2024-09-21T02:18:02.293 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T02:18:02.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T02:18:02.411 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913425' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client dirsize rbytes: false global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKDCE6JDZpSfHW0/RL6Fe/ezmmB6M0H2KkWRt2VvSodF5Yvzln2XyNPKtOBoApTxECMTjtowYIAU4pVeDafa26g= smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGYD9CckC++E5fXBKiKoe4o2LsOL6wFpFH7XU5yaSgOsXRStmPzuA6Ny3YbJ+Dlo8RKj6m3RLJ2UTA3kgWQPg6o= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOOId2CwP2yxNsRZYcU24eQPBJ418/VwHeAqWMEH8wp2g7K0IQdZRIT5RqgKGM1y7zt2cFETvXcBdEddGD6Z2+0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T02:18:02.411 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T02:18:02.412 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T02:18:02.412 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T02:18:02.414 INFO:teuthology.task.internal:Checking packages... 2024-09-21T02:18:02.432 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T02:18:02.433 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T02:18:02.433 INFO:teuthology.packaging:ref: None 2024-09-21T02:18:02.433 INFO:teuthology.packaging:tag: None 2024-09-21T02:18:02.433 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T02:18:02.433 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:18:02.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T02:18:02.576 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T02:18:02.578 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T02:18:02.584 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T02:18:02.584 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T02:18:02.613 INFO:teuthology.task.internal:Saving configuration 2024-09-21T02:18:02.633 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T02:18:02.643 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T02:18:02.668 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:12:14.189532', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKDCE6JDZpSfHW0/RL6Fe/ezmmB6M0H2KkWRt2VvSodF5Yvzln2XyNPKtOBoApTxECMTjtowYIAU4pVeDafa26g='} 2024-09-21T02:18:02.691 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:12:14.190755', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGYD9CckC++E5fXBKiKoe4o2LsOL6wFpFH7XU5yaSgOsXRStmPzuA6Ny3YbJ+Dlo8RKj6m3RLJ2UTA3kgWQPg6o='} 2024-09-21T02:18:02.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 02:12:14.187567', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOOId2CwP2yxNsRZYcU24eQPBJ418/VwHeAqWMEH8wp2g7K0IQdZRIT5RqgKGM1y7zt2cFETvXcBdEddGD6Z2+0='} 2024-09-21T02:18:02.712 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T02:18:02.718 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T02:18:02.719 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T02:18:02.719 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T02:18:02.719 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T02:18:02.831 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb34d050160>, signals=[15]) 2024-09-21T02:18:02.832 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T02:18:02.838 INFO:teuthology.task.internal:Opening connections... 2024-09-21T02:18:02.838 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:18:02.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:18:02.912 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T02:18:02.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:18:02.985 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-21T02:18:02.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:18:03.056 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T02:18:03.062 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-09-21T02:18:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-09-21T02:18:03.081 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-09-21T02:18:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-09-21T02:18:03.138 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:18:03.139 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:18:03.140 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-09-21T02:18:03.161 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-09-21T02:18:03.179 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-09-21T02:18:03.179 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-09-21T02:18:03.237 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-09-21T02:18:03.237 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-09-21T02:18:03.237 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-09-21T02:18:03.237 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:18:03.238 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:18:03.238 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-09-21T02:18:03.261 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-21T02:18:03.279 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-21T02:18:03.279 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-21T02:18:03.337 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-21T02:18:03.337 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-21T02:18:03.337 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-21T02:18:03.337 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-21T02:18:03.337 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-21T02:18:03.337 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-21T02:18:03.337 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T02:18:03.337 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-21T02:18:03.338 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-21T02:18:03.338 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T02:18:03.338 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-21T02:18:03.338 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T02:18:03.338 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T02:18:03.338 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T02:18:03.338 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-21T02:18:03.361 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T02:18:03.372 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T02:18:03.396 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T02:18:03.396 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:18:03.399 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:18:03.401 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-21T02:18:03.418 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T02:18:03.430 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T02:18:03.430 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:18:03.456 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:18:03.459 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-21T02:18:03.562 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T02:18:03.637 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T02:18:03.688 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T02:18:03.688 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-21T02:18:03.688 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-21T02:18:03.688 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:18:03.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:18:03.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-21T02:18:03.855 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T02:18:03.856 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-21T02:18:03.856 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-21T02:18:03.874 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-503.el9.x86_64 2024-09-21T02:18:03.874 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T02:18:03.874 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-21T02:18:03.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum upgrade -y linux-firmware 2024-09-21T02:18:10.133 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.3 MB 00:04 2024-09-21T02:18:15.017 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 20 MB 00:03 2024-09-21T02:18:20.100 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.5 MB 00:01 2024-09-21T02:18:22.009 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-21T02:18:22.921 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T02:18:28.535 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T02:18:30.546 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-21T02:18:30.552 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T02:18:30.552 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 1 Package 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 388 M 2024-09-21T02:18:30.553 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-21T02:19:20.286 INFO:teuthology.orchestra.run.smithi084.stdout:linux-firmware-20240905-146.el9.noarch.rpm 7.8 MB/s | 388 MB 00:49 2024-09-21T02:19:20.286 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:19:20.286 INFO:teuthology.orchestra.run.smithi084.stdout:Total 7.8 MB/s | 388 MB 00:49 2024-09-21T02:19:23.401 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-21T02:19:23.489 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-21T02:19:23.489 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-21T02:19:26.751 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-21T02:19:26.751 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-21T02:19:35.796 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-21T02:19:36.495 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T02:19:36.575 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T02:19:37.086 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T02:19:37.086 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-21T02:19:37.849 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-21T02:19:37.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:19:37.849 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-09-21T02:19:37.849 INFO:teuthology.orchestra.run.smithi084.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-21T02:19:37.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:19:37.849 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-21T02:19:38.199 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T02:19:38.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-21T02:19:38.353 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-21T02:19:38.353 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-21T02:19:38.356 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi084.front.sepia.ceph.com to complete... 2024-09-21T02:19:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21 02:19:46 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-21T02:19:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:FINISHED --2024-09-21 02:19:46-- 2024-09-21T02:19:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:Total wall clock time: 8.0s 2024-09-21T02:19:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:Downloaded: 1 files, 343M in 7.8s (44.1 MB/s) 2024-09-21T02:19:46.423 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-21T02:19:46.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-21T02:19:48.520 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying... ######################################## 2024-09-21T02:19:48.583 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing... ######################################## 2024-09-21T02:19:48.642 INFO:teuthology.orchestra.run.smithi084.stdout:Updating / installing... 2024-09-21T02:19:56.594 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-21T02:20:36.519 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-21T02:20:36.520 DEBUG:teuthology.orchestra.run.smithi084:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-21T02:20:36.604 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:36.604 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-21T02:20:36.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-21T02:20:36.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-21T02:20:36.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-21T02:20:36.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-21T02:20:36.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-21T02:20:36.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-21T02:20:36.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-21T02:20:36.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-21T02:20:36.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-21T02:20:36.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-21T02:20:36.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-21T02:20:36.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-21T02:20:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-21T02:20:36.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-21T02:20:36.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-21T02:20:36.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-21T02:20:36.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-21T02:20:36.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-21T02:20:36.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-21T02:20:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-21T02:20:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-21T02:20:36.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-21T02:20:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-21T02:20:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-21T02:20:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-21T02:20:36.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-21T02:20:36.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-21T02:20:36.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-21T02:20:36.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-21T02:20:36.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-21T02:20:36.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-21T02:20:36.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-21T02:20:36.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-21T02:20:36.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-21T02:20:36.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-21T02:20:36.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-21T02:20:36.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-21T02:20:36.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-21T02:20:36.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-21T02:20:36.644 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-21T02:20:36.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-21T02:20:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-21T02:20:36.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-21T02:20:36.648 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-21T02:20:36.649 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-21T02:20:36.650 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-21T02:20:36.651 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-21T02:20:36.652 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-21T02:20:36.653 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-21T02:20:36.654 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-21T02:20:36.655 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-21T02:20:36.656 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-21T02:20:36.657 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-21T02:20:36.658 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-21T02:20:36.659 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-21T02:20:36.660 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-21T02:20:36.661 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-21T02:20:36.662 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-21T02:20:36.663 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-21T02:20:36.664 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-21T02:20:36.665 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-21T02:20:36.666 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-21T02:20:36.667 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-21T02:20:36.668 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-21T02:20:36.669 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-21T02:20:36.670 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-21T02:20:36.671 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-21T02:20:36.672 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-21T02:20:36.673 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-21T02:20:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-21T02:20:36.675 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-21T02:20:36.676 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-21T02:20:36.677 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-21T02:20:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-21T02:20:36.679 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-21T02:20:36.680 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-21T02:20:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-21T02:20:36.682 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-21T02:20:36.683 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-21T02:20:36.684 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-21T02:20:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-21T02:20:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-21T02:20:36.687 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-21T02:20:36.688 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-21T02:20:36.689 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-21T02:20:36.690 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-21T02:20:36.691 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-21T02:20:36.692 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-21T02:20:36.693 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-21T02:20:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-21T02:20:36.695 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-21T02:20:36.696 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-21T02:20:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-21T02:20:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-21T02:20:36.699 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-21T02:20:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-21T02:20:36.701 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-21T02:20:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-21T02:20:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-21T02:20:36.704 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-21T02:20:36.705 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-21T02:20:36.706 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-21T02:20:36.707 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-21T02:20:36.708 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-21T02:20:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-21T02:20:36.710 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-21T02:20:36.711 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-21T02:20:36.712 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-21T02:20:36.713 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-21T02:20:36.714 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-21T02:20:36.715 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-21T02:20:36.716 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-21T02:20:36.717 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-21T02:20:36.718 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-21T02:20:36.719 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-21T02:20:36.720 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-21T02:20:36.721 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-21T02:20:36.722 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-21T02:20:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-21T02:20:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-21T02:20:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-21T02:20:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-21T02:20:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-21T02:20:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-21T02:20:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-21T02:20:36.730 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-21T02:20:36.731 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-21T02:20:36.732 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-21T02:20:36.733 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-21T02:20:36.734 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-21T02:20:36.735 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-21T02:20:36.736 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-21T02:20:36.737 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-21T02:20:36.738 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-21T02:20:36.739 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-21T02:20:36.740 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-21T02:20:36.741 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-21T02:20:36.742 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-21T02:20:36.743 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-21T02:20:36.744 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-21T02:20:36.745 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T02:20:36.749 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:36.749 DEBUG:teuthology.orchestra.run.smithi084:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout:postinstall scriptlet (using /bin/sh): 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout:for file in vmlinuz System.map config; do 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout: fi 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout:done 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-21T02:20:36.772 INFO:teuthology.orchestra.run.smithi084.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:36.773 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2024-09-21T02:20:36.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.06 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 82.el9 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Group : Unspecified 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 8274670 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T02:20:36.856 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : builder@centos.org 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T02:20:36.857 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-09-21T02:20:36.858 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:20:36.858 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T02:20:36.858 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T02:20:36.858 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:36.859 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T02:20:37.408 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-09-21T02:20:38.777 INFO:teuthology.orchestra.run.smithi084.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T02:20:38.795 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-09-21T02:20:38.797 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-09-21T02:20:38.812 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.muVgGMXVB9 2024-09-21T02:20:38.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.muVgGMXVB9 2024-09-21T02:20:38.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.muVgGMXVB9 2024-09-21T02:20:39.016 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.muVgGMXVB9 is 6KB 2024-09-21T02:20:39.064 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.muVgGMXVB9 2024-09-21T02:20:39.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T02:20:39.147 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T02:20:39.147 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T02:20:39.147 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T02:20:39.147 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-21T02:20:39.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:20:39.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-09-21T02:21:09.310 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T02:21:09.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T02:21:09.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:21:27.663 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-09-21T02:21:36.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T02:21:36.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:22:36.667 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T02:22:48.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T02:22:48.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:22:49.016 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-21T02:22:49.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T02:22:49.499 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-21T02:22:49.500 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-21T02:22:49.533 INFO:teuthology.orchestra.run.smithi084.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:22:49.533 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-21T02:22:49.534 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T02:22:49.534 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T02:22:50.534 DEBUG:teuthology.parallel:result is None 2024-09-21T02:22:50.534 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T02:22:50.541 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T02:22:50.541 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:22:50.545 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:22:50.548 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T02:22:50.578 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T02:22:50.588 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T02:22:50.621 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T02:22:50.622 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:22:50.626 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:22:50.628 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T02:22:50.962 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T02:22:50.969 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T02:22:50.969 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:22:50.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:22:50.986 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T02:22:51.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:22:51.004 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:22:51.008 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:22:51.029 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T02:22:51.087 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:22:51.093 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:22:51.107 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:22:51.107 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:22:51.108 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:22:51.140 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T02:22:51.143 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T02:22:51.150 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T02:22:51.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:22:51.154 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:22:51.157 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T02:22:51.208 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T02:22:51.216 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T02:22:51.217 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:22:51.221 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:22:51.225 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T02:22:51.251 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:22:51.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:22:51.435 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:22:51.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:22:51.568 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:22:51.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:22:51.622 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:22:51.667 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:22:51.720 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:22:51.805 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:22:51.848 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:22:51.848 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:22:51.915 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:22:51.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T02:22:52.024 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:22:52.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T02:22:52.112 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:22:52.112 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T02:22:52.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-09-21T02:22:52.182 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-09-21T02:22:52.185 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-21T02:22:52.222 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:22:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:22:52.263 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:22:52.793 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T02:22:52.800 INFO:teuthology.task.internal:Starting timer... 2024-09-21T02:22:52.801 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T02:22:52.834 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T02:22:52.866 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T02:22:52.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-09-21T02:22:52.950 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-09-21T02:22:52.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2024-09-21T02:22:53.014 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: 2024-09-21T02:22:53.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-21T02:22:53.076 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-21T02:22:53.078 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T02:22:53.078 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-09-21T02:22:53.117 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-09-21T02:22:53.117 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2024-09-21T02:22:53.144 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2024-09-21T02:22:53.144 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-21T02:22:53.178 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-21T02:22:53.179 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi090.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-09-21T02:22:53.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:22:53.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:22:53.238 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:22:53.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:22:53.267 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:22:53.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:22:53.295 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T02:22:53.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:22:53.363 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:22:53.400 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-21T02:22:53.431 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T02:22:53.440 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T02:22:53.443 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T02:22:53.555 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T02:22:53.568 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T02:22:53.569 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi090.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T02:27:25.617 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-09-21T02:27:25.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T02:27:25.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:27:25.707 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-21T02:27:25.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T02:27:25.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T02:27:25.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:27:25.894 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-09-21T02:27:25.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-09-21T02:27:25.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-21T02:27:25.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T02:27:26.053 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-21T02:27:26.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-21T02:27:26.140 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T02:27:26.151 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T02:27:26.151 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:27:26.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:27:26.156 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:27:26.156 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:27:26.158 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T02:27:26.158 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:27:26.188 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:27:26.204 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:27:26.214 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:27:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T02:27:26.229 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2024-09-21T02:27:26.230 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:27:26.241 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2024-09-21T02:27:26.245 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T02:27:26.255 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:27:26.256 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-21T02:27:26.268 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-21T02:27:26.269 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:27:26.283 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:27:26.297 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:27:26.300 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-09-21T02:27:26.324 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:27:26.324 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-09-21T02:27:26.327 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:27:26.327 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-09-21T02:27:26.327 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.327 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.327 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.327 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.353 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T02:27:26.353 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:27:26.357 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:27:26.357 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-21T02:27:26.357 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.357 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.357 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.357 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.383 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T02:27:26.488 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:27:26.496 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:27:26.496 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-21T02:27:26.496 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.496 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.496 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.496 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:27:26.497 INFO:teuthology.run_tasks:Running task install... 2024-09-21T02:27:26.505 DEBUG:teuthology.task.install:project ceph 2024-09-21T02:27:26.505 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T02:27:26.505 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T02:27:26.505 INFO:teuthology.task.install:Using flavor: default 2024-09-21T02:27:26.510 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T02:27:26.510 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T02:27:26.511 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:27:26.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:27:26.513 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:27:26.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:27:26.514 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T02:27:26.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:27:26.661 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:27:26.662 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:27:26.667 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:27:26.668 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:27:26.672 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T02:27:26.672 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T02:27:26.769 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:27:26.769 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:27:26.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:27:26.776 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:27:26.776 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:27:26.776 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:27:26.780 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T02:27:26.780 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:27:26.780 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T02:27:26.803 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:27:26.804 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:27:26.806 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:27:26.806 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:27:26.826 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T02:27:26.826 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T02:27:26.870 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:27:26.872 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:27:26.923 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T02:27:26.945 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:27:26.947 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:27:27.000 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T02:27:27.009 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2024-09-21T02:27:27.011 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2024-09-21T02:27:27.011 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-21T02:27:27.012 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-21T02:27:27.055 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-09-21T02:27:27.059 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-09-21T02:27:27.235 INFO:teuthology.orchestra.run.smithi090.stdout:45 files removed 2024-09-21T02:27:27.238 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-21T02:27:27.262 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:27:27.265 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:27:27.325 INFO:teuthology.orchestra.run.smithi084.stdout:45 files removed 2024-09-21T02:27:27.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T02:27:27.813 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-21T02:27:27.824 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-21T02:27:28.048 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 287 kB/s | 84 kB 00:00 2024-09-21T02:27:28.116 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T02:27:28.181 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 74 kB/s | 24 kB 00:00 2024-09-21T02:27:28.349 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T02:27:28.392 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T02:27:28.448 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T02:27:28.641 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-21T02:27:28.882 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.3 MB 00:00 2024-09-21T02:27:28.975 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T02:27:29.249 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T02:27:30.775 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T02:27:34.501 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-21T02:27:34.841 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-21T02:27:36.177 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-21T02:27:37.546 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 123 kB/s | 19 kB 00:00 2024-09-21T02:27:38.592 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-21T02:27:39.325 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T02:27:39.785 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-21T02:27:41.059 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-21T02:27:41.460 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-21T02:27:42.180 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T02:27:42.423 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T02:27:44.049 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-21T02:27:46.193 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:27:46.194 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:27:46.205 INFO:teuthology.orchestra.run.smithi090.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:27:46.206 INFO:teuthology.orchestra.run.smithi090.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:27:46.207 INFO:teuthology.orchestra.run.smithi090.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:27:46.208 INFO:teuthology.orchestra.run.smithi090.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:27:46.209 INFO:teuthology.orchestra.run.smithi090.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:27:46.212 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:27:46.212 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:27:46.274 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-09-21T02:27:46.297 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-21T02:27:46.297 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-09-21T02:27:46.297 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:27:46.298 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:27:46.299 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-09-21T02:27:46.300 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:27:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:27:46.302 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:27:46.303 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:27:46.304 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:27:46.305 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:27:46.306 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:27:46.307 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:27:46.308 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:27:46.309 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-09-21T02:27:46.310 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-09-21T02:27:46.310 INFO:teuthology.orchestra.run.smithi090.stdout:Install 149 Packages 2024-09-21T02:27:46.310 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 8 Packages 2024-09-21T02:27:46.310 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:27:46.310 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 228 M 2024-09-21T02:27:46.310 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-09-21T02:27:46.976 INFO:teuthology.orchestra.run.smithi090.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T02:27:47.293 INFO:teuthology.orchestra.run.smithi090.stdout:(2/157): ceph-base-19.3.0-5120.g18432218.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-21T02:27:47.335 INFO:teuthology.orchestra.run.smithi090.stdout:(3/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.4 MB/s | 873 kB 00:00 2024-09-21T02:27:47.360 INFO:teuthology.orchestra.run.smithi090.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T02:27:47.461 INFO:teuthology.orchestra.run.smithi090.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 15 MB/s | 1.5 MB 00:00 2024-09-21T02:27:47.736 INFO:teuthology.orchestra.run.smithi090.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.0 MB 00:00 2024-09-21T02:27:47.796 INFO:teuthology.orchestra.run.smithi090.stdout:(7/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 5.0 MB/s | 2.3 MB 00:00 2024-09-21T02:27:47.820 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T02:27:48.213 INFO:teuthology.orchestra.run.smithi090.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 15 MB/s | 20 MB 00:01 2024-09-21T02:27:48.263 INFO:teuthology.orchestra.run.smithi090.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T02:27:48.485 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-21T02:27:48.555 INFO:teuthology.orchestra.run.smithi090.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 22 MB/s | 18 MB 00:00 2024-09-21T02:27:48.605 INFO:teuthology.orchestra.run.smithi090.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T02:27:48.731 INFO:teuthology.orchestra.run.smithi090.stdout:(12/157): ceph-radosgw-19.3.0-5120.g18432218.el 11 MB/s | 10 MB 00:00 2024-09-21T02:27:48.756 INFO:teuthology.orchestra.run.smithi090.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 180 kB/s | 27 kB 00:00 2024-09-21T02:27:48.781 INFO:teuthology.orchestra.run.smithi090.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 634 kB/s | 32 kB 00:00 2024-09-21T02:27:48.823 INFO:teuthology.orchestra.run.smithi090.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T02:27:48.857 INFO:teuthology.orchestra.run.smithi090.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T02:27:48.882 INFO:teuthology.orchestra.run.smithi090.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T02:27:48.916 INFO:teuthology.orchestra.run.smithi090.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.4 MB/s | 507 kB 00:00 2024-09-21T02:27:48.983 INFO:teuthology.orchestra.run.smithi090.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 677 kB/s | 45 kB 00:00 2024-09-21T02:27:49.100 INFO:teuthology.orchestra.run.smithi090.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.2 MB/s | 148 kB 00:00 2024-09-21T02:27:49.192 INFO:teuthology.orchestra.run.smithi090.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.3 MB 00:00 2024-09-21T02:27:49.217 INFO:teuthology.orchestra.run.smithi090.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.3 MB/s | 161 kB 00:00 2024-09-21T02:27:49.251 INFO:teuthology.orchestra.run.smithi090.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T02:27:49.276 INFO:teuthology.orchestra.run.smithi090.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T02:27:49.302 INFO:teuthology.orchestra.run.smithi090.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T02:27:49.327 INFO:teuthology.orchestra.run.smithi090.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T02:27:49.386 INFO:teuthology.orchestra.run.smithi090.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T02:27:49.453 INFO:teuthology.orchestra.run.smithi090.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 21 MB/s | 3.1 MB 00:00 2024-09-21T02:27:49.478 INFO:teuthology.orchestra.run.smithi090.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 373 kB/s | 34 kB 00:00 2024-09-21T02:27:49.514 INFO:teuthology.orchestra.run.smithi090.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.5 MB/s | 154 kB 00:00 2024-09-21T02:27:49.940 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:27:49.941 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:27:49.948 INFO:teuthology.orchestra.run.smithi090.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-21T02:27:49.954 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:27:49.955 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:27:49.956 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:27:49.957 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:27:49.959 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:27:49.962 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:27:49.963 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:27:50.015 INFO:teuthology.orchestra.run.smithi090.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T02:27:50.026 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:27:50.041 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:27:50.042 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:27:50.043 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:27:50.044 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:27:50.045 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:27:50.046 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:27:50.047 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:27:50.048 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:27:50.049 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:27:50.050 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:27:50.051 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout:Install 149 Packages 2024-09-21T02:27:50.052 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 8 Packages 2024-09-21T02:27:50.053 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:27:50.053 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 228 M 2024-09-21T02:27:50.053 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-21T02:27:50.098 INFO:teuthology.orchestra.run.smithi090.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 592 kB/s | 49 kB 00:00 2024-09-21T02:27:50.165 INFO:teuthology.orchestra.run.smithi090.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 246 kB/s | 16 kB 00:00 2024-09-21T02:27:50.324 INFO:teuthology.orchestra.run.smithi090.stdout:(35/157): ceph-mgr-dashboard-19.3.0-5120.g18432 17 MB/s | 14 MB 00:00 2024-09-21T02:27:50.349 INFO:teuthology.orchestra.run.smithi090.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 1.5 MB/s | 285 kB 00:00 2024-09-21T02:27:50.383 INFO:teuthology.orchestra.run.smithi090.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 13 MB/s | 784 kB 00:00 2024-09-21T02:27:50.408 INFO:teuthology.orchestra.run.smithi090.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 313 kB/s | 18 kB 00:00 2024-09-21T02:27:50.713 INFO:teuthology.orchestra.run.smithi172.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-09-21T02:27:50.816 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:27:50.817 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T02:27:50.830 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T02:27:50.831 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T02:27:50.832 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T02:27:50.834 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T02:27:50.835 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T02:27:50.838 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T02:27:50.839 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T02:27:50.851 INFO:teuthology.orchestra.run.smithi090.stdout:(39/157): ceph-test-19.3.0-5120.g18432218.el9.x 15 MB/s | 40 MB 00:02 2024-09-21T02:27:50.905 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-21T02:27:50.930 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T02:27:50.930 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-21T02:27:50.930 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T02:27:50.930 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T02:27:50.931 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T02:27:50.932 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T02:27:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T02:27:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T02:27:50.935 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T02:27:50.936 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T02:27:50.937 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T02:27:50.938 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T02:27:50.939 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T02:27:50.940 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T02:27:50.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:27:50.942 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-21T02:27:50.942 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T02:27:50.942 INFO:teuthology.orchestra.run.smithi084.stdout:Install 149 Packages 2024-09-21T02:27:50.942 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 8 Packages 2024-09-21T02:27:50.942 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:27:50.942 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 228 M 2024-09-21T02:27:50.942 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-21T02:27:50.955 INFO:teuthology.orchestra.run.smithi172.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-21T02:27:50.967 INFO:teuthology.orchestra.run.smithi090.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 137 kB/s | 80 kB 00:00 2024-09-21T02:27:51.009 INFO:teuthology.orchestra.run.smithi090.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T02:27:51.060 INFO:teuthology.orchestra.run.smithi090.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-21T02:27:51.072 INFO:teuthology.orchestra.run.smithi172.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T02:27:51.093 INFO:teuthology.orchestra.run.smithi090.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-21T02:27:51.105 INFO:teuthology.orchestra.run.smithi172.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 986 kB/s | 148 kB 00:00 2024-09-21T02:27:51.119 INFO:teuthology.orchestra.run.smithi090.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T02:27:51.144 INFO:teuthology.orchestra.run.smithi090.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T02:27:51.181 INFO:teuthology.orchestra.run.smithi172.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 21 MB/s | 2.3 MB 00:00 2024-09-21T02:27:51.187 INFO:teuthology.orchestra.run.smithi090.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 6.9 MB/s | 1.2 MB 00:00 2024-09-21T02:27:51.212 INFO:teuthology.orchestra.run.smithi090.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-21T02:27:51.237 INFO:teuthology.orchestra.run.smithi090.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T02:27:51.354 INFO:teuthology.orchestra.run.smithi090.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 916 kB/s | 107 kB 00:00 2024-09-21T02:27:51.381 INFO:teuthology.orchestra.run.smithi172.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-09-21T02:27:51.388 INFO:teuthology.orchestra.run.smithi090.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-21T02:27:51.414 INFO:teuthology.orchestra.run.smithi090.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 362 kB/s | 22 kB 00:00 2024-09-21T02:27:51.448 INFO:teuthology.orchestra.run.smithi090.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-21T02:27:51.456 INFO:teuthology.orchestra.run.smithi172.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.0 MB 00:00 2024-09-21T02:27:51.473 INFO:teuthology.orchestra.run.smithi090.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-21T02:27:51.498 INFO:teuthology.orchestra.run.smithi090.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T02:27:51.524 INFO:teuthology.orchestra.run.smithi090.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-21T02:27:51.549 INFO:teuthology.orchestra.run.smithi090.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-21T02:27:51.575 INFO:teuthology.orchestra.run.smithi090.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T02:27:51.641 INFO:teuthology.orchestra.run.smithi090.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-21T02:27:51.665 INFO:teuthology.orchestra.run.smithi172.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T02:27:51.667 INFO:teuthology.orchestra.run.smithi090.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T02:27:51.692 INFO:teuthology.orchestra.run.smithi090.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-21T02:27:51.715 INFO:teuthology.orchestra.run.smithi172.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T02:27:51.734 INFO:teuthology.orchestra.run.smithi090.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-21T02:27:51.759 INFO:teuthology.orchestra.run.smithi090.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-21T02:27:51.785 INFO:teuthology.orchestra.run.smithi090.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-21T02:27:51.818 INFO:teuthology.orchestra.run.smithi090.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-21T02:27:51.852 INFO:teuthology.orchestra.run.smithi090.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T02:27:51.877 INFO:teuthology.orchestra.run.smithi090.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-21T02:27:51.903 INFO:teuthology.orchestra.run.smithi090.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T02:27:51.978 INFO:teuthology.orchestra.run.smithi090.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T02:27:52.003 INFO:teuthology.orchestra.run.smithi084.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-09-21T02:27:52.053 INFO:teuthology.orchestra.run.smithi090.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-09-21T02:27:52.087 INFO:teuthology.orchestra.run.smithi090.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-21T02:27:52.112 INFO:teuthology.orchestra.run.smithi090.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T02:27:52.150 INFO:teuthology.orchestra.run.smithi172.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 15 MB/s | 10 MB 00:00 2024-09-21T02:27:52.178 INFO:teuthology.orchestra.run.smithi084.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-21T02:27:52.188 INFO:teuthology.orchestra.run.smithi090.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 15 MB/s | 4.9 MB 00:00 2024-09-21T02:27:52.224 INFO:teuthology.orchestra.run.smithi172.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.0 MB/s | 226 kB 00:00 2024-09-21T02:27:52.229 INFO:teuthology.orchestra.run.smithi090.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-21T02:27:52.255 INFO:teuthology.orchestra.run.smithi090.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T02:27:52.297 INFO:teuthology.orchestra.run.smithi090.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T02:27:52.341 INFO:teuthology.orchestra.run.smithi172.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 232 kB/s | 27 kB 00:00 2024-09-21T02:27:52.390 INFO:teuthology.orchestra.run.smithi090.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-21T02:27:52.424 INFO:teuthology.orchestra.run.smithi090.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-21T02:27:52.424 INFO:teuthology.orchestra.run.smithi172.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 382 kB/s | 32 kB 00:00 2024-09-21T02:27:52.457 INFO:teuthology.orchestra.run.smithi090.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-21T02:27:52.483 INFO:teuthology.orchestra.run.smithi090.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 26 kB 00:00 2024-09-21T02:27:52.495 INFO:teuthology.orchestra.run.smithi084.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 7.2 MB/s | 5.5 MB 00:00 2024-09-21T02:27:52.508 INFO:teuthology.orchestra.run.smithi090.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T02:27:52.516 INFO:teuthology.orchestra.run.smithi172.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T02:27:52.542 INFO:teuthology.orchestra.run.smithi090.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T02:27:52.567 INFO:teuthology.orchestra.run.smithi090.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-09-21T02:27:52.617 INFO:teuthology.orchestra.run.smithi172.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 1.5 MB/s | 158 kB 00:00 2024-09-21T02:27:52.659 INFO:teuthology.orchestra.run.smithi090.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-21T02:27:52.693 INFO:teuthology.orchestra.run.smithi090.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-21T02:27:52.717 INFO:teuthology.orchestra.run.smithi172.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.2 MB/s | 127 kB 00:00 2024-09-21T02:27:52.718 INFO:teuthology.orchestra.run.smithi090.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T02:27:52.737 INFO:teuthology.orchestra.run.smithi084.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.5 MB/s | 2.3 MB 00:00 2024-09-21T02:27:52.743 INFO:teuthology.orchestra.run.smithi090.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T02:27:52.769 INFO:teuthology.orchestra.run.smithi090.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-21T02:27:52.770 INFO:teuthology.orchestra.run.smithi084.stdout:(5/157): ceph-immutable-object-cache-19.3.0-512 250 kB/s | 148 kB 00:00 2024-09-21T02:27:52.802 INFO:teuthology.orchestra.run.smithi090.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-21T02:27:52.817 INFO:teuthology.orchestra.run.smithi172.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 4.9 MB/s | 507 kB 00:00 2024-09-21T02:27:52.836 INFO:teuthology.orchestra.run.smithi090.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-21T02:27:52.861 INFO:teuthology.orchestra.run.smithi090.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-21T02:27:52.887 INFO:teuthology.orchestra.run.smithi090.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T02:27:52.912 INFO:teuthology.orchestra.run.smithi090.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T02:27:53.004 INFO:teuthology.orchestra.run.smithi090.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-21T02:27:53.013 INFO:teuthology.orchestra.run.smithi084.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-09-21T02:27:53.021 INFO:teuthology.orchestra.run.smithi090.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-21T02:27:53.046 INFO:teuthology.orchestra.run.smithi090.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T02:27:53.080 INFO:teuthology.orchestra.run.smithi090.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T02:27:53.106 INFO:teuthology.orchestra.run.smithi090.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-09-21T02:27:53.131 INFO:teuthology.orchestra.run.smithi090.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T02:27:53.165 INFO:teuthology.orchestra.run.smithi090.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T02:27:53.190 INFO:teuthology.orchestra.run.smithi090.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-21T02:27:53.217 INFO:teuthology.orchestra.run.smithi090.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.8 MB/s | 96 kB 00:00 2024-09-21T02:27:53.242 INFO:teuthology.orchestra.run.smithi090.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T02:27:53.267 INFO:teuthology.orchestra.run.smithi090.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-21T02:27:53.276 INFO:teuthology.orchestra.run.smithi172.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-21T02:27:53.304 INFO:teuthology.orchestra.run.smithi084.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 13 MB/s | 20 MB 00:01 2024-09-21T02:27:53.326 INFO:teuthology.orchestra.run.smithi172.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 906 kB/s | 45 kB 00:00 2024-09-21T02:27:53.409 INFO:teuthology.orchestra.run.smithi172.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T02:27:53.510 INFO:teuthology.orchestra.run.smithi172.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.6 MB/s | 161 kB 00:00 2024-09-21T02:27:53.526 INFO:teuthology.orchestra.run.smithi090.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-21T02:27:53.551 INFO:teuthology.orchestra.run.smithi090.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-21T02:27:53.602 INFO:teuthology.orchestra.run.smithi172.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.4 MB/s | 321 kB 00:00 2024-09-21T02:27:53.610 INFO:teuthology.orchestra.run.smithi090.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-21T02:27:53.652 INFO:teuthology.orchestra.run.smithi090.stdout:(107/157): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-21T02:27:53.686 INFO:teuthology.orchestra.run.smithi090.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.2 MB/s | 308 kB 00:00 2024-09-21T02:27:53.693 INFO:teuthology.orchestra.run.smithi172.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 3.3 MB/s | 307 kB 00:00 2024-09-21T02:27:53.711 INFO:teuthology.orchestra.run.smithi090.stdout:(109/157): grpc-data-1.46.7-10.el9.noarch.rpm 197 kB/s | 19 kB 00:00 2024-09-21T02:27:53.736 INFO:teuthology.orchestra.run.smithi090.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-09-21T02:27:53.761 INFO:teuthology.orchestra.run.smithi090.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 961 kB/s | 49 kB 00:00 2024-09-21T02:27:53.787 INFO:teuthology.orchestra.run.smithi090.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T02:27:53.812 INFO:teuthology.orchestra.run.smithi090.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T02:27:53.871 INFO:teuthology.orchestra.run.smithi090.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-21T02:27:53.904 INFO:teuthology.orchestra.run.smithi090.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-21T02:27:53.938 INFO:teuthology.orchestra.run.smithi090.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 965 kB/s | 32 kB 00:00 2024-09-21T02:27:53.944 INFO:teuthology.orchestra.run.smithi172.stdout:(24/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 7.0 MB/s | 18 MB 00:02 2024-09-21T02:27:53.963 INFO:teuthology.orchestra.run.smithi090.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-21T02:27:53.969 INFO:teuthology.orchestra.run.smithi172.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 361 kB/s | 99 kB 00:00 2024-09-21T02:27:53.981 INFO:teuthology.orchestra.run.smithi090.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-21T02:27:53.994 INFO:teuthology.orchestra.run.smithi172.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T02:27:54.014 INFO:teuthology.orchestra.run.smithi090.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T02:27:54.038 INFO:teuthology.orchestra.run.smithi084.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 14 MB/s | 10 MB 00:00 2024-09-21T02:27:54.048 INFO:teuthology.orchestra.run.smithi090.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T02:27:54.186 INFO:teuthology.orchestra.run.smithi090.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-09-21T02:27:54.215 INFO:teuthology.orchestra.run.smithi090.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2024-09-21T02:27:54.238 INFO:teuthology.orchestra.run.smithi084.stdout:(9/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 15 MB/s | 18 MB 00:01 2024-09-21T02:27:54.241 INFO:teuthology.orchestra.run.smithi090.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.1 MB/s | 220 kB 00:00 2024-09-21T02:27:54.255 INFO:teuthology.orchestra.run.smithi084.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 116 kB/s | 25 kB 00:00 2024-09-21T02:27:54.266 INFO:teuthology.orchestra.run.smithi090.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-21T02:27:54.292 INFO:teuthology.orchestra.run.smithi090.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.8 MB/s | 144 kB 00:00 2024-09-21T02:27:54.305 INFO:teuthology.orchestra.run.smithi084.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T02:27:54.318 INFO:teuthology.orchestra.run.smithi090.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 343 kB/s | 18 kB 00:00 2024-09-21T02:27:54.343 INFO:teuthology.orchestra.run.smithi090.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T02:27:54.355 INFO:teuthology.orchestra.run.smithi084.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 544 kB/s | 27 kB 00:00 2024-09-21T02:27:54.362 INFO:teuthology.orchestra.run.smithi172.stdout:(27/157): ceph-test-19.3.0-5120.g18432218.el9.x 15 MB/s | 40 MB 00:02 2024-09-21T02:27:54.368 INFO:teuthology.orchestra.run.smithi090.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T02:27:54.387 INFO:teuthology.orchestra.run.smithi172.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 434 kB/s | 170 kB 00:00 2024-09-21T02:27:54.394 INFO:teuthology.orchestra.run.smithi090.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-21T02:27:54.412 INFO:teuthology.orchestra.run.smithi172.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 687 kB/s | 34 kB 00:00 2024-09-21T02:27:54.414 INFO:teuthology.orchestra.run.smithi084.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 545 kB/s | 32 kB 00:00 2024-09-21T02:27:54.419 INFO:teuthology.orchestra.run.smithi090.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T02:27:54.437 INFO:teuthology.orchestra.run.smithi172.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T02:27:54.486 INFO:teuthology.orchestra.run.smithi090.stdout:(131/157): python3-grpcio-1.46.7-10.el9.x86_64. 6.8 MB/s | 2.0 MB 00:00 2024-09-21T02:27:54.504 INFO:teuthology.orchestra.run.smithi172.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 5.8 MB/s | 3.1 MB 00:00 2024-09-21T02:27:54.506 INFO:teuthology.orchestra.run.smithi084.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T02:27:54.512 INFO:teuthology.orchestra.run.smithi090.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 858 kB/s | 79 kB 00:00 2024-09-21T02:27:54.537 INFO:teuthology.orchestra.run.smithi090.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-21T02:27:54.562 INFO:teuthology.orchestra.run.smithi090.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-21T02:27:54.587 INFO:teuthology.orchestra.run.smithi090.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-21T02:27:54.590 INFO:teuthology.orchestra.run.smithi084.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 1.9 MB/s | 158 kB 00:00 2024-09-21T02:27:54.596 INFO:teuthology.orchestra.run.smithi172.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T02:27:54.613 INFO:teuthology.orchestra.run.smithi090.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-21T02:27:54.638 INFO:teuthology.orchestra.run.smithi090.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-21T02:27:54.664 INFO:teuthology.orchestra.run.smithi090.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-21T02:27:54.680 INFO:teuthology.orchestra.run.smithi172.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 593 kB/s | 49 kB 00:00 2024-09-21T02:27:54.690 INFO:teuthology.orchestra.run.smithi084.stdout:(16/157): ceph-mon-19.3.0-5120.g18432218.el9.x8 2.6 MB/s | 5.0 MB 00:01 2024-09-21T02:27:54.706 INFO:teuthology.orchestra.run.smithi090.stdout:(139/157): python3-kubernetes-26.1.0-2.el9.noar 3.0 MB/s | 1.0 MB 00:00 2024-09-21T02:27:54.715 INFO:teuthology.orchestra.run.smithi084.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.0 MB/s | 127 kB 00:00 2024-09-21T02:27:54.738 INFO:teuthology.orchestra.run.smithi172.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 283 kB/s | 16 kB 00:00 2024-09-21T02:27:54.739 INFO:teuthology.orchestra.run.smithi090.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-21T02:27:54.764 INFO:teuthology.orchestra.run.smithi090.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 587 kB/s | 59 kB 00:00 2024-09-21T02:27:54.790 INFO:teuthology.orchestra.run.smithi090.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2024-09-21T02:27:54.815 INFO:teuthology.orchestra.run.smithi090.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-21T02:27:54.839 INFO:teuthology.orchestra.run.smithi172.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 2.8 MB/s | 285 kB 00:00 2024-09-21T02:27:54.840 INFO:teuthology.orchestra.run.smithi090.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T02:27:54.874 INFO:teuthology.orchestra.run.smithi090.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T02:27:54.900 INFO:teuthology.orchestra.run.smithi090.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-09-21T02:27:54.907 INFO:teuthology.orchestra.run.smithi084.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 2.3 MB/s | 507 kB 00:00 2024-09-21T02:27:54.933 INFO:teuthology.orchestra.run.smithi090.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T02:27:54.967 INFO:teuthology.orchestra.run.smithi090.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T02:27:55.007 INFO:teuthology.orchestra.run.smithi084.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 453 kB/s | 45 kB 00:00 2024-09-21T02:27:55.014 INFO:teuthology.orchestra.run.smithi172.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 4.4 MB/s | 784 kB 00:00 2024-09-21T02:27:55.026 INFO:teuthology.orchestra.run.smithi090.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T02:27:55.097 INFO:teuthology.orchestra.run.smithi172.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 222 kB/s | 18 kB 00:00 2024-09-21T02:27:55.141 INFO:teuthology.orchestra.run.smithi084.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-21T02:27:55.175 INFO:teuthology.orchestra.run.smithi084.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 890 kB/s | 148 kB 00:00 2024-09-21T02:27:55.177 INFO:teuthology.orchestra.run.smithi090.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-09-21T02:27:55.216 INFO:teuthology.orchestra.run.smithi084.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T02:27:55.252 INFO:teuthology.orchestra.run.smithi090.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-21T02:27:55.283 INFO:teuthology.orchestra.run.smithi084.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.9 MB/s | 321 kB 00:00 2024-09-21T02:27:55.303 INFO:teuthology.orchestra.run.smithi090.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 820 kB/s | 41 kB 00:00 2024-09-21T02:27:55.309 INFO:teuthology.orchestra.run.smithi084.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.3 MB/s | 307 kB 00:00 2024-09-21T02:27:55.353 INFO:teuthology.orchestra.run.smithi090.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-21T02:27:55.356 INFO:teuthology.orchestra.run.smithi172.stdout:(38/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T02:27:55.363 INFO:teuthology.orchestra.run.smithi084.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.2 MB/s | 99 kB 00:00 2024-09-21T02:27:55.384 INFO:teuthology.orchestra.run.smithi084.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.1 MB/s | 86 kB 00:00 2024-09-21T02:27:55.428 INFO:teuthology.orchestra.run.smithi090.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-21T02:27:55.468 INFO:teuthology.orchestra.run.smithi084.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.0 MB/s | 170 kB 00:00 2024-09-21T02:27:55.481 INFO:teuthology.orchestra.run.smithi172.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 208 kB/s | 80 kB 00:00 2024-09-21T02:27:55.495 INFO:teuthology.orchestra.run.smithi090.stdout:(155/157): librados2-19.3.0-5120.g18432218.el9. 6.0 MB/s | 3.4 MB 00:00 2024-09-21T02:27:55.526 INFO:teuthology.orchestra.run.smithi084.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 589 kB/s | 34 kB 00:00 2024-09-21T02:27:55.554 INFO:teuthology.orchestra.run.smithi090.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-09-21T02:27:55.582 INFO:teuthology.orchestra.run.smithi172.stdout:(40/157): ceph-mgr-diskprediction-local-19.3.0- 6.4 MB/s | 7.4 MB 00:01 2024-09-21T02:27:55.593 INFO:teuthology.orchestra.run.smithi084.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T02:27:55.682 INFO:teuthology.orchestra.run.smithi172.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 954 kB/s | 191 kB 00:00 2024-09-21T02:27:55.904 INFO:teuthology.orchestra.run.smithi090.stdout:(157/157): librbd1-19.3.0-5120.g18432218.el9.x8 3.4 MB/s | 3.2 MB 00:00 2024-09-21T02:27:55.910 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:27:55.911 INFO:teuthology.orchestra.run.smithi090.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T02:27:56.074 INFO:teuthology.orchestra.run.smithi172.stdout:(42/157): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-21T02:27:56.094 INFO:teuthology.orchestra.run.smithi084.stdout:(30/157): ceph-test-19.3.0-5120.g18432218.el9.x 21 MB/s | 40 MB 00:01 2024-09-21T02:27:56.161 INFO:teuthology.orchestra.run.smithi084.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 3.9 MB/s | 3.1 MB 00:00 2024-09-21T02:27:56.199 INFO:teuthology.orchestra.run.smithi172.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 951 kB/s | 801 kB 00:00 2024-09-21T02:27:56.224 INFO:teuthology.orchestra.run.smithi172.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 710 kB/s | 106 kB 00:00 2024-09-21T02:27:56.250 INFO:teuthology.orchestra.run.smithi172.stdout:(45/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 379 kB/s | 253 kB 00:00 2024-09-21T02:27:56.277 INFO:teuthology.orchestra.run.smithi084.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.5 MB/s | 292 kB 00:00 2024-09-21T02:27:56.316 INFO:teuthology.orchestra.run.smithi172.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-21T02:27:56.342 INFO:teuthology.orchestra.run.smithi172.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-21T02:27:56.361 INFO:teuthology.orchestra.run.smithi084.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 594 kB/s | 49 kB 00:00 2024-09-21T02:27:56.459 INFO:teuthology.orchestra.run.smithi172.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.0 MB/s | 215 kB 00:00 2024-09-21T02:27:56.461 INFO:teuthology.orchestra.run.smithi084.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 20 MB/s | 7.4 MB 00:00 2024-09-21T02:27:56.487 INFO:teuthology.orchestra.run.smithi084.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 131 kB/s | 16 kB 00:00 2024-09-21T02:27:56.492 INFO:teuthology.orchestra.run.smithi172.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-21T02:27:56.512 INFO:teuthology.orchestra.run.smithi084.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T02:27:56.526 INFO:teuthology.orchestra.run.smithi172.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 651 kB/s | 22 kB 00:00 2024-09-21T02:27:56.568 INFO:teuthology.orchestra.run.smithi172.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-21T02:27:56.593 INFO:teuthology.orchestra.run.smithi172.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-21T02:27:56.619 INFO:teuthology.orchestra.run.smithi172.stdout:(53/157): boost-program-options-1.75.0-8.el9.x8 671 kB/s | 107 kB 00:00 2024-09-21T02:27:56.644 INFO:teuthology.orchestra.run.smithi172.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 433 kB/s | 33 kB 00:00 2024-09-21T02:27:56.669 INFO:teuthology.orchestra.run.smithi172.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-21T02:27:56.679 INFO:teuthology.orchestra.run.smithi084.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T02:27:56.694 INFO:teuthology.orchestra.run.smithi172.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T02:27:56.704 INFO:teuthology.orchestra.run.smithi084.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 96 kB/s | 18 kB 00:00 2024-09-21T02:27:56.728 INFO:teuthology.orchestra.run.smithi172.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-21T02:27:56.738 INFO:teuthology.orchestra.run.smithi084.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.1 MB/s | 784 kB 00:00 2024-09-21T02:27:56.762 INFO:teuthology.orchestra.run.smithi172.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T02:27:56.787 INFO:teuthology.orchestra.run.smithi172.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-09-21T02:27:56.845 INFO:teuthology.orchestra.run.smithi172.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-21T02:27:56.879 INFO:teuthology.orchestra.run.smithi172.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T02:27:56.888 INFO:teuthology.orchestra.run.smithi084.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 383 kB/s | 80 kB 00:00 2024-09-21T02:27:56.904 INFO:teuthology.orchestra.run.smithi172.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T02:27:56.929 INFO:teuthology.orchestra.run.smithi172.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T02:27:56.955 INFO:teuthology.orchestra.run.smithi172.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-21T02:27:56.971 INFO:teuthology.orchestra.run.smithi084.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 818 kB/s | 191 kB 00:00 2024-09-21T02:27:56.980 INFO:teuthology.orchestra.run.smithi172.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T02:27:56.997 INFO:teuthology.orchestra.run.smithi084.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T02:27:57.006 INFO:teuthology.orchestra.run.smithi172.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-21T02:27:57.030 INFO:teuthology.orchestra.run.smithi172.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-21T02:27:57.055 INFO:teuthology.orchestra.run.smithi084.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T02:27:57.089 INFO:teuthology.orchestra.run.smithi084.stdout:(44/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-21T02:27:57.106 INFO:teuthology.orchestra.run.smithi172.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T02:27:57.115 INFO:teuthology.orchestra.run.smithi084.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-21T02:27:57.138 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-09-21T02:27:57.157 INFO:teuthology.orchestra.run.smithi084.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-21T02:27:57.182 INFO:teuthology.orchestra.run.smithi172.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-21T02:27:57.182 INFO:teuthology.orchestra.run.smithi084.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-21T02:27:57.207 INFO:teuthology.orchestra.run.smithi084.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T02:27:57.257 INFO:teuthology.orchestra.run.smithi172.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-21T02:27:57.282 INFO:teuthology.orchestra.run.smithi172.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-21T02:27:57.288 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-09-21T02:27:57.288 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-09-21T02:27:57.324 INFO:teuthology.orchestra.run.smithi172.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.1 MB/s | 910 kB 00:00 2024-09-21T02:27:57.366 INFO:teuthology.orchestra.run.smithi172.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-21T02:27:57.391 INFO:teuthology.orchestra.run.smithi172.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T02:27:57.454 INFO:teuthology.orchestra.run.smithi172.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 983 kB/s | 61 kB 00:00 2024-09-21T02:27:57.525 INFO:teuthology.orchestra.run.smithi172.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-21T02:27:57.550 INFO:teuthology.orchestra.run.smithi172.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.5 MB/s | 245 kB 00:00 2024-09-21T02:27:57.575 INFO:teuthology.orchestra.run.smithi172.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T02:27:57.600 INFO:teuthology.orchestra.run.smithi172.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-21T02:27:57.626 INFO:teuthology.orchestra.run.smithi172.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-21T02:27:57.651 INFO:teuthology.orchestra.run.smithi172.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T02:27:57.666 INFO:teuthology.orchestra.run.smithi084.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-21T02:27:57.668 INFO:teuthology.orchestra.run.smithi172.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 832 kB/s | 35 kB 00:00 2024-09-21T02:27:57.752 INFO:teuthology.orchestra.run.smithi172.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T02:27:57.775 INFO:teuthology.orchestra.run.smithi084.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-21T02:27:57.777 INFO:teuthology.orchestra.run.smithi172.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T02:27:57.802 INFO:teuthology.orchestra.run.smithi172.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T02:27:57.828 INFO:teuthology.orchestra.run.smithi172.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T02:27:57.853 INFO:teuthology.orchestra.run.smithi172.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-21T02:27:57.878 INFO:teuthology.orchestra.run.smithi172.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T02:27:57.903 INFO:teuthology.orchestra.run.smithi172.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T02:27:57.929 INFO:teuthology.orchestra.run.smithi172.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T02:27:57.954 INFO:teuthology.orchestra.run.smithi172.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T02:27:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 843 kB/s | 689 kB 00:00 2024-09-21T02:27:57.979 INFO:teuthology.orchestra.run.smithi172.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T02:27:58.055 INFO:teuthology.orchestra.run.smithi172.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-21T02:27:58.058 INFO:teuthology.orchestra.run.smithi084.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-21T02:27:58.080 INFO:teuthology.orchestra.run.smithi172.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-21T02:27:58.092 INFO:teuthology.orchestra.run.smithi084.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-21T02:27:58.105 INFO:teuthology.orchestra.run.smithi172.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-21T02:27:58.117 INFO:teuthology.orchestra.run.smithi084.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-09-21T02:27:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T02:27:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-21T02:27:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-21T02:27:58.201 INFO:teuthology.orchestra.run.smithi084.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-21T02:27:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.0 MB/s | 304 kB 00:00 2024-09-21T02:27:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T02:27:58.251 INFO:teuthology.orchestra.run.smithi084.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 11 kB 00:00 2024-09-21T02:27:58.274 INFO:teuthology.orchestra.run.smithi172.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T02:27:58.299 INFO:teuthology.orchestra.run.smithi172.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T02:27:58.318 INFO:teuthology.orchestra.run.smithi084.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-21T02:27:58.324 INFO:teuthology.orchestra.run.smithi172.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-21T02:27:58.368 INFO:teuthology.orchestra.run.smithi084.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T02:27:58.424 INFO:teuthology.orchestra.run.smithi172.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-21T02:27:58.426 INFO:teuthology.orchestra.run.smithi084.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-21T02:27:58.485 INFO:teuthology.orchestra.run.smithi084.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.0 MB/s | 3.0 MB 00:00 2024-09-21T02:27:58.527 INFO:teuthology.orchestra.run.smithi084.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-21T02:27:58.608 INFO:teuthology.orchestra.run.smithi172.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-21T02:27:58.619 INFO:teuthology.orchestra.run.smithi084.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 183 kB/s | 24 kB 00:00 2024-09-21T02:27:58.641 INFO:teuthology.orchestra.run.smithi172.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-09-21T02:27:58.644 INFO:teuthology.orchestra.run.smithi084.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-21T02:27:58.667 INFO:teuthology.orchestra.run.smithi172.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 849 kB/s | 19 kB 00:00 2024-09-21T02:27:58.700 INFO:teuthology.orchestra.run.smithi172.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-21T02:27:58.711 INFO:teuthology.orchestra.run.smithi084.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 2.0 MB/s | 581 kB 00:00 2024-09-21T02:27:58.742 INFO:teuthology.orchestra.run.smithi172.stdout:(109/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.2 MB/s | 308 kB 00:00 2024-09-21T02:27:58.761 INFO:teuthology.orchestra.run.smithi084.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T02:27:58.767 INFO:teuthology.orchestra.run.smithi172.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T02:27:58.793 INFO:teuthology.orchestra.run.smithi172.stdout:(111/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-09-21T02:27:58.818 INFO:teuthology.orchestra.run.smithi172.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T02:27:58.820 INFO:teuthology.orchestra.run.smithi084.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-21T02:27:58.843 INFO:teuthology.orchestra.run.smithi172.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-21T02:27:58.885 INFO:teuthology.orchestra.run.smithi172.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-21T02:27:58.911 INFO:teuthology.orchestra.run.smithi172.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T02:27:58.944 INFO:teuthology.orchestra.run.smithi172.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-21T02:27:58.969 INFO:teuthology.orchestra.run.smithi172.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-21T02:27:58.995 INFO:teuthology.orchestra.run.smithi172.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-21T02:27:59.020 INFO:teuthology.orchestra.run.smithi172.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T02:27:59.054 INFO:teuthology.orchestra.run.smithi172.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.0 MB/s | 303 kB 00:00 2024-09-21T02:27:59.087 INFO:teuthology.orchestra.run.smithi084.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 626 kB/s | 292 kB 00:00 2024-09-21T02:27:59.087 INFO:teuthology.orchestra.run.smithi172.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-21T02:27:59.113 INFO:teuthology.orchestra.run.smithi172.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T02:27:59.127 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-09-21T02:27:59.127 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-09-21T02:27:59.138 INFO:teuthology.orchestra.run.smithi172.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T02:27:59.163 INFO:teuthology.orchestra.run.smithi172.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-21T02:27:59.188 INFO:teuthology.orchestra.run.smithi172.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-21T02:27:59.214 INFO:teuthology.orchestra.run.smithi172.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-21T02:27:59.239 INFO:teuthology.orchestra.run.smithi172.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-21T02:27:59.264 INFO:teuthology.orchestra.run.smithi172.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-21T02:27:59.340 INFO:teuthology.orchestra.run.smithi172.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-21T02:27:59.365 INFO:teuthology.orchestra.run.smithi172.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T02:27:59.390 INFO:teuthology.orchestra.run.smithi172.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T02:27:59.415 INFO:teuthology.orchestra.run.smithi172.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T02:27:59.466 INFO:teuthology.orchestra.run.smithi172.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-21T02:27:59.491 INFO:teuthology.orchestra.run.smithi172.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-21T02:27:59.525 INFO:teuthology.orchestra.run.smithi172.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-09-21T02:27:59.550 INFO:teuthology.orchestra.run.smithi172.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T02:27:59.575 INFO:teuthology.orchestra.run.smithi172.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-21T02:27:59.609 INFO:teuthology.orchestra.run.smithi172.stdout:(138/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-21T02:27:59.634 INFO:teuthology.orchestra.run.smithi172.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-09-21T02:27:59.637 INFO:teuthology.orchestra.run.smithi084.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 5.6 MB/s | 4.9 MB 00:00 2024-09-21T02:27:59.659 INFO:teuthology.orchestra.run.smithi172.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T02:27:59.685 INFO:teuthology.orchestra.run.smithi172.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T02:27:59.710 INFO:teuthology.orchestra.run.smithi172.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T02:27:59.735 INFO:teuthology.orchestra.run.smithi172.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T02:27:59.760 INFO:teuthology.orchestra.run.smithi172.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-21T02:27:59.777 INFO:teuthology.orchestra.run.smithi172.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-21T02:27:59.803 INFO:teuthology.orchestra.run.smithi172.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-21T02:27:59.828 INFO:teuthology.orchestra.run.smithi172.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T02:27:59.853 INFO:teuthology.orchestra.run.smithi172.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-21T02:27:59.904 INFO:teuthology.orchestra.run.smithi172.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T02:28:00.154 INFO:teuthology.orchestra.run.smithi172.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 10 MB/s | 3.4 MB 00:00 2024-09-21T02:28:00.254 INFO:teuthology.orchestra.run.smithi172.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.9 MB/s | 3.2 MB 00:00 2024-09-21T02:28:00.630 INFO:teuthology.orchestra.run.smithi172.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 109 kB/s | 41 kB 00:00 2024-09-21T02:28:00.962 INFO:teuthology.orchestra.run.smithi084.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 687 kB/s | 910 kB 00:01 2024-09-21T02:28:00.964 INFO:teuthology.orchestra.run.smithi172.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-09-21T02:28:01.005 INFO:teuthology.orchestra.run.smithi172.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 663 kB/s | 249 kB 00:00 2024-09-21T02:28:01.113 INFO:teuthology.orchestra.run.smithi172.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 9.1 MB/s | 1.4 MB 00:00 2024-09-21T02:28:01.180 INFO:teuthology.orchestra.run.smithi172.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-09-21T02:28:01.246 INFO:teuthology.orchestra.run.smithi084.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 485 kB/s | 137 kB 00:00 2024-09-21T02:28:01.404 INFO:teuthology.orchestra.run.smithi084.stdout:(71/157): postgresql-13.16-1.el9.x86_64.rpm 701 kB/s | 1.6 MB 00:02 2024-09-21T02:28:01.513 INFO:teuthology.orchestra.run.smithi084.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.6 MB/s | 4.4 MB 00:02 2024-09-21T02:28:01.689 INFO:teuthology.orchestra.run.smithi172.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-21T02:28:01.695 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:28:01.695 INFO:teuthology.orchestra.run.smithi172.stdout:Total 20 MB/s | 228 MB 00:11 2024-09-21T02:28:01.713 INFO:teuthology.orchestra.run.smithi084.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 438 kB/s | 87 kB 00:00 2024-09-21T02:28:02.901 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-21T02:28:02.930 INFO:teuthology.orchestra.run.smithi084.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 677 kB/s | 1.0 MB 00:01 2024-09-21T02:28:03.054 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-21T02:28:03.054 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-21T02:28:03.055 INFO:teuthology.orchestra.run.smithi084.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 490 kB/s | 61 kB 00:00 2024-09-21T02:28:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-21T02:28:03.806 INFO:teuthology.orchestra.run.smithi084.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 662 kB/s | 248 kB 00:00 2024-09-21T02:28:03.906 INFO:teuthology.orchestra.run.smithi084.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 257 kB/s | 26 kB 00:00 2024-09-21T02:28:04.015 INFO:teuthology.orchestra.run.smithi084.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-21T02:28:04.307 INFO:teuthology.orchestra.run.smithi084.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 591 kB/s | 172 kB 00:00 2024-09-21T02:28:04.415 INFO:teuthology.orchestra.run.smithi084.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-21T02:28:04.868 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-21T02:28:04.870 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-21T02:28:05.377 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-09-21T02:28:05.535 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:28:05.692 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:28:05.905 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:28:05.945 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:28:05.978 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:28:06.032 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:28:06.405 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:28:06.523 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:28:06.640 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:28:06.674 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:28:06.764 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:28:06.795 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:28:06.833 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:28:06.984 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:28:07.036 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:28:07.064 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:28:07.170 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:28:07.199 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:28:07.253 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:28:07.284 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:28:07.305 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:28:07.535 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:28:07.702 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:28:07.876 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:28:07.971 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:08.070 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:08.298 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:08.403 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:28:08.432 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:28:08.469 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:28:08.542 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:28:08.599 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:28:08.639 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:28:08.683 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:28:08.715 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:28:08.754 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:28:08.823 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:28:08.884 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:28:08.923 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:28:08.967 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:28:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:28:09.078 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:28:09.121 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:28:09.150 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:28:09.219 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:28:09.274 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:28:09.348 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:28:09.481 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:28:09.536 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:28:09.564 INFO:teuthology.orchestra.run.smithi084.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 711 kB/s | 5.8 MB 00:08 2024-09-21T02:28:09.998 INFO:teuthology.orchestra.run.smithi084.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 579 kB/s | 250 kB 00:00 2024-09-21T02:28:10.063 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:28:10.173 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:28:10.212 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:28:10.254 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:28:10.292 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:28:10.335 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:28:10.340 INFO:teuthology.orchestra.run.smithi084.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 708 kB/s | 6.0 MB 00:08 2024-09-21T02:28:10.415 INFO:teuthology.orchestra.run.smithi084.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 533 kB/s | 222 kB 00:00 2024-09-21T02:28:10.524 INFO:teuthology.orchestra.run.smithi084.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-21T02:28:10.533 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:28:10.549 INFO:teuthology.orchestra.run.smithi084.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 370 kB/s | 77 kB 00:00 2024-09-21T02:28:10.590 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:28:10.680 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:28:10.746 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:28:10.819 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:28:10.841 INFO:teuthology.orchestra.run.smithi084.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 544 kB/s | 159 kB 00:00 2024-09-21T02:28:10.860 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:28:10.897 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:28:10.943 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:28:10.979 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:28:10.983 INFO:teuthology.orchestra.run.smithi084.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 587 kB/s | 269 kB 00:00 2024-09-21T02:28:11.065 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:28:11.091 INFO:teuthology.orchestra.run.smithi084.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-21T02:28:11.169 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-21T02:28:11.200 INFO:teuthology.orchestra.run.smithi084.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 496 kB/s | 54 kB 00:00 2024-09-21T02:28:11.309 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:28:11.317 INFO:teuthology.orchestra.run.smithi084.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 586 kB/s | 279 kB 00:00 2024-09-21T02:28:11.387 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:28:11.434 INFO:teuthology.orchestra.run.smithi084.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-09-21T02:28:11.439 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:28:11.542 INFO:teuthology.orchestra.run.smithi084.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-09-21T02:28:11.653 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:28:11.694 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:28:11.719 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:28:11.727 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:28:11.763 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:28:11.767 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:28:11.792 INFO:teuthology.orchestra.run.smithi084.stdout:(95/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 707 kB/s | 5.1 MB 00:07 2024-09-21T02:28:11.810 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:28:11.909 INFO:teuthology.orchestra.run.smithi084.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-09-21T02:28:11.912 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:28:11.935 INFO:teuthology.orchestra.run.smithi084.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 563 kB/s | 221 kB 00:00 2024-09-21T02:28:11.952 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:28:11.992 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:28:12.026 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:28:12.027 INFO:teuthology.orchestra.run.smithi084.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-21T02:28:12.060 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:28:12.111 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:28:12.134 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:28:12.135 INFO:teuthology.orchestra.run.smithi084.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 535 kB/s | 58 kB 00:00 2024-09-21T02:28:12.236 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:28:12.262 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:28:12.303 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:28:12.331 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:28:12.335 INFO:teuthology.orchestra.run.smithi084.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 478 kB/s | 96 kB 00:00 2024-09-21T02:28:12.362 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:28:12.364 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:28:12.395 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:28:12.404 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:28:12.410 INFO:teuthology.orchestra.run.smithi084.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 639 kB/s | 304 kB 00:00 2024-09-21T02:28:12.444 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:28:12.482 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:28:12.487 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:28:12.516 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:28:12.517 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:28:12.519 INFO:teuthology.orchestra.run.smithi084.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 414 kB/s | 45 kB 00:00 2024-09-21T02:28:12.545 INFO:teuthology.orchestra.run.smithi084.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 305 kB/s | 64 kB 00:00 2024-09-21T02:28:12.546 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:28:12.551 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:28:12.600 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:28:12.628 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:28:12.653 INFO:teuthology.orchestra.run.smithi084.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-21T02:28:12.699 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:28:12.706 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:28:12.746 INFO:teuthology.orchestra.run.smithi084.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.9 MB/s | 548 kB 00:00 2024-09-21T02:28:12.756 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:28:12.758 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:28:12.779 INFO:teuthology.orchestra.run.smithi084.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T02:28:12.784 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:28:12.798 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:28:12.804 INFO:teuthology.orchestra.run.smithi084.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T02:28:12.890 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:28:12.900 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:28:12.918 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:28:12.921 INFO:teuthology.orchestra.run.smithi084.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T02:28:12.947 INFO:teuthology.orchestra.run.smithi084.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T02:28:12.958 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:28:12.971 INFO:teuthology.orchestra.run.smithi084.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T02:28:12.980 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:28:12.997 INFO:teuthology.orchestra.run.smithi084.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T02:28:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:28:13.022 INFO:teuthology.orchestra.run.smithi084.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-21T02:28:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:28:13.073 INFO:teuthology.orchestra.run.smithi084.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T02:28:13.106 INFO:teuthology.orchestra.run.smithi084.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T02:28:13.131 INFO:teuthology.orchestra.run.smithi084.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T02:28:13.156 INFO:teuthology.orchestra.run.smithi084.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T02:28:13.184 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:28:13.199 INFO:teuthology.orchestra.run.smithi084.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 337 kB/s | 14 kB 00:00 2024-09-21T02:28:13.224 INFO:teuthology.orchestra.run.smithi084.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-21T02:28:13.257 INFO:teuthology.orchestra.run.smithi084.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-21T02:28:13.299 INFO:teuthology.orchestra.run.smithi084.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-09-21T02:28:13.307 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:28:13.325 INFO:teuthology.orchestra.run.smithi084.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-21T02:28:13.391 INFO:teuthology.orchestra.run.smithi084.stdout:(122/157): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-09-21T02:28:13.417 INFO:teuthology.orchestra.run.smithi084.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T02:28:13.434 INFO:teuthology.orchestra.run.smithi084.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-21T02:28:13.437 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:28:13.459 INFO:teuthology.orchestra.run.smithi084.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-21T02:28:13.484 INFO:teuthology.orchestra.run.smithi084.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-09-21T02:28:13.510 INFO:teuthology.orchestra.run.smithi084.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 787 kB/s | 19 kB 00:00 2024-09-21T02:28:13.535 INFO:teuthology.orchestra.run.smithi084.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 796 kB/s | 20 kB 00:00 2024-09-21T02:28:13.541 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:13.604 INFO:teuthology.orchestra.run.smithi084.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-09-21T02:28:13.605 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:13.627 INFO:teuthology.orchestra.run.smithi084.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.0 MB/s | 46 kB 00:00 2024-09-21T02:28:13.652 INFO:teuthology.orchestra.run.smithi084.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T02:28:13.669 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:28:13.677 INFO:teuthology.orchestra.run.smithi084.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T02:28:13.711 INFO:teuthology.orchestra.run.smithi084.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T02:28:13.728 INFO:teuthology.orchestra.run.smithi084.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-21T02:28:13.762 INFO:teuthology.orchestra.run.smithi084.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-21T02:28:13.766 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:28:13.779 INFO:teuthology.orchestra.run.smithi084.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-21T02:28:13.796 INFO:teuthology.orchestra.run.smithi084.stdout:(137/157): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-09-21T02:28:13.799 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:28:13.821 INFO:teuthology.orchestra.run.smithi084.stdout:(138/157): python3-routes-2.5.1-5.el9.noarch.rp 7.4 MB/s | 188 kB 00:00 2024-09-21T02:28:13.824 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:13.846 INFO:teuthology.orchestra.run.smithi084.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T02:28:13.879 INFO:teuthology.orchestra.run.smithi084.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2024-09-21T02:28:13.898 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:28:13.904 INFO:teuthology.orchestra.run.smithi084.stdout:(141/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-21T02:28:13.938 INFO:teuthology.orchestra.run.smithi084.stdout:(142/157): protobuf-compiler-3.14.0-13.el9.x86_ 620 kB/s | 863 kB 00:01 2024-09-21T02:28:13.940 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:28:13.954 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:28:13.968 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:28:13.980 INFO:teuthology.orchestra.run.smithi084.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T02:28:14.003 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:28:14.008 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:28:14.022 INFO:teuthology.orchestra.run.smithi084.stdout:(144/157): python3-werkzeug-2.0.3-3.el9.1.noarc 10 MB/s | 427 kB 00:00 2024-09-21T02:28:14.047 INFO:teuthology.orchestra.run.smithi084.stdout:(145/157): python3-websocket-client-1.2.3-2.el9 825 kB/s | 90 kB 00:00 2024-09-21T02:28:14.072 INFO:teuthology.orchestra.run.smithi084.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 401 kB/s | 20 kB 00:00 2024-09-21T02:28:14.085 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:28:14.095 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:28:14.106 INFO:teuthology.orchestra.run.smithi084.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-21T02:28:14.128 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:28:14.129 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:28:14.156 INFO:teuthology.orchestra.run.smithi084.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T02:28:14.169 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:28:14.221 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:28:14.253 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:28:14.281 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:28:14.302 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:28:14.335 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:28:14.350 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:28:14.398 INFO:teuthology.orchestra.run.smithi084.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-21T02:28:14.403 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:28:14.413 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:28:14.434 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:28:14.470 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:28:14.490 INFO:teuthology.orchestra.run.smithi084.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 8.8 MB/s | 3.4 MB 00:00 2024-09-21T02:28:14.551 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:28:14.597 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:28:14.649 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:28:14.678 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:28:14.747 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:28:14.792 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:28:14.867 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:28:14.998 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:28:15.050 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:28:15.077 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:28:15.090 INFO:teuthology.orchestra.run.smithi084.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.0 MB/s | 1.8 MB 00:00 2024-09-21T02:28:15.132 INFO:teuthology.orchestra.run.smithi084.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.2 MB/s | 2.3 MB 00:00 2024-09-21T02:28:15.157 INFO:teuthology.orchestra.run.smithi084.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 614 kB/s | 41 kB 00:00 2024-09-21T02:28:15.191 INFO:teuthology.orchestra.run.smithi084.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-21T02:28:15.192 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:28:15.316 INFO:teuthology.orchestra.run.smithi084.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-21T02:28:15.602 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:28:15.705 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:28:15.735 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:28:15.770 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:28:15.808 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:28:15.857 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:28:16.035 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:28:16.086 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:28:16.176 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:28:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:28:16.314 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:28:16.354 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:28:16.366 INFO:teuthology.orchestra.run.smithi084.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-21T02:28:16.390 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:28:16.399 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:28:16.437 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:28:16.473 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:28:16.479 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:28:16.515 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:28:16.516 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:28:16.549 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:28:16.558 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:28:16.694 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:28:16.810 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:28:16.852 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:28:16.875 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:28:16.955 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:28:16.962 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:28:17.001 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:28:17.039 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:28:17.041 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:28:17.067 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:28:17.068 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:28:17.094 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:28:17.112 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:28:17.168 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:28:17.294 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:28:17.334 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:28:17.361 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:28:17.396 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:28:17.435 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:28:17.467 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:28:17.496 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:28:17.531 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:28:17.564 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:28:17.606 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:28:17.612 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:28:17.641 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:28:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:28:17.721 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:28:17.726 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:28:17.752 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:28:17.779 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:28:17.811 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:28:17.913 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:28:17.961 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:28:18.676 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:28:18.725 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:28:18.759 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:28:18.857 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:28:18.913 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:28:18.958 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:28:19.045 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:28:19.086 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:28:19.278 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:28:19.309 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:28:19.385 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:28:20.001 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:20.021 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:28:20.059 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:20.140 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:28:20.628 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:20.690 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:28:20.787 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:28:20.787 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:28:20.787 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:28:20.787 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:28:21.364 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:28:21.454 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:28:21.482 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:28:21.515 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:28:21.841 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:28:21.895 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:28:21.985 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:28:22.024 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:28:22.060 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:28:22.579 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:28:22.622 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:28:22.693 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:28:22.715 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:28:24.973 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:25.221 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:25.787 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:25.824 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:28:25.906 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:28:25.906 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:28:25.906 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:28:25.906 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:25.933 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:28:29.340 INFO:teuthology.orchestra.run.smithi084.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 917 kB/s | 16 MB 00:18 2024-09-21T02:28:29.345 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:28:29.346 INFO:teuthology.orchestra.run.smithi084.stdout:Total 5.9 MB/s | 228 MB 00:38 2024-09-21T02:28:31.432 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-21T02:28:31.617 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-21T02:28:31.617 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-21T02:28:34.031 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-21T02:28:34.032 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /root 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2024-09-21T02:28:34.381 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:34.579 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:28:34.595 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:28:34.595 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:34.595 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:28:34.595 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:36.182 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:28:36.208 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:28:36.208 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:36.208 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:28:36.209 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:28:36.209 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:28:36.209 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:36.432 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:28:36.455 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:28:36.456 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:36.456 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:28:36.456 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:28:36.456 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:28:36.456 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:36.941 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:28:36.965 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:28:36.965 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:36.965 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:28:36.965 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:28:36.966 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:28:36.966 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:37.072 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:28:37.130 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:28:37.193 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:28:37.379 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:28:37.437 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:28:37.515 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:28:37.603 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:28:37.630 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:28:37.630 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-21T02:28:37.630 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-21T02:28:37.630 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-21T02:28:37.630 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-21T02:28:37.630 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-21T02:28:37.630 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-21T02:28:37.631 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-21T02:28:37.631 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:37.751 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:28:37.812 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:28:37.823 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:28:37.842 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:28:37.842 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:37.842 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:28:37.842 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:37.844 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:28:37.880 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:28:38.360 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:28:38.389 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:28:38.430 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:28:38.496 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:28:38.521 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:28:39.447 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:28:39.473 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:28:39.474 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:39.474 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:28:39.474 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:28:39.474 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:28:39.474 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:39.697 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:28:39.721 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:28:39.721 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:39.721 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:28:39.721 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:28:39.721 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:28:39.721 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:40.198 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:28:40.222 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:28:40.222 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:40.222 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:28:40.222 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:28:40.222 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:28:40.222 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:40.337 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:28:40.393 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:28:40.449 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:28:40.632 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:28:40.657 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-21T02:28:40.682 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:28:40.751 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:28:40.818 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T02:28:40.839 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:28:40.862 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T02:28:40.925 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T02:28:40.962 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T02:28:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:28:40.994 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T02:28:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:28:41.048 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T02:28:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:28:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:28:41.426 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T02:28:41.527 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:28:41.557 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:28:41.578 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:28:41.589 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:28:41.654 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:28:41.678 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:28:41.680 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:28:41.727 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:28:41.747 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:28:41.754 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:28:41.858 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:28:41.893 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:28:41.932 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T02:28:42.140 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T02:28:42.198 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T02:28:42.225 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:28:42.351 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:28:42.405 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:28:42.484 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T02:28:42.510 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:28:42.547 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T02:28:42.703 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:28:42.745 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:28:42.747 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:28:42.860 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:28:42.929 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T02:28:43.032 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:28:43.059 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:28:43.083 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:28:43.083 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:43.083 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:28:43.083 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:28:43.083 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:28:43.084 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:43.133 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T02:28:43.135 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:28:43.147 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:28:43.249 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:43.254 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:28:43.308 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:28:43.383 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:43.668 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T02:28:43.806 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T02:28:43.848 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T02:28:43.892 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T02:28:43.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T02:28:44.036 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T02:28:44.075 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T02:28:44.129 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T02:28:44.168 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T02:28:44.202 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T02:28:44.267 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:28:44.289 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T02:28:44.322 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:28:44.345 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T02:28:44.345 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:28:44.345 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:44.345 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:28:44.345 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:28:44.346 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:28:44.346 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:44.397 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:28:44.406 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T02:28:44.420 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:28:44.420 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:44.420 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:28:44.420 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:44.452 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T02:28:44.473 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:28:44.497 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:28:44.497 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:44.497 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:28:44.497 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:28:44.497 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:28:44.497 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:44.547 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T02:28:44.593 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T02:28:44.637 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T02:28:44.664 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T02:28:44.744 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T02:28:44.800 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T02:28:44.815 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:28:44.839 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:28:44.839 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:44.839 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:28:44.839 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:28:44.839 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:28:44.839 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:28:44.861 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:28:44.890 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T02:28:44.919 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:28:45.047 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T02:28:45.102 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T02:28:45.729 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T02:28:45.819 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T02:28:45.856 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T02:28:45.877 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:28:45.900 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T02:28:45.911 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:28:45.938 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T02:28:45.991 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T02:28:46.024 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:28:46.165 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T02:28:46.195 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:28:46.221 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:28:46.241 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T02:28:46.245 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:28:46.245 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:46.245 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:28:46.245 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:28:46.245 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:28:46.245 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:46.288 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:28:46.300 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:28:46.345 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T02:28:46.399 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:28:46.418 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T02:28:46.453 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:28:46.502 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T02:28:46.551 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T02:28:46.587 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T02:28:46.645 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T02:28:46.686 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T02:28:46.731 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T02:28:46.783 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T02:28:46.950 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T02:28:46.990 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T02:28:47.036 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T02:28:47.151 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T02:28:47.194 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T02:28:47.236 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T02:28:47.282 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T02:28:47.298 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T02:28:47.419 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:28:47.421 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T02:28:47.466 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:28:47.490 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:28:47.490 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:47.490 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:28:47.490 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:28:47.490 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:28:47.491 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:47.533 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:28:47.557 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:28:47.557 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:47.557 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:28:47.557 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:47.571 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T02:28:47.609 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:28:47.614 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T02:28:47.633 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:28:47.633 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:47.633 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:28:47.633 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:28:47.633 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:28:47.633 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:47.651 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T02:28:47.685 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T02:28:47.725 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T02:28:47.765 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T02:28:47.802 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T02:28:47.837 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T02:28:47.870 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T02:28:47.913 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T02:28:47.951 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:28:47.954 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T02:28:47.975 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:28:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:28:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:28:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:28:47.975 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:28:47.975 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:28:48.052 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T02:28:48.103 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T02:28:48.141 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T02:28:48.261 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T02:28:48.320 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T02:28:48.831 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:28:48.872 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:28:48.913 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:28:48.945 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:28:48.972 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:28:49.153 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:28:49.194 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T02:28:49.205 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:28:49.227 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:28:49.254 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T02:28:49.265 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:28:49.288 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T02:28:49.312 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:28:49.400 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T02:28:49.471 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T02:28:49.524 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T02:28:49.619 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T02:28:49.656 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T02:28:49.890 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T02:28:49.922 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:28:49.922 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T02:28:49.972 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:28:49.992 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:28:50.015 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T02:28:50.806 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T02:28:50.812 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:28:50.897 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:28:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T02:28:50.938 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:28:51.028 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:28:51.069 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:28:51.103 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:28:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:28:51.137 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:28:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:28:51.230 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:28:51.314 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:28:51.339 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:28:51.344 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:28:51.344 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:28:51.524 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:28:51.524 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:28:51.617 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:28:51.690 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:28:51.939 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:28:51.988 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:28:52.029 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:28:52.061 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:28:52.088 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:28:52.278 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:28:52.318 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:28:52.348 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:28:52.378 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:28:52.432 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:28:52.467 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T02:28:52.567 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T02:28:52.595 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T02:28:52.628 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T02:28:52.978 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T02:28:53.053 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:28:53.060 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:28:53.097 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:28:53.116 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:28:53.168 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T02:28:53.204 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T02:28:53.251 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T02:28:53.784 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T02:28:53.817 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:28:53.908 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T02:28:53.935 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T02:28:53.949 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:28:54.034 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:28:54.075 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:28:54.157 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:28:54.187 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:28:54.213 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:28:54.247 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:28:54.247 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:28:54.339 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:28:54.339 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:28:54.432 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:28:54.457 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:28:54.462 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:28:54.462 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:28:54.642 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:28:54.642 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:28:54.709 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:28:54.781 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:28:56.496 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:56.533 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:57.193 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T02:28:57.244 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:28:57.362 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T02:28:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T02:28:57.362 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T02:28:57.362 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:28:57.404 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:29:00.764 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:29:00.764 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:29:00.764 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:29:00.764 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:29:00.764 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:29:00.764 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:29:00.764 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:29:00.764 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:29:00.765 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:29:00.766 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:29:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:29:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:29:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:29:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:29:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:29:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:29:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:29:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:29:00.785 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:29:00.786 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:29:00.786 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:29:00.786 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:29:00.786 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:29:00.786 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:29:00.786 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:29:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:29:01.154 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:29:01.155 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:29:01.156 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:29:01.167 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:29:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:29:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:29:01.168 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:29:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:29:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:29:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:29:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:29:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:29:01.169 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:29:01.170 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:29:01.171 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:29:01.172 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:29:01.173 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:29:01.174 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:29:01.175 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:29:01.176 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:29:01.177 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:29:01.178 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:29:01.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:29:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:29:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:29:03.408 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-09-21T02:29:03.408 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:29:03.409 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.410 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:29:03.411 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:29:03.412 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:29:03.413 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:29:03.414 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:29:03.415 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:29:03.416 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:29:03.417 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:29:03.418 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.419 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:29:03.420 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-09-21T02:29:03.636 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:29:03.636 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:29:03.636 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-21T02:29:03.636 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:03.636 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:03.636 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:03.636 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.637 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.638 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:29:03.639 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:29:03.640 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:29:03.641 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:29:03.642 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:29:03.643 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:29:03.644 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:29:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.646 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:29:03.647 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:29:03.648 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:29:03.649 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-21T02:29:04.048 DEBUG:teuthology.parallel:result is None 2024-09-21T02:29:04.107 DEBUG:teuthology.parallel:result is None 2024-09-21T02:29:10.288 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T02:29:10.288 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-09-21T02:29:10.288 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-09-21T02:29:10.289 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-09-21T02:29:10.289 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-09-21T02:29:10.289 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-09-21T02:29:10.289 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-09-21T02:29:10.289 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-09-21T02:29:10.289 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:10.488 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:29:10.523 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T02:29:10.523 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:10.523 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T02:29:10.524 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:12.274 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:29:12.331 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T02:29:12.331 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:12.331 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T02:29:12.331 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:29:12.331 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T02:29:12.331 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:12.582 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:29:12.632 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T02:29:12.633 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:12.633 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T02:29:12.633 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:29:12.633 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T02:29:12.633 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:13.142 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:29:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T02:29:13.192 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:13.192 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T02:29:13.192 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:29:13.192 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T02:29:13.192 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:13.333 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T02:29:13.394 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T02:29:13.465 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T02:29:13.689 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T02:29:13.753 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T02:29:13.838 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T02:29:13.939 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T02:29:14.113 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T02:29:14.185 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T02:29:14.234 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T02:29:14.260 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T02:29:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:29:14.809 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T02:29:14.851 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T02:29:14.939 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T02:29:14.981 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:29:18.580 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T02:29:18.661 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:29:19.737 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T02:29:19.770 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:29:19.921 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T02:29:20.097 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T02:29:20.130 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:29:20.182 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T02:29:20.182 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:20.182 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T02:29:20.182 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:29:20.182 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T02:29:20.183 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:20.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:29:20.265 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T02:29:20.373 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T02:29:20.441 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T02:29:21.496 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T02:29:21.533 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:29:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T02:29:21.585 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:21.585 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T02:29:21.585 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:29:21.585 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T02:29:21.585 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:21.634 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:29:21.683 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T02:29:21.683 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:21.683 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T02:29:21.684 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:21.743 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:29:21.793 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T02:29:21.794 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:21.794 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T02:29:21.794 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:29:21.794 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T02:29:21.794 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:22.152 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:29:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T02:29:22.203 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T02:29:22.203 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T02:29:22.203 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:29:22.203 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T02:29:22.203 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:26.554 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T02:29:26.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T02:29:26.674 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T02:29:26.703 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T02:29:26.739 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T02:29:27.001 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T02:29:27.043 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T02:29:27.072 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T02:29:27.104 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T02:29:27.148 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T02:29:27.845 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:29:27.904 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:29:27.952 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T02:29:29.260 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T02:29:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T02:29:29.421 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T02:29:29.522 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T02:29:29.563 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T02:29:29.597 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T02:29:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T02:29:29.642 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:29:29.757 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T02:29:29.757 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:29:29.866 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T02:29:29.891 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T02:29:29.906 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:29:29.907 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:29:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T02:29:30.143 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:29:30.252 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T02:29:30.327 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:29:30.537 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:29:30.537 INFO:teuthology.orchestra.run.smithi084.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-21T02:29:30.537 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:36.693 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T02:29:36.693 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T02:29:36.693 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T02:29:36.693 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T02:29:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T02:29:36.695 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T02:29:36.706 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T02:29:36.706 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T02:29:36.706 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T02:29:36.706 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T02:29:36.707 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T02:29:36.708 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T02:29:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T02:29:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T02:29:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T02:29:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T02:29:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T02:29:36.710 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T02:29:36.711 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T02:29:36.712 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T02:29:36.713 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T02:29:36.714 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T02:29:36.715 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T02:29:36.716 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T02:29:36.717 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T02:29:38.879 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T02:29:38.879 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:38.879 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.881 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T02:29:38.882 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T02:29:38.884 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T02:29:38.885 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T02:29:38.886 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T02:29:38.887 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T02:29:38.888 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T02:29:38.889 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T02:29:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T02:29:38.891 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T02:29:38.891 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T02:29:38.891 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T02:29:38.891 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T02:29:38.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:29:38.891 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-21T02:29:39.493 DEBUG:teuthology.parallel:result is None 2024-09-21T02:29:39.493 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:29:39.637 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:29:39.681 INFO:teuthology.orchestra.run.smithi084.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:29:39.682 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:29:39.682 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:29:39.684 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:29:39.824 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:29:39.850 INFO:teuthology.orchestra.run.smithi090.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:29:39.850 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:29:39.850 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:29:39.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:29:39.986 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T02:29:40.013 INFO:teuthology.orchestra.run.smithi172.stdout:19.3.0-5120.g18432218.el9 2024-09-21T02:29:40.013 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T02:29:40.013 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T02:29:40.015 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T02:29:40.015 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:29:40.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:29:40.073 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:29:40.073 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:29:40.106 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:29:40.106 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T02:29:40.139 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T02:29:40.139 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:29:40.139 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:29:40.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:29:40.292 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:29:40.292 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:29:40.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:29:40.391 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:29:40.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T02:29:40.423 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T02:29:40.490 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T02:29:40.490 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:29:40.490 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:29:40.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:29:40.648 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:29:40.648 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:29:40.672 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:29:40.737 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:29:40.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T02:29:40.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T02:29:40.827 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T02:29:40.827 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:29:40.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:29:40.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:29:40.982 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:29:40.982 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:29:41.008 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:29:41.073 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:29:41.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T02:29:41.099 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T02:29:41.164 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T02:29:41.251 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client dirsize rbytes': False}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2}} 2024-09-21T02:29:41.251 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:29:41.252 INFO:tasks.cephadm:Cluster fsid is 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:29:41.252 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T02:29:41.252 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.84', 'mon.b': '172.21.15.90', 'mon.c': '172.21.15.172'} 2024-09-21T02:29:41.252 INFO:tasks.cephadm:First mon is mon.a on smithi084 2024-09-21T02:29:41.252 INFO:tasks.cephadm:First mgr is x 2024-09-21T02:29:41.253 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T02:29:41.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-09-21T02:29:41.310 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname $(hostname -s) 2024-09-21T02:29:41.335 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-09-21T02:29:41.360 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T02:29:41.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:29:41.497 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T02:29:41.631 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:29:41.633 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T02:29:41.633 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T02:29:41.633 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:42.179 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:29 /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:42.179 DEBUG:teuthology.orchestra.run.smithi090:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:42.683 INFO:teuthology.orchestra.run.smithi090.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:29 /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:42.683 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:43.199 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 02:29 /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:43.200 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:43.242 DEBUG:teuthology.orchestra.run.smithi090:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:43.261 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T02:29:43.296 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T02:29:43.296 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:29:43.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:29:43.304 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T02:29:44.864 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:29:44.997 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:29:45.515 INFO:teuthology.orchestra.run.smithi090.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T02:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "repo_digests": [ 2024-09-21T02:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-09-21T02:30:16.995 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T02:30:20.515 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T02:30:20.515 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:30:20.515 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:30:20.515 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-09-21T02:30:20.515 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:30:20.515 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-21T02:30:20.515 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T02:30:28.889 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:30:28.889 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:30:28.889 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T02:30:28.889 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2024-09-21T02:30:28.889 INFO:teuthology.orchestra.run.smithi084.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T02:30:28.889 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:30:28.889 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:30:28.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-09-21T02:30:28.979 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph 2024-09-21T02:30:29.012 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-09-21T02:30:29.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-09-21T02:30:29.100 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /etc/ceph 2024-09-21T02:30:29.128 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-09-21T02:30:29.157 INFO:tasks.cephadm:Writing seed config... 2024-09-21T02:30:29.158 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-21T02:30:29.158 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T02:30:29.158 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T02:30:29.158 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T02:30:29.158 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T02:30:29.158 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T02:30:29.158 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T02:30:29.158 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T02:30:29.159 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T02:30:29.160 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:30:29.160 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T02:30:29.195 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5b18da14-77c1-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T02:30:29.195 DEBUG:teuthology.orchestra.run.smithi084:mon.a> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T02:30:29.239 DEBUG:teuthology.orchestra.run.smithi084:mgr.x> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T02:30:29.284 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T02:30:29.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.84 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:30:29.540 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T02:30:29.540 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.84', '--skip-admin-label'] 2024-09-21T02:30:29.540 INFO:teuthology.orchestra.run.smithi084.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T02:30:29.541 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying podman|docker is present... 2024-09-21T02:30:29.585 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 5.2.2 2024-09-21T02:30:29.585 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying lvm2 is present... 2024-09-21T02:30:29.585 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying time synchronization is in place... 2024-09-21T02:30:29.599 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T02:30:29.599 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T02:30:29.611 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T02:30:29.611 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T02:30:29.625 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-09-21T02:30:29.637 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-09-21T02:30:29.637 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-09-21T02:30:29.637 INFO:teuthology.orchestra.run.smithi084.stdout:Repeating the final host check... 2024-09-21T02:30:29.681 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 5.2.2 2024-09-21T02:30:29.681 INFO:teuthology.orchestra.run.smithi084.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T02:30:29.681 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl is present 2024-09-21T02:30:29.681 INFO:teuthology.orchestra.run.smithi084.stdout:lvcreate is present 2024-09-21T02:30:29.693 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T02:30:29.694 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T02:30:29.706 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T02:30:29.706 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T02:30:29.719 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-09-21T02:30:29.732 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-09-21T02:30:29.732 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-09-21T02:30:29.732 INFO:teuthology.orchestra.run.smithi084.stdout:Host looks OK 2024-09-21T02:30:29.732 INFO:teuthology.orchestra.run.smithi084.stdout:Cluster fsid: 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:29.732 INFO:teuthology.orchestra.run.smithi084.stdout:Acquiring lock 140023192754832 on /run/cephadm/5b18da14-77c1-11ef-baf5-efdc52797490.lock 2024-09-21T02:30:29.733 INFO:teuthology.orchestra.run.smithi084.stdout:Lock 140023192754832 acquired on /run/cephadm/5b18da14-77c1-11ef-baf5-efdc52797490.lock 2024-09-21T02:30:29.733 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 3300 ... 2024-09-21T02:30:29.733 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 6789 ... 2024-09-21T02:30:29.733 INFO:teuthology.orchestra.run.smithi084.stdout:Base mon IP(s) is [172.21.15.84:3300, 172.21.15.84:6789], mon addrv is [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T02:30:29.740 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.84 metric 100 2024-09-21T02:30:29.740 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.84 metric 100 2024-09-21T02:30:29.746 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T02:30:29.746 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T02:30:29.746 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T02:30:29.752 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T02:30:29.753 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T02:30:29.753 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T02:30:29.753 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T02:30:29.754 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2024-09-21T02:30:29.754 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T02:30:29.754 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-09-21T02:30:29.754 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-09-21T02:30:29.754 INFO:teuthology.orchestra.run.smithi084.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T02:30:29.754 INFO:teuthology.orchestra.run.smithi084.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T02:30:29.755 INFO:teuthology.orchestra.run.smithi084.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:30:30.216 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T02:30:30.216 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T02:30:30.216 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T02:30:30.216 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T02:30:30.216 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T02:30:30.216 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T02:30:30.216 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T02:30:31.262 INFO:teuthology.orchestra.run.smithi084.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T02:30:31.262 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T02:30:31.262 INFO:teuthology.orchestra.run.smithi084.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T02:30:32.292 INFO:teuthology.orchestra.run.smithi084.stdout:stat: stdout 167 167 2024-09-21T02:30:32.292 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial keys... 2024-09-21T02:30:33.399 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDIL+5mlmawLBAAiqMysUt7+yxGsDCsmyPhsQ== 2024-09-21T02:30:34.439 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDJL+5mL1OZMRAAJM4IiYdRk4bK1CpryypBfA== 2024-09-21T02:30:35.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQDKL+5m9r1nMhAAYTYKwywpLEqc3t9qcfOBiA== 2024-09-21T02:30:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial monmap... 2024-09-21T02:30:36.556 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool for a [v2:172.21.15.84:3300,v1:172.21.15.84:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = quincy 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: set fsid to 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:30:36.557 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mon... 2024-09-21T02:30:37.639 INFO:teuthology.orchestra.run.smithi084.stdout:create mon.a on 2024-09-21T02:30:37.964 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T02:30:38.180 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T02:30:38.439 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5b18da14-77c1-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-5b18da14-77c1-11ef-baf5-efdc52797490.target. 2024-09-21T02:30:38.439 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5b18da14-77c1-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-5b18da14-77c1-11ef-baf5-efdc52797490.target. 2024-09-21T02:30:38.773 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a 2024-09-21T02:30:38.773 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T02:30:39.030 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b18da14-77c1-11ef-baf5-efdc52797490.target.wants/ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-5b18da14-77c1-11ef-baf5-efdc52797490@.service. 2024-09-21T02:30:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:39 smithi084 podman[30367]: 2024-09-21 02:30:39.576337505 +0000 UTC m=+0.319760175 container start b93cf3d7ec694628231d0c6f498eec2c17c7c9e1ef4c934cd4d86536e607f867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:30:39.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:39 smithi084 bash[30367]: b93cf3d7ec694628231d0c6f498eec2c17c7c9e1ef4c934cd4d86536e607f867 2024-09-21T02:30:39.664 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:30:39.664 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T02:30:39.677 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:30:39.677 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T02:30:39.678 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T02:30:39.678 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T02:30:39.678 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon to start... 2024-09-21T02:30:39.678 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon... 2024-09-21T02:30:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:39 smithi084 systemd[1]: Started Ceph mon.a for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:30:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:39 smithi084 ceph-mon[30386]: mkfs 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:39.926 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:39 smithi084 ceph-mon[30386]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:30:40.959 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:30:40.959 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: monmap epoch 1 2024-09-21T02:30:40.959 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:40.959 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: last_changed 2024-09-21T02:30:35.951032+0000 2024-09-21T02:30:40.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: created 2024-09-21T02:30:35.951032+0000 2024-09-21T02:30:40.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: min_mon_release 19 (squid) 2024-09-21T02:30:40.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: election_strategy: 1 2024-09-21T02:30:40.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T02:30:40.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: fsmap 2024-09-21T02:30:40.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T02:30:40.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: mgrmap e1: no daemons active 2024-09-21T02:30:40.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:40 smithi084 ceph-mon[30386]: from='client.? 172.21.15.84:0/1565464745' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T02:30:40.968 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T02:30:40.968 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout id: 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:40.968 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T02:30:40.968 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:30:40.968 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout services: 2024-09-21T02:30:40.968 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.643065s) 2024-09-21T02:30:40.968 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout data: 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:mon is available 2024-09-21T02:30:40.969 INFO:teuthology.orchestra.run.smithi084.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T02:30:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:41 smithi084 ceph-mon[30386]: from='client.? 172.21.15.84:0/377433055' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T02:30:41.838 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:41 smithi084 ceph-mon[30386]: from='client.? 172.21.15.84:0/377433055' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T02:30:42.148 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:30:42.148 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T02:30:42.149 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T02:30:42.150 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T02:30:42.150 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T02:30:42.150 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T02:30:42.150 INFO:teuthology.orchestra.run.smithi084.stdout:Generating new minimal ceph.conf... 2024-09-21T02:30:43.109 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:42 smithi084 ceph-mon[30386]: from='client.? 172.21.15.84:0/1839635749' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:30:43.376 INFO:teuthology.orchestra.run.smithi084.stdout:Restarting the monitor... 2024-09-21T02:30:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:43 smithi084 systemd[1]: Stopping Ceph mon.a for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:30:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:43 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a[30381]: 2024-09-21T02:30:43.717+0000 7f7e80800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:30:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:43 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a[30381]: 2024-09-21T02:30:43.717+0000 7f7e80800640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T02:30:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:43 smithi084 podman[30627]: 2024-09-21 02:30:43.74974339 +0000 UTC m=+0.140996710 container died b93cf3d7ec694628231d0c6f498eec2c17c7c9e1ef4c934cd4d86536e607f867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T02:30:44.390 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 podman[30627]: 2024-09-21 02:30:44.155678042 +0000 UTC m=+0.546931370 container cleanup b93cf3d7ec694628231d0c6f498eec2c17c7c9e1ef4c934cd4d86536e607f867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:30:44.391 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 bash[30627]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a 2024-09-21T02:30:44.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 podman[30639]: 2024-09-21 02:30:44.390079505 +0000 UTC m=+0.628988186 container remove b93cf3d7ec694628231d0c6f498eec2c17c7c9e1ef4c934cd4d86536e607f867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T02:30:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 systemd[1]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T02:30:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 systemd[1]: Stopped Ceph mon.a for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:30:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 systemd[1]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a.service: Consumed 1.288s CPU time. 2024-09-21T02:30:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 systemd[1]: Starting Ceph mon.a for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:30:45.144 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 podman[30728]: 2024-09-21 02:30:44.761212702 +0000 UTC m=+0.026826567 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:30:45.144 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:44 smithi084 podman[30728]: 2024-09-21 02:30:44.907534813 +0000 UTC m=+0.173148665 container create 2869e05ceb39fe2c3509b1333c27b26486cc7ed99f41fd6087ccf6c22a815e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:30:45.219 INFO:teuthology.orchestra.run.smithi084.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T02:30:45.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 podman[30728]: 2024-09-21 02:30:45.143612337 +0000 UTC m=+0.409226194 container init 2869e05ceb39fe2c3509b1333c27b26486cc7ed99f41fd6087ccf6c22a815e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T02:30:45.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 podman[30728]: 2024-09-21 02:30:45.150065056 +0000 UTC m=+0.415678914 container start 2869e05ceb39fe2c3509b1333c27b26486cc7ed99f41fd6087ccf6c22a815e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T02:30:45.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 bash[30728]: 2869e05ceb39fe2c3509b1333c27b26486cc7ed99f41fd6087ccf6c22a815e57 2024-09-21T02:30:45.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 systemd[1]: Started Ceph mon.a for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:30:45.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T02:30:45.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T02:30:45.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: pidfile_write: ignore empty --pid-file 2024-09-21T02:30:45.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: load: jerasure load: lrc 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: RocksDB version: 7.9.2 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Git sha 0 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: DB SUMMARY 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: DB Session ID: WIHLFNPMRAYHK8W7FLGB 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: CURRENT file: CURRENT 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94808 ; 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.error_if_exists: 0 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.create_if_missing: 0 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.paranoid_checks: 1 2024-09-21T02:30:45.448 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T02:30:45.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T02:30:45.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T02:30:45.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.env: 0x55f69cf80d60 2024-09-21T02:30:45.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T02:30:45.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.info_log: 0x55f6bdd47320 2024-09-21T02:30:45.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T02:30:45.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.statistics: (nil) 2024-09-21T02:30:45.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.use_fsync: 0 2024-09-21T02:30:45.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_log_file_size: 0 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.allow_fallocate: 1 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.use_direct_reads: 0 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.db_log_dir: 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.wal_dir: 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T02:30:45.451 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.write_buffer_manager: 0x55f6bdd4bd60 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T02:30:45.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.unordered_write: 0 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.row_cache: None 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.wal_filter: None 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.two_write_queues: 0 2024-09-21T02:30:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.wal_compression: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.atomic_flush: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.log_readahead_size: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T02:30:45.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_background_jobs: 2 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_background_compactions: -1 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_subcompactions: 1 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_open_files: -1 2024-09-21T02:30:45.455 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_background_flushes: -1 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Compression algorithms supported: 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: kZSTD supported: 0 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: kXpressCompression supported: 0 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: kBZip2Compression supported: 0 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: kLZ4Compression supported: 1 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: kZlibCompression supported: 1 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: kSnappyCompression supported: 1 2024-09-21T02:30:45.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.merge_operator: 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_filter: None 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f6bdd46f60) 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T02:30:45.457 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_type: 0 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_index_type: 0 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_shortening: 1 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: checksum: 4 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: no_block_cache: 0 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache: 0x55f6b9d0b610 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_options: 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: capacity : 536870912 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_shard_bits : 4 2024-09-21T02:30:45.458 INFO:journalctl@ceph.mon.a.smithi084.stdout: strict_capacity_limit : 0 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_compressed: (nil) 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: persistent_cache: (nil) 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size: 4096 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size_deviation: 10 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_restart_interval: 16 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_block_restart_interval: 1 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_block_size: 4096 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: partition_filters: 0 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: use_delta_encoding: 1 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: filter_policy: bloomfilter 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: whole_key_filtering: 1 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: verify_compression: 0 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-09-21T02:30:45.459 INFO:journalctl@ceph.mon.a.smithi084.stdout: format_version: 5 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_index_compression: 1 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_align: 0 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_auto_readahead_size: 262144 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout: prepopulate_block_cache: 0 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout: initial_auto_readahead_size: 8192 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression: NoCompression 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.num_levels: 7 2024-09-21T02:30:45.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T02:30:45.461 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T02:30:45.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T02:30:45.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.inplace_update_support: 0 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T02:30:45.464 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.bloom_locality: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.max_successive_merges: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.ttl: 2592000 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T02:30:45.465 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.enable_blob_files: false 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.min_blob_size: 0 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 65b9d928-6ff2-4942-a2f9-d244ca43918a 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885845259024, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T02:30:45.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885845262284, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91051, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 283, "table_properties": {"data_size": 89099, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11601, "raw_average_key_size": 47, "raw_value_size": 82504, "raw_average_value_size": 340, "num_data_blocks": 12, "num_entries": 242, "num_filter_entries": 242, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726885845, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "65b9d928-6ff2-4942-a2f9-d244ca43918a", "db_session_id": "WIHLFNPMRAYHK8W7FLGB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885845262574, "job": 1, "event": "recovery_finished"} 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f6bdd6ca80 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: DB pointer 0x55f6beb0e000 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** DB Stats ** 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:30:45.467 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: L0 2/0 90.78 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 41.5 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: Sum 2/0 90.78 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 41.5 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 41.5 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 41.5 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative compaction: 0.00 GB write, 8.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval compaction: 0.00 GB write, 8.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache BinnedLRUCache@0x55f6b9d0b610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-21T02:30:45.469 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: starting mon.a rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a@-1(???) e1 preinit fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a@-1(???).mds e1 new map 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a@-1(???).mds e1 print_map 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: e1 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: btime 2024-09-21T02:30:39:705299+0000 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: legacy client fscid: -1 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout: No filesystems configured 2024-09-21T02:30:45.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: monmap epoch 1 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: last_changed 2024-09-21T02:30:35.951032+0000 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: created 2024-09-21T02:30:35.951032+0000 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: min_mon_release 19 (squid) 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: election_strategy: 1 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: fsmap 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T02:30:45.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:45 smithi084 ceph-mon[30747]: mgrmap e1: no daemons active 2024-09-21T02:30:46.365 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T02:30:46.399 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:30:46.399 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mgr... 2024-09-21T02:30:46.399 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T02:30:46.400 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T02:30:46.728 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x 2024-09-21T02:30:46.728 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T02:30:46.953 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b18da14-77c1-11ef-baf5-efdc52797490.target.wants/ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-5b18da14-77c1-11ef-baf5-efdc52797490@.service. 2024-09-21T02:30:47.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:46 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3430523491' entity='client.admin' 2024-09-21T02:30:47.013 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:30:46 smithi084 systemd[1]: Starting Ceph mgr.x for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:30:47.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:30:47 smithi084 podman[30955]: 2024-09-21 02:30:47.21932985 +0000 UTC m=+0.027352088 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:30:52.013 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:30:51 smithi084 podman[30955]: 2024-09-21 02:30:51.619254016 +0000 UTC m=+4.427276254 container create 7df86c183f495f2f311d581dd285cb153849180d5047bcbfc306f544bf8667df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:30:55.111 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:30:55.111 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T02:30:55.125 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:30:55.125 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T02:30:55.125 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T02:30:55.125 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T02:30:55.144 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:30:55.144 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T02:30:55.157 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:30:55.158 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T02:30:55.158 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T02:30:55.158 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T02:30:55.158 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr to start... 2024-09-21T02:30:55.158 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr... 2024-09-21T02:30:55.300 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:30:55 smithi084 podman[30955]: 2024-09-21 02:30:55.016194946 +0000 UTC m=+7.824217205 container init 7df86c183f495f2f311d581dd285cb153849180d5047bcbfc306f544bf8667df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:30:55.301 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:30:55 smithi084 podman[30955]: 2024-09-21 02:30:55.02275172 +0000 UTC m=+7.830773958 container start 7df86c183f495f2f311d581dd285cb153849180d5047bcbfc306f544bf8667df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T02:30:55.301 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:30:55 smithi084 bash[30955]: 7df86c183f495f2f311d581dd285cb153849180d5047bcbfc306f544bf8667df 2024-09-21T02:30:55.301 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:30:55 smithi084 systemd[1]: Started Ceph mgr.x for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:30:56.173 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:55 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2762320161' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T02:30:56.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:30:56.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:30:56.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:30:56.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T02:30:56.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T02:30:56.473 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T02:30:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T02:30:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T02:30:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T02:30:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T02:30:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:30:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T02:30:56.474 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T02:30:56.475 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T02:30:56.476 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T02:30:56.479 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T02:30:56.479 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T02:30:56.479 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T02:30:56.479 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:56.479 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T02:30:56.479 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T02:30:56.479 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T02:30:39:705299+0000", 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:56.480 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T02:30:39.706524+0000", 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:30:56.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:56.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T02:30:56.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:30:56.482 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (1/15)... 2024-09-21T02:30:59.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:30:59 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3225012581' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T02:30:59.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T02:30:59.991 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T02:30:59.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T02:30:59.993 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T02:30:59.999 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T02:30:59.999 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T02:30:59.999 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T02:30:59.999 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:30:59.999 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:31:00.000 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T02:30:39:705299+0000", 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:31:00.001 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:00.002 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T02:31:00.002 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:31:00.002 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T02:30:39.706524+0000", 2024-09-21T02:31:00.002 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:31:00.002 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:00.002 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T02:31:00.002 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:31:00.002 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (2/15)... 2024-09-21T02:31:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: Activating manager daemon x 2024-09-21T02:31:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: mgrmap e2: x(active, starting, since 0.00498925s) 2024-09-21T02:31:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:31:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:31:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:31:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:31:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:31:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: Manager daemon x is now available 2024-09-21T02:31:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:31:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' 2024-09-21T02:31:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:31:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' 2024-09-21T02:31:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:01 smithi084 ceph-mon[30747]: from='mgr.14100 172.21.15.84:0/1797778855' entity='mgr.x' 2024-09-21T02:31:03.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:03 smithi084 ceph-mon[30747]: mgrmap e3: x(active, since 1.00924s) 2024-09-21T02:31:03.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:03 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3523633437' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T02:31:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:31:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:31:03.623 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:31:03.624 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T02:31:03.624 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T02:31:03.624 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T02:31:03.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T02:31:03.628 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T02:31:03.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T02:31:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T02:30:39:705299+0000", 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:31:03.631 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T02:30:39.706524+0000", 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T02:31:03.632 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:31:03.633 INFO:teuthology.orchestra.run.smithi084.stdout:mgr is available 2024-09-21T02:31:04.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:04 smithi084 ceph-mon[30747]: mgrmap e4: x(active, since 2s) 2024-09-21T02:31:05.050 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:31:05.050 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T02:31:05.050 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T02:31:05.051 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T02:31:05.052 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T02:31:05.052 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T02:31:05.052 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling cephadm module... 2024-09-21T02:31:05.320 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:05 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3018429859' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T02:31:06.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:06 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1457882338' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T02:31:06.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:06 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: ignoring --setuser ceph since I am not root 2024-09-21T02:31:06.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:06 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: ignoring --setgroup ceph since I am not root 2024-09-21T02:31:07.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:07 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1457882338' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T02:31:07.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:07 smithi084 ceph-mon[30747]: mgrmap e5: x(active, since 5s) 2024-09-21T02:31:08.381 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:08 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1119133525' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T02:31:08.388 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:31:08.388 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T02:31:08.388 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:31:08.388 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T02:31:08.388 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T02:31:08.388 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:31:08.388 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-09-21T02:31:08.388 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 5... 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: Active manager daemon x restarted 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: Activating manager daemon x 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: mgrmap e6: x(active, starting, since 0.00442789s) 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:31:12.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:12 smithi084 ceph-mon[30747]: Manager daemon x is now available 2024-09-21T02:31:13.949 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:31:13.949 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T02:31:13.949 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T02:31:13.950 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:31:13.950 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 5 is available 2024-09-21T02:31:13.950 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying orchestrator module is enabled... 2024-09-21T02:31:14.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:14.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:14.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: Found migration_current of "None". Setting to last migration. 2024-09-21T02:31:14.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:14.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:14.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:14.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:14.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:31:14.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:31:14.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: mgrmap e7: x(active, since 1.00962s) 2024-09-21T02:31:14.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T02:31:14.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-mon[30747]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T02:31:14.514 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:31:14.217+0000 7fd5cc800640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:02:31:14] ENGINE Error in HTTPServer.serve 2024-09-21T02:31:14.514 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: Traceback (most recent call last): 2024-09-21T02:31:14.514 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:31:14.514 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: self._connections.run(self.expiration_interval) 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: self._run(expiration_interval) 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: s = self.context.wrap_socket( 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: return self.sslsocket_class._create( 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: self.do_handshake() 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:31:14.515 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: self._sslobj.do_handshake() 2024-09-21T02:31:14.516 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:31:14.516 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:31:15.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:15 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:14] ENGINE Bus STARTING 2024-09-21T02:31:15.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:15 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:14] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T02:31:15.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:15 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:14] ENGINE Error in HTTPServer.serve 2024-09-21T02:31:15.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: Traceback (most recent call last): 2024-09-21T02:31:15.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:31:15.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._connections.run(self.expiration_interval) 2024-09-21T02:31:15.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:31:15.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._run(expiration_interval) 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: s = self.context.wrap_socket( 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: return self.sslsocket_class._create( 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: self.do_handshake() 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._sslobj.do_handshake() 2024-09-21T02:31:15.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:31:15.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:15 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:14] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T02:31:15.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:15 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:14] ENGINE Bus STARTED 2024-09-21T02:31:15.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:15 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:15.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:15 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2866223296' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T02:31:15.822 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T02:31:15.822 INFO:teuthology.orchestra.run.smithi084.stdout:Setting orchestrator backend to cephadm... 2024-09-21T02:31:16.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:16 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2866223296' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T02:31:16.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:16 smithi084 ceph-mon[30747]: mgrmap e8: x(active, since 2s) 2024-09-21T02:31:18.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:17 smithi084 ceph-mon[30747]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:17 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:17 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:18.601 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T02:31:18.601 INFO:teuthology.orchestra.run.smithi084.stdout:Generating ssh key... 2024-09-21T02:31:18.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:18 smithi084 ceph-mon[30747]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: Generating public/private rsa key pair. 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: Your identification has been saved in /tmp/tmpr_7nwi1k/key 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: Your public key has been saved in /tmp/tmpr_7nwi1k/key.pub 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: The key fingerprint is: 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: SHA256:Z5sqF1Q1iyJmNmyGbBxIEiaOGf02bJJfaz8P/XurDXc ceph-5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: The key's randomart image is: 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: +---[RSA 3072]----+ 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: |==... .o | 2024-09-21T02:31:19.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: |=+oo + .. o | 2024-09-21T02:31:19.764 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: |o. += X ... . | 2024-09-21T02:31:19.764 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: | o.**.o.. | 2024-09-21T02:31:19.764 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: | = o oS o | 2024-09-21T02:31:19.764 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: | . o .+ o | 2024-09-21T02:31:19.764 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: | . ...+ . . E| 2024-09-21T02:31:19.764 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: | . +o . +.. | 2024-09-21T02:31:19.764 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: | o.o. ++o. | 2024-09-21T02:31:19.764 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:19 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: +----[SHA256]-----+ 2024-09-21T02:31:20.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:20 smithi084 ceph-mon[30747]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:20.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:20 smithi084 ceph-mon[30747]: Generating ssh key... 2024-09-21T02:31:20.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:20 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:20.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:20 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:21.514 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC22VSSdTXrmdwOJ+VdATWUF3ClUyO0ebjC8Gw5OPelXj1LJamBU8HhW324fMBkXD3TnuZLL6hAUCM3QpzgW7qCfSbg5kpfnTOC5XNYo05iF1U87AQwAN6W5h5772OK9CL2W7GkE6E4QeO46u7DZ3uZVf6pFP19xRbYv9jVTCUoVdrlP0A/gWSQheEqmr9jSut1rsO4UeYHoCaKTxNiR0Coow1ku4+mP1o/0QzIqTKYdJgaxDRgBcKr0RB/v3DqLH/EK2cpibUr6HBw4U9/1tn+N7TeRS0rRM475Pij6Urr392uBglh8Ka89Q+G1Rw/b8OD6jyXnSPKepzd8SG1hlgxwACSHm4ARn1zOcjaY9aSOyKH1FGJUAE6BlMqlwP28QmKQDZTF1EuU+gBw/WSaKD3BEuHD06J5QP3jyNCYh3bXoxndnQWAJwiaZNYHIWuxF4zTxDU6nIKkp2lx+x1fukmZknYhwSQ/m9CwnkQGzlgnD8LIsqpCvICgKiD6aPZ2xU= ceph-5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:31:21.514 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:31:21.514 INFO:teuthology.orchestra.run.smithi084.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T02:31:21.519 INFO:teuthology.orchestra.run.smithi084.stdout:Adding host smithi084... 2024-09-21T02:31:21.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:21 smithi084 ceph-mon[30747]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:22.679 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:22 smithi084 ceph-mon[30747]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:23.724 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:23 smithi084 ceph-mon[30747]: Deploying cephadm binary to smithi084 2024-09-21T02:31:26.535 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Added host 'smithi084' with addr '172.21.15.84' 2024-09-21T02:31:26.535 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mon service... 2024-09-21T02:31:27.238 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:26 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:27.238 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:26 smithi084 ceph-mon[30747]: Added host smithi084 2024-09-21T02:31:27.238 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:26 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:28.129 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T02:31:28.130 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mgr service... 2024-09-21T02:31:28.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:28 smithi084 ceph-mon[30747]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:28.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:28 smithi084 ceph-mon[30747]: Saving service mon spec with placement count:5 2024-09-21T02:31:28.644 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:28 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:30.148 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T02:31:30.390 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:30 smithi084 ceph-mon[30747]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:30.390 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:30 smithi084 ceph-mon[30747]: Saving service mgr spec with placement count:2 2024-09-21T02:31:30.390 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:30 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:30.390 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:30 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:30.390 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:30 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:32.222 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:31 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2325313090' entity='client.admin' 2024-09-21T02:31:32.222 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:31 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:33.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:33 smithi084 ceph-mon[30747]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:31:33.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:33 smithi084 ceph-mon[30747]: from='mgr.14118 172.21.15.84:0/1465047746' entity='mgr.x' 2024-09-21T02:31:33.659 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:33 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/154097237' entity='client.admin' 2024-09-21T02:31:33.664 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling the dashboard module... 2024-09-21T02:31:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:35 smithi084 ceph-mon[30747]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:31:35.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:35 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2859232930' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T02:31:35.680 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:35 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: ignoring --setuser ceph since I am not root 2024-09-21T02:31:35.680 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:35 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: ignoring --setgroup ceph since I am not root 2024-09-21T02:31:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:36 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2859232930' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T02:31:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:36 smithi084 ceph-mon[30747]: mgrmap e9: x(active, since 23s) 2024-09-21T02:31:37.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:37 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/719135386' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T02:31:37.520 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:31:37.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T02:31:37.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T02:31:37.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T02:31:37.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T02:31:37.521 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:31:37.521 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-09-21T02:31:37.521 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 9... 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: Active manager daemon x restarted 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: Activating manager daemon x 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: mgrmap e10: x(active, starting, since 0.00462257s) 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T02:31:41.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:41 smithi084 ceph-mon[30747]: Manager daemon x is now available 2024-09-21T02:31:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T02:31:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T02:31:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-mon[30747]: mgrmap e11: x(active, since 1.00832s) 2024-09-21T02:31:43.263 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:31:42.943+0000 7f951b200640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:02:31:42] ENGINE Error in HTTPServer.serve 2024-09-21T02:31:43.263 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: Traceback (most recent call last): 2024-09-21T02:31:43.263 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:31:43.263 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: self._connections.run(self.expiration_interval) 2024-09-21T02:31:43.263 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: self._run(expiration_interval) 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: s = self.context.wrap_socket( 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: return self.sslsocket_class._create( 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: self.do_handshake() 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: self._sslobj.do_handshake() 2024-09-21T02:31:43.264 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:31:43.265 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:31:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:31:43.812 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:43 smithi084 ceph-mon[30747]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T02:31:43.812 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:43 smithi084 ceph-mon[30747]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T02:31:43.812 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:43.819 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T02:31:43.819 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T02:31:43.819 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T02:31:43.819 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T02:31:43.819 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 9 is available 2024-09-21T02:31:43.819 INFO:teuthology.orchestra.run.smithi084.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:44 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:42] ENGINE Bus STARTING 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:44 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:42] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:44 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:42] ENGINE Error in HTTPServer.serve 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: Traceback (most recent call last): 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._connections.run(self.expiration_interval) 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._run(expiration_interval) 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T02:31:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout: s = self.context.wrap_socket( 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout: return self.sslsocket_class._create( 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout: self.do_handshake() 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._sslobj.do_handshake() 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:44 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:43] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:44 smithi084 ceph-mon[30747]: [21/Sep/2024:02:31:43] ENGINE Bus STARTED 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:44 smithi084 ceph-mon[30747]: mgrmap e12: x(active, since 2s) 2024-09-21T02:31:45.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:45.744 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:45 smithi084 ceph-mon[30747]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:45.749 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUYmdSurasmuvmY/7J685bmKO5pzcwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAyMzE0NVoXDTM0\nMDkyMjAyMzE0NVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1Ljg0MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAvmleOcR5enFZA7NDRvb1unhzS2HQ6QxXDwl4\nTfHK976+rSZ8s6kybuAuPpYUcxmuF4mw0LwdOPYGqiQOB2hNrFTTG9RY5e+lCiOy\njJfaICjCO8u4G+HjmK3KfBctjfD144a4lJHtpCA/AreFLACSE34hjT4pN+q1o5ZN\nvoK1dVrTx+DfgicY+M4+hZrmo5AKKUICq9NUbIDB57uKzNlcYY4tuHqG4sPayYFP\npIbteoa1KsFbk6WTgurndJ7Z9Qr9LeSgP9b0W9yo4XrZZuoMm9xoLfU8oRzd2V5Z\naLLB8L1ni05Vi6KsCh7NvhXNI6AHcdykveXjlGjwZXRPBRAZ5UTwKrfV/fPyOu74\nztAVQgl/X+TCRb8sYeBTLZzn+KSZqn4n4trXZKI7fdem7VYXlKrFwX15cexXGXb9\nnfwcH5oEQPDYYySmyS/n/AZjxRTKxK9l3RR4F4DApm8vDTUQQ+mPD7OLCVIULjDs\nRHlKkkcbn3JrwRW2z3kGAopSb+mn0ovfmAZToWq5YK5YrMFWXe7fP1oZz1B3WxN3\ns2Wld85N7XvOqO5k4UqOzDypdCSPyzQ9bdFdSNXVC1xEJJ9lsdPbaeUcK/uhxtYq\nh/CbguSCBjMwBrGBXuQkxWNPmiA2qkfWHOx7PLY2VJJ6EIDI2wGtElAX+r28ToVy\nFZT7qesCAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDg0LmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPVDAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQCIAphdUyyS0HoBUG4Vpgw7hIv7kdBIWBSu+oZZ\n2ApZ4p5bFhW9/LiVwjwIcP7cnoVKcXSwXrsQcCcpBaJk/CNDG2s2Z25X0f96fbJu\nEMpMDl15Ar2brxtbRiEJeFlR0VmpGIjQ/WvRvgT8KkmpA4RW8noDXwFWIPD0fSpZ\nT0FPCa8xMeOCTvXGU81+GDK0506G1jczhRYFUHwaWGkuTgL+Zi63Orxtb0uzU2Ro\n5gF5Ts4LDzeYOrI2xwj2FBxJsSBZkrWodEjJ/Qp4maYptTyVreSORRqMguSYMN1p\ndxCnhA85qIeE5o0dwQ5A+4v8zrhHTls9tgS5mVpJ3VZVIYzdCzvWP9LttCJQa1Qp\nkH1Hk049ATQTp1v3Vx8PwCyT/WSP056vBdghuBUqXMCqga5aTBwT0wwjUMuSNysW\nOG19WCD6zVuDhfPanapgqqMiZJFgvyPskOmM+n5oP7Tfw852aBxbeNgHvZuNSL3S\nm6afMgP/1sAMf6D6WYqF+qErUN80Zw3KhaT0haQKL5pW+0pLVmUJFvvvxOUS6gGr\nSCrnOPpuDusJOSKp/fBxCvZ3Dv0MIu/XBF+FzC6OSQ+fmYYLge4aTGKfpwEBVFbv\niJTlyDGCaiPZTL9mE9vrfg64AGkunlUtK8lWa6s2Z3i6sp7gZKiQiyvs4UiV9ZjV\nzH/e0w==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAvmleOcR5enFZA7NDRvb1unhzS2HQ6QxXDwl4TfHK976+rSZ8\ns6kybuAuPpYUcxmuF4mw0LwdOPYGqiQOB2hNrFTTG9RY5e+lCiOyjJfaICjCO8u4\nG+HjmK3KfBctjfD144a4lJHtpCA/AreFLACSE34hjT4pN+q1o5ZNvoK1dVrTx+Df\ngicY+M4+hZrmo5AKKUICq9NUbIDB57uKzNlcYY4tuHqG4sPayYFPpIbteoa1KsFb\nk6WTgurndJ7Z9Qr9LeSgP9b0W9yo4XrZZuoMm9xoLfU8oRzd2V5ZaLLB8L1ni05V\ni6KsCh7NvhXNI6AHcdykveXjlGjwZXRPBRAZ5UTwKrfV/fPyOu74ztAVQgl/X+TC\nRb8sYeBTLZzn+KSZqn4n4trXZKI7fdem7VYXlKrFwX15cexXGXb9nfwcH5oEQPDY\nYySmyS/n/AZjxRTKxK9l3RR4F4DApm8vDTUQQ+mPD7OLCVIULjDsRHlKkkcbn3Jr\nwRW2z3kGAopSb+mn0ovfmAZToWq5YK5YrMFWXe7fP1oZz1B3WxN3s2Wld85N7XvO\nqO5k4UqOzDypdCSPyzQ9bdFdSNXVC1xEJJ9lsdPbaeUcK/uhxtYqh/CbguSCBjMw\nBrGBXuQkxWNPmiA2qkfWHOx7PLY2VJJ6EIDI2wGtElAX+r28ToVyFZT7qesCAwEA\nAQKCAf87DnMrEStpAb7NM8xDnLtm5ygObHte/9szzrwbCkm2JtljQSY4+UFEu9zP\nJiOX9cVvh3hPq6IxbunVdPLk8tskZMRIdvpOvQUMuZ9AyKURusW2kt8g+e6dOONh\nMwJUajSmKbxJJPmPutcDZxtNJBNdkfRvpwshsxCjEpSj6EzF5f9i/vWGzv/vxNTS\nm2u6G/KkctTHqV2F4zZA3IOWnwcIB6qM83OvR9xgoyEQf/v0njmSb5ld/pZbauZe\nq7LuGkc49K/yUB959/ZpK+RB0+9IaBPnxsGg0FMxsXgJmpryqWWnNaSF3bsXztxn\nfsHuF4EEaTd8FNEanQsln4bipLVi3SJCeZxOLTcslkcV7vKd0X2QJgvokgvajs0A\n/9aFr8Rs7xNb9XBCxnf97WfkuUrqa17IJVQk2Jl8z85WRlxsDDudTl3PJheX2umS\nVECdS318D1lEO/JC7QEnARqDNApqk7uRh0MwhLlee4pL4MwjGpB5xPArGjZXDFT4\nnPSJ7Pvo729QqDc/2nRHKTizzpV8rsV8hVJYXDG0b5bAV5wxtfQdQKuS/o8spxht\nGA5Hok9GBOHcFf3PLN4V/8LrOyECNS5AFGM2KBtTGS59xdklqANcDfBFgLf7KnYy\nyYZjzYAILVIDFUwteVdrFaYWjbHSJr7NqUAm6AeuGo3sX+DhAoIBAQDwnKSxN71X\nkEJg+iQQova7Xsdh2cqRpMu0qzc/DjwQeouVyCQhAUs9rRQUe/L4j/5Z0N65f2wf\nbRYwdb2VyRntUifDcaP765XRnOrAnhlA5ZIfYjeuqbqTj1ufyEfKCeZ7SW4SG9tt\nzzaDMZcGQSRiQxHz2W52ZSfXnXl2Jg1r10W+57JML/3MRog0zcy9U12K08M4IwcQ\noGfZnI/GF5IvEgyLc59opCg+ybPrtk5WdUNvQ2WuEqDuZtmCDz3zi38YwyW8dTV2\nMVjZbXlU52s4pcmuK+jeWEImpVyuxgUdZTog378LByfZZ+ZGYCPYQrBibTfrwB0F\nZixwy/owQZCxAoIBAQDKltVP5y6YxMoeRV1U8Nf9LY1sTtN3L8+MNKj8WGCcN0NW\nUJ0VaQ8H7U9WMqYeYWobKHf+TOrMc5OusU+yGVG8o7YRvCNhy4I1VAJOuPTdOwbf\n3dZ14rCFzmFZ3GZIWsZ7VUhyQvNF6w2U34BAb+i7P8r3wZjHXHrxItSzr3EPy+va\nCxSA+LyLagoT+4RbbmLV/gr9Lquc5Eg/W4Czqx6fZwCEErqk62H0VKOilHD2Hg16\n9o24uoztoZWWWKGyypgsntmQ/l3f+s6yPWmtTxx+NIcaTTjGS6mv0WsgeOPqBjPv\nA/GJZv0YZGFRCy5snCxojBb8WcIhgLxpAuBMN6tbAoIBAAGhTgxVUFcThx+ZEj16\nnSlPzxH+o7yw3SBwOIOY2RdTfTaakIQYuiXE0moBHPhKIXMCUz/2eQkNeCUD5zDo\nl+Bfuh0829uNEQrGgWCksY8a/w5vX+kzBSySwBApDzNzNbiIGtLMlYP872WcJGXK\nczCnO6vnQTRUIxz22CfQwi6E2tgcQbz6ZkHICIwzCLwPoIacQKpUsmuOaqWyxdaV\nukvPV35qXh4bXppuS2XBam5zhO1wC3ROdACpebfD2quXuli0mcDZGm+ejfeLIlNM\n7hEILoGbkoxPFMOmQyZ7+PTmBqrKWUT922tBpPG9HQEOEpvYGZTjTE8JDiwFdcB1\n8UECggEAFCrHuViOLu8IH9NP4zDGj5GFTo7aRjcgNhjX6abylxp5PZJw0LzQnj1l\ndHM+Ti/sXB+/MjV9+jRXM0C7akNS+7BgY4uTCh00LRLb1/JZjdxeZtKykrGqWOee\nkU97byB6ObTXrWg0x3UKuRM2tTNuu5UyI0/GYbI3GuIYwnpoiuYF6ILJ27znKAm6\nTxruphtrA1pyxZlrxAaFmqkFOt2CAuRCDOPAaMJ10djLIVgdlqKPPPpmSUlo1g8L\n0RepoR7B309A4UoxFiblhKDQcEw7zeR0vo2JZVQK5FG4lFb0eUt8yAJgfQkfkNoN\nRgAS8wTo9s9bSmu1A5jJKLr8kRnJmQKCAQEAkccYJNbyzHO+J8bVI3rn/+CtpL/G\nnaxdp9c+qCP5W3gP6YSuz2ynzioDuo66TPFEmEBMO2eYdcU5dOum+EtJ0B4XgP71\nC7nuK9Dr24KvABNV+0XtveVZWIYl2mqRC3hRqj0NfucHpbItb9V2aBKUTL6F1+rT\nDzbndrxGPuVwYOeajxisSakY2owPY6PIBxxSd1tRCyU4fQndlY+zrmdb0RzgZTol\nLAdvLQ6gEibSU6vUAnWPICBaocg4HsYKq4VsIDBnk4p8RxyfmCqbmflgKc0LCqfW\nr7MtUDIm7KuXi1rwUAJIwFXVYHbz9UM1nreHtrs4YT+fUn52O5TpkRB5dg==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T02:31:48.069 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T02:31:48.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:48 smithi084 ceph-mon[30747]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:48.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:48 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:49.393 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T02:31:49.393 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial admin user... 2024-09-21T02:31:50.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:49 smithi084 ceph-mon[30747]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:50.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:49 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:50.973 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$f26agz/TeUqZ0945bDE0/u2aLf3cSKawKuirq6Q1Olh/274cdfMfO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726885910, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T02:31:50.973 INFO:teuthology.orchestra.run.smithi084.stdout:Fetching dashboard port number... 2024-09-21T02:31:51.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:51 smithi084 ceph-mon[30747]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:51.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:52.379 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T02:31:52.397 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T02:31:52.397 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T02:31:52.410 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T02:31:52.410 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T02:31:52.410 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T02:31:52.410 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T02:31:52.412 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph Dashboard is now available at: 2024-09-21T02:31:52.413 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:52.413 INFO:teuthology.orchestra.run.smithi084.stdout: URL: https://smithi084.front.sepia.ceph.com:8443/ 2024-09-21T02:31:52.413 INFO:teuthology.orchestra.run.smithi084.stdout: User: admin 2024-09-21T02:31:52.413 INFO:teuthology.orchestra.run.smithi084.stdout: Password: r50v4v9rwy 2024-09-21T02:31:52.413 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:52.413 INFO:teuthology.orchestra.run.smithi084.stdout:Saving cluster configuration to /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config directory 2024-09-21T02:31:52.714 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:52 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1627529516' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T02:31:53.920 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T02:31:53.920 INFO:teuthology.orchestra.run.smithi084.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T02:31:53.920 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:53.920 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: ceph telemetry on 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout:For more information see: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:31:53.921 INFO:teuthology.orchestra.run.smithi084.stdout:Bootstrap complete. 2024-09-21T02:31:53.976 INFO:tasks.cephadm:Fetching config... 2024-09-21T02:31:53.977 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:31:53.977 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T02:31:54.011 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T02:31:54.011 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:31:54.011 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T02:31:54.091 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T02:31:54.091 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:31:54.091 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T02:31:54.189 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T02:31:54.189 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:31:54.190 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T02:31:54.264 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T02:31:54.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC22VSSdTXrmdwOJ+VdATWUF3ClUyO0ebjC8Gw5OPelXj1LJamBU8HhW324fMBkXD3TnuZLL6hAUCM3QpzgW7qCfSbg5kpfnTOC5XNYo05iF1U87AQwAN6W5h5772OK9CL2W7GkE6E4QeO46u7DZ3uZVf6pFP19xRbYv9jVTCUoVdrlP0A/gWSQheEqmr9jSut1rsO4UeYHoCaKTxNiR0Coow1ku4+mP1o/0QzIqTKYdJgaxDRgBcKr0RB/v3DqLH/EK2cpibUr6HBw4U9/1tn+N7TeRS0rRM475Pij6Urr392uBglh8Ka89Q+G1Rw/b8OD6jyXnSPKepzd8SG1hlgxwACSHm4ARn1zOcjaY9aSOyKH1FGJUAE6BlMqlwP28QmKQDZTF1EuU+gBw/WSaKD3BEuHD06J5QP3jyNCYh3bXoxndnQWAJwiaZNYHIWuxF4zTxDU6nIKkp2lx+x1fukmZknYhwSQ/m9CwnkQGzlgnD8LIsqpCvICgKiD6aPZ2xU= ceph-5b18da14-77c1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:31:54.386 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC22VSSdTXrmdwOJ+VdATWUF3ClUyO0ebjC8Gw5OPelXj1LJamBU8HhW324fMBkXD3TnuZLL6hAUCM3QpzgW7qCfSbg5kpfnTOC5XNYo05iF1U87AQwAN6W5h5772OK9CL2W7GkE6E4QeO46u7DZ3uZVf6pFP19xRbYv9jVTCUoVdrlP0A/gWSQheEqmr9jSut1rsO4UeYHoCaKTxNiR0Coow1ku4+mP1o/0QzIqTKYdJgaxDRgBcKr0RB/v3DqLH/EK2cpibUr6HBw4U9/1tn+N7TeRS0rRM475Pij6Urr392uBglh8Ka89Q+G1Rw/b8OD6jyXnSPKepzd8SG1hlgxwACSHm4ARn1zOcjaY9aSOyKH1FGJUAE6BlMqlwP28QmKQDZTF1EuU+gBw/WSaKD3BEuHD06J5QP3jyNCYh3bXoxndnQWAJwiaZNYHIWuxF4zTxDU6nIKkp2lx+x1fukmZknYhwSQ/m9CwnkQGzlgnD8LIsqpCvICgKiD6aPZ2xU= ceph-5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:31:54.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC22VSSdTXrmdwOJ+VdATWUF3ClUyO0ebjC8Gw5OPelXj1LJamBU8HhW324fMBkXD3TnuZLL6hAUCM3QpzgW7qCfSbg5kpfnTOC5XNYo05iF1U87AQwAN6W5h5772OK9CL2W7GkE6E4QeO46u7DZ3uZVf6pFP19xRbYv9jVTCUoVdrlP0A/gWSQheEqmr9jSut1rsO4UeYHoCaKTxNiR0Coow1ku4+mP1o/0QzIqTKYdJgaxDRgBcKr0RB/v3DqLH/EK2cpibUr6HBw4U9/1tn+N7TeRS0rRM475Pij6Urr392uBglh8Ka89Q+G1Rw/b8OD6jyXnSPKepzd8SG1hlgxwACSHm4ARn1zOcjaY9aSOyKH1FGJUAE6BlMqlwP28QmKQDZTF1EuU+gBw/WSaKD3BEuHD06J5QP3jyNCYh3bXoxndnQWAJwiaZNYHIWuxF4zTxDU6nIKkp2lx+x1fukmZknYhwSQ/m9CwnkQGzlgnD8LIsqpCvICgKiD6aPZ2xU= ceph-5b18da14-77c1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:31:54.450 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:54 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3082472001' entity='client.admin' 2024-09-21T02:31:54.466 INFO:teuthology.orchestra.run.smithi090.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC22VSSdTXrmdwOJ+VdATWUF3ClUyO0ebjC8Gw5OPelXj1LJamBU8HhW324fMBkXD3TnuZLL6hAUCM3QpzgW7qCfSbg5kpfnTOC5XNYo05iF1U87AQwAN6W5h5772OK9CL2W7GkE6E4QeO46u7DZ3uZVf6pFP19xRbYv9jVTCUoVdrlP0A/gWSQheEqmr9jSut1rsO4UeYHoCaKTxNiR0Coow1ku4+mP1o/0QzIqTKYdJgaxDRgBcKr0RB/v3DqLH/EK2cpibUr6HBw4U9/1tn+N7TeRS0rRM475Pij6Urr392uBglh8Ka89Q+G1Rw/b8OD6jyXnSPKepzd8SG1hlgxwACSHm4ARn1zOcjaY9aSOyKH1FGJUAE6BlMqlwP28QmKQDZTF1EuU+gBw/WSaKD3BEuHD06J5QP3jyNCYh3bXoxndnQWAJwiaZNYHIWuxF4zTxDU6nIKkp2lx+x1fukmZknYhwSQ/m9CwnkQGzlgnD8LIsqpCvICgKiD6aPZ2xU= ceph-5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:31:54.479 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC22VSSdTXrmdwOJ+VdATWUF3ClUyO0ebjC8Gw5OPelXj1LJamBU8HhW324fMBkXD3TnuZLL6hAUCM3QpzgW7qCfSbg5kpfnTOC5XNYo05iF1U87AQwAN6W5h5772OK9CL2W7GkE6E4QeO46u7DZ3uZVf6pFP19xRbYv9jVTCUoVdrlP0A/gWSQheEqmr9jSut1rsO4UeYHoCaKTxNiR0Coow1ku4+mP1o/0QzIqTKYdJgaxDRgBcKr0RB/v3DqLH/EK2cpibUr6HBw4U9/1tn+N7TeRS0rRM475Pij6Urr392uBglh8Ka89Q+G1Rw/b8OD6jyXnSPKepzd8SG1hlgxwACSHm4ARn1zOcjaY9aSOyKH1FGJUAE6BlMqlwP28QmKQDZTF1EuU+gBw/WSaKD3BEuHD06J5QP3jyNCYh3bXoxndnQWAJwiaZNYHIWuxF4zTxDU6nIKkp2lx+x1fukmZknYhwSQ/m9CwnkQGzlgnD8LIsqpCvICgKiD6aPZ2xU= ceph-5b18da14-77c1-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T02:31:54.521 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC22VSSdTXrmdwOJ+VdATWUF3ClUyO0ebjC8Gw5OPelXj1LJamBU8HhW324fMBkXD3TnuZLL6hAUCM3QpzgW7qCfSbg5kpfnTOC5XNYo05iF1U87AQwAN6W5h5772OK9CL2W7GkE6E4QeO46u7DZ3uZVf6pFP19xRbYv9jVTCUoVdrlP0A/gWSQheEqmr9jSut1rsO4UeYHoCaKTxNiR0Coow1ku4+mP1o/0QzIqTKYdJgaxDRgBcKr0RB/v3DqLH/EK2cpibUr6HBw4U9/1tn+N7TeRS0rRM475Pij6Urr392uBglh8Ka89Q+G1Rw/b8OD6jyXnSPKepzd8SG1hlgxwACSHm4ARn1zOcjaY9aSOyKH1FGJUAE6BlMqlwP28QmKQDZTF1EuU+gBw/WSaKD3BEuHD06J5QP3jyNCYh3bXoxndnQWAJwiaZNYHIWuxF4zTxDU6nIKkp2lx+x1fukmZknYhwSQ/m9CwnkQGzlgnD8LIsqpCvICgKiD6aPZ2xU= ceph-5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:31:54.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T02:31:54.908 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:55.353 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:55 smithi084 ceph-mon[30747]: mgrmap e13: x(active, since 12s) 2024-09-21T02:31:56.750 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T02:31:56.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T02:31:56.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:56 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/336970499' entity='client.admin' 2024-09-21T02:31:56.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:56.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:56.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T02:31:56.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:56.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:56.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:57.269 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:31:59.084 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi090 2024-09-21T02:31:59.084 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:31:59.084 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/etc/ceph/ceph.conf 2024-09-21T02:31:59.105 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:31:59.105 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:31:59.162 INFO:tasks.cephadm:Adding host smithi090 to orchestrator... 2024-09-21T02:31:59.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch host add smithi090 2024-09-21T02:31:59.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:59 smithi084 ceph-mon[30747]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:31:59.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:31:59.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:31:59.320 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:31:59.320 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:31:59.320 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:59 smithi084 ceph-mon[30747]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T02:31:59.320 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:31:59 smithi084 ceph-mon[30747]: Updating smithi084:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:31:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:00.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:00 smithi084 ceph-mon[30747]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:00.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:00 smithi084 ceph-mon[30747]: Updating smithi084:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:32:00.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:00.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:00.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:01.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:01 smithi084 ceph-mon[30747]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi090", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:02.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:02 smithi084 ceph-mon[30747]: Deploying cephadm binary to smithi090 2024-09-21T02:32:02.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:02 smithi084 ceph-mon[30747]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:03.499 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi090' with addr '172.21.15.90' 2024-09-21T02:32:04.164 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T02:32:04.521 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:04.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:04 smithi084 ceph-mon[30747]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:04.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:04.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:04 smithi084 ceph-mon[30747]: Added host smithi090 2024-09-21T02:32:04.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:04.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:04.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:32:05.334 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.90", "hostname": "smithi090", "labels": [], "status": ""}] 2024-09-21T02:32:05.974 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:05 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:05.974 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:05 smithi084 ceph-mon[30747]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:32:05.974 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:05 smithi084 ceph-mon[30747]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:05.976 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-09-21T02:32:05.976 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:32:05.976 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-09-21T02:32:05.996 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:32:05.996 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:06.055 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-09-21T02:32:06.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch host add smithi172 2024-09-21T02:32:06.411 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi090", "name": "osd_memory_target"} : dispatch 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:09.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:09.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:10.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:09 smithi084 ceph-mon[30747]: Updating smithi090:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:10.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:09 smithi084 ceph-mon[30747]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:10.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:09 smithi084 ceph-mon[30747]: Updating smithi090:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:32:10.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:09 smithi084 ceph-mon[30747]: Deploying cephadm binary to smithi172 2024-09-21T02:32:10.280 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-09-21T02:32:10.911 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:10 smithi084 ceph-mon[30747]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:10.911 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:10.912 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:10.951 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T02:32:11.317 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:11.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:11 smithi084 ceph-mon[30747]: Added host smithi172 2024-09-21T02:32:11.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:11 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:11.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:11 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:12.107 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:32:12.107 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.90", "hostname": "smithi090", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-09-21T02:32:12.743 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:12 smithi084 ceph-mon[30747]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:12.744 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:12.779 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T02:32:12.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T02:32:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:14.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:13 smithi084 ceph-mon[30747]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:32:14.545 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-09-21T02:32:14.975 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:14.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3765863364' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T02:32:14.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:14.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:14.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:14.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:14.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-21T02:32:14.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:14.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:15.286 INFO:tasks.cephadm:Adding mon.a on smithi084 2024-09-21T02:32:15.286 INFO:tasks.cephadm:Adding mon.b on smithi090 2024-09-21T02:32:15.287 INFO:tasks.cephadm:Adding mon.c on smithi172 2024-09-21T02:32:15.287 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi084:172.21.15.84=a;smithi090:172.21.15.90=b;smithi172:172.21.15.172=c' 2024-09-21T02:32:15.522 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:15 smithi084 ceph-mon[30747]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T02:32:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:15 smithi084 ceph-mon[30747]: Updating smithi172:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:15 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3765863364' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T02:32:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:15 smithi084 ceph-mon[30747]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:32:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:16.181 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2024-09-21T02:32:16.823 DEBUG:teuthology.orchestra.run.smithi090:mon.b> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T02:32:16.826 DEBUG:teuthology.orchestra.run.smithi172:mon.c> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T02:32:16.828 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:32:16.828 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: Updating smithi172:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:17.792 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:17 smithi084 ceph-mon[30747]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi090:172.21.15.90=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:17 smithi084 ceph-mon[30747]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi090:172.21.15.90=b;smithi172:172.21.15.172=c;count:3 2024-09-21T02:32:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:17 smithi084 ceph-mon[30747]: Deploying daemon mon.c on smithi172 2024-09-21T02:32:18.708 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:32:18.708 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","modified":"2024-09-21T02:30:35.951032Z","created":"2024-09-21T02:30:35.951032Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T02:32:18.708 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-21T02:32:19.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:18 smithi084 ceph-mon[30747]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:20.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:19 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/1419338805' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:20.368 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:32:20.368 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:32:20.722 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:32:21.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:20 smithi084 ceph-mon[30747]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:21.454 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:32:21.455 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","modified":"2024-09-21T02:30:35.951032Z","created":"2024-09-21T02:30:35.951032Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T02:32:21.455 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2024-09-21T02:32:21.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 podman[35036]: 2024-09-21 02:32:21.571328962 +0000 UTC m=+0.338458732 container start 210a6b4d73123e7d21858d27319a93456859058456224625857cabc4e8b93b25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-c, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T02:32:21.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T02:32:21.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T02:32:21.604 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pidfile_write: ignore empty --pid-file 2024-09-21T02:32:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: load: jerasure load: lrc 2024-09-21T02:32:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: RocksDB version: 7.9.2 2024-09-21T02:32:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Git sha 0 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: DB SUMMARY 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: DB Session ID: GL97DYNB1W1EQXVM3GOM 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: CURRENT file: CURRENT 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.error_if_exists: 0 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.create_if_missing: 0 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.paranoid_checks: 1 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T02:32:22.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.env: 0x55ceddb0bd60 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.info_log: 0x55cee34e7360 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.statistics: (nil) 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.use_fsync: 0 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_log_file_size: 0 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.allow_fallocate: 1 2024-09-21T02:32:22.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.use_direct_reads: 0 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.db_log_dir: 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.wal_dir: 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T02:32:22.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T02:32:22.010 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T02:32:22.010 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.write_buffer_manager: 0x55cee34ebd60 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.unordered_write: 0 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T02:32:22.011 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.row_cache: None 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.wal_filter: None 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.two_write_queues: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.wal_compression: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.atomic_flush: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T02:32:22.012 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.log_readahead_size: 0 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_background_jobs: 2 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_background_compactions: -1 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_subcompactions: 1 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T02:32:22.013 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_open_files: -1 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_background_flushes: -1 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Compression algorithms supported: 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: kZSTD supported: 0 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: kXpressCompression supported: 0 2024-09-21T02:32:22.014 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: kBZip2Compression supported: 0 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: kLZ4Compression supported: 1 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: kZlibCompression supported: 1 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: kSnappyCompression supported: 1 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.merge_operator: 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_filter: None 2024-09-21T02:32:22.015 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cee34e6fa0) 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_type: 0 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_index_type: 0 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_shortening: 1 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: checksum: 4 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: no_block_cache: 0 2024-09-21T02:32:22.016 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache: 0x55cedf4ab610 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_options: 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: capacity : 536870912 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_shard_bits : 4 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: strict_capacity_limit : 0 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_cache_compressed: (nil) 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: persistent_cache: (nil) 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size: 4096 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_size_deviation: 10 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_restart_interval: 16 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: index_block_restart_interval: 1 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: metadata_block_size: 4096 2024-09-21T02:32:22.017 INFO:journalctl@ceph.mon.c.smithi172.stdout: partition_filters: 0 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: use_delta_encoding: 1 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: filter_policy: bloomfilter 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: whole_key_filtering: 1 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: verify_compression: 0 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: format_version: 5 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_index_compression: 1 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: block_align: 0 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: max_auto_readahead_size: 262144 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: prepopulate_block_cache: 0 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: initial_auto_readahead_size: 8192 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T02:32:22.018 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression: NoCompression 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.num_levels: 7 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:32:22.019 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T02:32:22.020 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T02:32:22.021 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T02:32:22.022 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.inplace_update_support: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.bloom_locality: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.max_successive_merges: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.ttl: 2592000 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.enable_blob_files: false 2024-09-21T02:32:22.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.min_blob_size: 0 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 84dcd6bd-c3fc-418d-8786-2de5ab7ffdb9 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885941609085, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885941609516, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726885941, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "84dcd6bd-c3fc-418d-8786-2de5ab7ffdb9", "db_session_id": "GL97DYNB1W1EQXVM3GOM", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T02:32:22.024 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726885941609621, "job": 1, "event": "recovery_finished"} 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cee350aa80 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: DB pointer 0x55cee42b0000 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** DB Stats ** 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-21T02:32:22.025 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-21T02:32:22.026 INFO:journalctl@ceph.mon.c.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache BinnedLRUCache@0x55cedf4ab610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T02:32:22.027 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: starting mon.c rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(???) e0 preinit fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout: e1 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout: btime 2024-09-21T02:30:39:705299+0000 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout: legacy client fscid: -1 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout: 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout: No filesystems configured 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T02:32:22.028 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi090", "name": "osd_memory_target"} : dispatch 2024-09-21T02:32:22.029 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Updating smithi090:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Updating smithi090:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Updating smithi090:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Deploying cephadm binary to smithi172 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Added host smithi172 2024-09-21T02:32:22.030 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3765863364' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T02:32:22.031 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Updating smithi172:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3765863364' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Updating smithi172:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:22.032 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi090:172.21.15.90=b;smithi172:172.21.15.172=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi090:172.21.15.90=b;smithi172:172.21.15.172=c;count:3 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: Deploying daemon mon.c on smithi172 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/1419338805' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/1867250173' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 ceph-mon[35067]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 bash[35036]: 210a6b4d73123e7d21858d27319a93456859058456224625857cabc4e8b93b25 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:21 smithi172 systemd[1]: Started Ceph mon.c for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:32:22.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:21 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/1867250173' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:22.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:21 smithi084 ceph-mon[30747]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:23.509 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:32:23.510 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:32:23.769 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: mon.a calling monitor election 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: mon.c calling monitor election 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: monmap epoch 2 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: last_changed 2024-09-21T02:32:21.639559+0000 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: created 2024-09-21T02:30:35.951032+0000 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: min_mon_release 19 (squid) 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: election_strategy: 1 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: fsmap 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: mgrmap e13: x(active, since 45s) 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: overall HEALTH_OK 2024-09-21T02:32:27.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:27.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:27.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:27.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:27.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: mon.a calling monitor election 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: mon.c calling monitor election 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: monmap epoch 2 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: last_changed 2024-09-21T02:32:21.639559+0000 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: created 2024-09-21T02:30:35.951032+0000 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: min_mon_release 19 (squid) 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: election_strategy: 1 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: fsmap 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: mgrmap e13: x(active, since 45s) 2024-09-21T02:32:27.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: overall HEALTH_OK 2024-09-21T02:32:27.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:27.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:27.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:27.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:27.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:27.464 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:32:27.464 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","modified":"2024-09-21T02:32:21.639559Z","created":"2024-09-21T02:30:35.951032Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T02:32:27.464 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-21T02:32:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:27 smithi172 ceph-mon[35067]: Deploying daemon mon.b on smithi090 2024-09-21T02:32:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:27 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/1983002631' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:27 smithi172 ceph-mon[35067]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:28.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:27 smithi084 ceph-mon[30747]: Deploying daemon mon.b on smithi090 2024-09-21T02:32:28.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:27 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/1983002631' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:28.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:27 smithi084 ceph-mon[30747]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:28.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:28.914 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:32:28 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:32:28.640+0000 7f955b800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T02:32:29.208 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:32:29.208 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:32:29.461 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:32:30.168 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:32:30.168 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":2,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","modified":"2024-09-21T02:32:21.639559Z","created":"2024-09-21T02:30:35.951032Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T02:32:30.169 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 2 2024-09-21T02:32:30.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:30 smithi090 systemd[1]: Started Ceph mon.b for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:32:31.762 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T02:32:31.762 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T02:32:32.014 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:32:35.729 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:32:35.729 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":3,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","modified":"2024-09-21T02:32:30.318265Z","created":"2024-09-21T02:30:35.951032Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:3300","nonce":0},{"type":"v1","addr":"172.21.15.90:6789","nonce":0}]},"addr":"172.21.15.90:6789/0","public_addr":"172.21.15.90:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T02:32:35.729 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 3 2024-09-21T02:32:35.729 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: mon.a calling monitor election 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: mon.c calling monitor election 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: mon.b calling monitor election 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.730 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: monmap epoch 3 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: last_changed 2024-09-21T02:32:30.318265+0000 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: created 2024-09-21T02:30:35.951032+0000 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: min_mon_release 19 (squid) 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: election_strategy: 1 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: fsmap 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: mgrmap e13: x(active, since 53s) 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: overall HEALTH_OK 2024-09-21T02:32:35.731 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.732 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.732 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.732 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:32:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: mon.a calling monitor election 2024-09-21T02:32:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: mon.c calling monitor election 2024-09-21T02:32:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: mon.b calling monitor election 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: monmap epoch 3 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: last_changed 2024-09-21T02:32:30.318265+0000 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: created 2024-09-21T02:30:35.951032+0000 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: min_mon_release 19 (squid) 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: election_strategy: 1 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-21T02:32:35.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-09-21T02:32:35.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: fsmap 2024-09-21T02:32:35.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:32:35.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: mgrmap e13: x(active, since 53s) 2024-09-21T02:32:35.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: overall HEALTH_OK 2024-09-21T02:32:35.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:32:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: mon.a calling monitor election 2024-09-21T02:32:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: mon.c calling monitor election 2024-09-21T02:32:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:32:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: mon.b calling monitor election 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: monmap epoch 3 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: last_changed 2024-09-21T02:32:30.318265+0000 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: created 2024-09-21T02:30:35.951032+0000 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: min_mon_release 19 (squid) 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: election_strategy: 1 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T02:32:35.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: 1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.c 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: 2: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: fsmap 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: mgrmap e13: x(active, since 53s) 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: overall HEALTH_OK 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:35.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:36.334 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T02:32:36.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T02:32:36.609 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:36 smithi172 ceph-mon[35067]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:36 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/3257907662' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:36.610 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:36.700 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:36 smithi084 ceph-mon[30747]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:36 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/3257907662' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:36 smithi090 ceph-mon[34571]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:36 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/3257907662' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T02:32:36.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:32:36.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:36.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.586 INFO:teuthology.orchestra.run.smithi084.stdout:# minimal ceph.conf for 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:37.586 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-09-21T02:32:37.586 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:32:37.586 INFO:teuthology.orchestra.run.smithi084.stdout: mon_host = [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-21T02:32:37.980 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.980 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.980 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: Updating smithi172:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: Updating smithi090:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: Updating smithi084:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3638013333' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:37.981 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:37.982 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:38.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: Updating smithi172:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: Updating smithi090:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: Updating smithi084:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3638013333' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:38.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: Updating smithi090:/etc/ceph/ceph.conf 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T02:32:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: Updating smithi172:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: Updating smithi090:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: Updating smithi084:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3638013333' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:38.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:38.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:38.019 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:38.324 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T02:32:38.324 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:32:38.324 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:32:38.382 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:32:38.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:38.478 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:32:38.478 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:32:38.505 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:32:38.505 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:38.570 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:32:38.570 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T02:32:38.602 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:32:38.602 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T02:32:38.672 INFO:tasks.cephadm:Adding mgr.x on smithi084 2024-09-21T02:32:38.672 INFO:tasks.cephadm:Adding mgr.y on smithi090 2024-09-21T02:32:38.672 INFO:tasks.cephadm:Adding mgr.z on smithi172 2024-09-21T02:32:38.672 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi084=x;smithi090=y;smithi172=z' 2024-09-21T02:32:38.955 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:32:39.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:39 smithi084 ceph-mon[30747]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T02:32:39.427 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:39 smithi084 ceph-mon[30747]: Reconfiguring daemon mon.a on smithi084 2024-09-21T02:32:39.594 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mgr update... 2024-09-21T02:32:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:39 smithi172 ceph-mon[35067]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T02:32:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:39 smithi172 ceph-mon[35067]: Reconfiguring daemon mon.a on smithi084 2024-09-21T02:32:39.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:39 smithi090 ceph-mon[34571]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T02:32:39.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:39 smithi090 ceph-mon[34571]: Reconfiguring daemon mon.a on smithi084 2024-09-21T02:32:40.127 DEBUG:teuthology.orchestra.run.smithi090:mgr.y> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T02:32:40.130 DEBUG:teuthology.orchestra.run.smithi172:mgr.z> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T02:32:40.132 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T02:32:40.133 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T02:32:40.136 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T02:32:40.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T02:32:40.182 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T02:32:40.182 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T02:32:40.226 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T02:32:40.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T02:32:40.270 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T02:32:40.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T02:32:40.317 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T02:32:40.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T02:32:40.363 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T02:32:40.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T02:32:40.409 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T02:32:40.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T02:32:40.457 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T02:32:40.457 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T02:32:40.508 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T02:32:40.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T02:32:40.558 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T02:32:40.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T02:32:40.613 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T02:32:40.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T02:32:40.660 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T02:32:40.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T02:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:40.700 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:40.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:40.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: Reconfiguring daemon mon.b on smithi090 2024-09-21T02:32:40.701 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:40.708 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T02:32:40.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T02:32:40.731 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:40.740 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T02:32:40.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: Reconfiguring daemon mon.b on smithi090 2024-09-21T02:32:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:40.803 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T02:32:40.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T02:32:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:40.823 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T02:32:40.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T02:32:40.876 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T02:32:40.876 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T02:32:40.940 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T02:32:40.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T02:32:41.002 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T02:32:41.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T02:32:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: Reconfiguring mon.b (monmap changed)... 2024-09-21T02:32:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: Reconfiguring daemon mon.b on smithi090 2024-09-21T02:32:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.053 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T02:32:41.053 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T02:32:41.104 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T02:32:41.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T02:32:41.163 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T02:32:41.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T02:32:41.222 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T02:32:41.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T02:32:41.277 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T02:32:41.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T02:32:41.306 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:41.323 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T02:32:41.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T02:32:41.393 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T02:32:41.394 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi084') 2024-09-21T02:32:41.596 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:41 smithi172 ceph-mon[35067]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi084=x;smithi090=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:41.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:41 smithi172 ceph-mon[35067]: Saving service mgr spec with placement smithi084=x;smithi090=y;smithi172=z;count:3 2024-09-21T02:32:41.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:41.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:41.597 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:41.597 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:41 smithi084 ceph-mon[30747]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi084=x;smithi090=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:41.597 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:41 smithi084 ceph-mon[30747]: Saving service mgr spec with placement smithi084=x;smithi090=y;smithi172=z;count:3 2024-09-21T02:32:41.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:41.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:41.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:41 smithi090 ceph-mon[34571]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi084=x;smithi090=y;smithi172=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:32:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:41 smithi090 ceph-mon[34571]: Saving service mgr spec with placement smithi084=x;smithi090=y;smithi172=z;count:3 2024-09-21T02:32:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T02:32:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T02:32:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: Reconfiguring daemon mon.c on smithi172 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:42.711 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.712 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:42.712 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:32:42.712 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:42.712 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:42.712 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:42 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: Reconfiguring daemon mon.c on smithi172 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:42 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:42.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: Reconfiguring mon.c (monmap changed)... 2024-09-21T02:32:42.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: Reconfiguring daemon mon.c on smithi172 2024-09-21T02:32:42.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:42.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:42.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:42.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:42.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:42.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:42.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:32:42.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:42.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:42.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:42 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:43.685 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:43 smithi172 ceph-mon[35067]: Deploying daemon mgr.z on smithi172 2024-09-21T02:32:43.685 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:43 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:43.736 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:43.738 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:43.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:43 smithi090 ceph-mon[34571]: Deploying daemon mgr.z on smithi172 2024-09-21T02:32:43.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:43 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:43.789 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:43 smithi084 ceph-mon[30747]: Deploying daemon mgr.z on smithi172 2024-09-21T02:32:43.789 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:43 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:43.792 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi084') 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 -- 172.21.15.84:0/1272880422 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f88b803fb20 msgr2=0x7f88b8042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 --2- 172.21.15.84:0/1272880422 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f88b803fb20 0x7f88b8042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88c4005d00 tx=0x7f88c400b410 comp rx=0 tx=0).stop 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 -- 172.21.15.84:0/1272880422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88d4104fe0 msgr2=0x7f88d419ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 --2- 172.21.15.84:0/1272880422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88d4104fe0 0x7f88d419ae90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f88cc009fd0 tx=0x7f88cc00ef10 comp rx=0 tx=0).stop 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 -- 172.21.15.84:0/1272880422 shutdown_connections 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 --2- 172.21.15.84:0/1272880422 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f88b803fb20 0x7f88b8042030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 --2- 172.21.15.84:0/1272880422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d4104640 0x7f88d419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 --2- 172.21.15.84:0/1272880422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88d4104fe0 0x7f88d419ae90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:43.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 --2- 172.21.15.84:0/1272880422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88d41035b0 0x7f88d4199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 -- 172.21.15.84:0/1272880422 >> 172.21.15.84:0/1272880422 conn(0x7f88d40fef20 msgr2=0x7f88d4107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 -- 172.21.15.84:0/1272880422 shutdown_connections 2024-09-21T02:32:43.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:43.813+0000 7f88d3e00640 1 -- 172.21.15.84:0/1272880422 wait complete. 2024-09-21T02:32:44.006 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:32:43 smithi172 systemd[1]: Starting Ceph mgr.z for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:32:44.339 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:32:44 smithi172 podman[36320]: 2024-09-21 02:32:43.969054856 +0000 UTC m=+0.015668617 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:44.339 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:32:44 smithi172 podman[36320]: 2024-09-21 02:32:44.099169281 +0000 UTC m=+0.145783027 container create d5bee140c48c2553355b93a33df55caf5821d28a572c04acd55a687128f3bc0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-z, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:32:44.339 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:32:44 smithi172 podman[36320]: 2024-09-21 02:32:44.301501436 +0000 UTC m=+0.348115190 container init d5bee140c48c2553355b93a33df55caf5821d28a572c04acd55a687128f3bc0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-z, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T02:32:44.339 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:32:44 smithi172 podman[36320]: 2024-09-21 02:32:44.304279919 +0000 UTC m=+0.350893676 container start d5bee140c48c2553355b93a33df55caf5821d28a572c04acd55a687128f3bc0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T02:32:44.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:44.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:44.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:44.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:32:44.666 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:44.667 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mgr[36339]: -- 172.21.15.172:0/3376729769 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc403bb0e0 con 0x55cc403d9a80 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:32:44 smithi172 bash[36320]: d5bee140c48c2553355b93a33df55caf5821d28a572c04acd55a687128f3bc0b 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:32:44 smithi172 systemd[1]: Started Ceph mgr.z for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:32:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:44.849 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:44.849 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:44.849 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.849 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.850 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:44.850 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:44.850 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T02:32:44.850 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:44.850 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:45.196 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi084') 2024-09-21T02:32:45.196 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T02:32:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:45.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:45 smithi084 ceph-mon[30747]: Deploying daemon mgr.y on smithi090 2024-09-21T02:32:45.878 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:45 smithi090 ceph-mon[34571]: Deploying daemon mgr.y on smithi090 2024-09-21T02:32:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:45 smithi172 ceph-mon[35067]: Deploying daemon mgr.y on smithi090 2024-09-21T02:32:46.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 -- 172.21.15.84:0/2265329391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30b4105180 msgr2=0x7f30b410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 --2- 172.21.15.84:0/2265329391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30b4105180 0x7f30b410bb20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009ca0 tx=0x7f30ac02a950 comp rx=0 tx=0).stop 2024-09-21T02:32:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 -- 172.21.15.84:0/2265329391 shutdown_connections 2024-09-21T02:32:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 --2- 172.21.15.84:0/2265329391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30b41047e0 0x7f30b4104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 --2- 172.21.15.84:0/2265329391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30b4105180 0x7f30b410bb20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 --2- 172.21.15.84:0/2265329391 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30b4103750 0x7f30b4103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 -- 172.21.15.84:0/2265329391 >> 172.21.15.84:0/2265329391 conn(0x7f30b40ff0e0 msgr2=0x7f30b4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 -- 172.21.15.84:0/2265329391 shutdown_connections 2024-09-21T02:32:46.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.170+0000 7f30bbc00640 1 -- 172.21.15.84:0/2265329391 wait complete. 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.171+0000 7f30bbc00640 1 Processor -- start 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.171+0000 7f30bbc00640 1 -- start start 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.171+0000 7f30bbc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30b4103750 0x7f30b419c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30bbc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30b41047e0 0x7f30b419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30bbc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30b4105180 0x7f30b419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30bbc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f30b410f290 con 0x7f30b41047e0 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30bbc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30b410f110 con 0x7f30b4105180 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30bbc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30b410f410 con 0x7f30b4103750 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30b41047e0 0x7f30b419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30b4103750 0x7f30b419c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30b4103750 0x7f30b419c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54204/0 (socket says 172.21.15.84:54204) 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9200640 1 -- 172.21.15.84:0/3883466871 learned_addr learned my addr 172.21.15.84:0/3883466871 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9c00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30b4105180 0x7f30b419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9200640 1 -- 172.21.15.84:0/3883466871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30b4105180 msgr2=0x7f30b419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9200640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30b4105180 0x7f30b419d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9200640 1 -- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30b41047e0 msgr2=0x7f30b419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9200640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30b41047e0 0x7f30b419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.172+0000 7f30b9200640 1 -- 172.21.15.84:0/3883466871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b419db00 con 0x7f30b4103750 2024-09-21T02:32:46.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.173+0000 7f30b9200640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30b4103750 0x7f30b419c0d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30a400d950 tx=0x7f30a400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:46.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.173+0000 7f30b1600640 1 -- 172.21.15.84:0/3883466871 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4017030 con 0x7f30b4103750 2024-09-21T02:32:46.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.173+0000 7f30b1600640 1 -- 172.21.15.84:0/3883466871 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1073+0+0 (secure 0 0 0) 0x7f30a4004020 con 0x7f30b4103750 2024-09-21T02:32:46.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.173+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b419ddf0 con 0x7f30b4103750 2024-09-21T02:32:46.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.173+0000 7f30b1600640 1 -- 172.21.15.84:0/3883466871 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4005640 con 0x7f30b4103750 2024-09-21T02:32:46.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.173+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b41a44f0 con 0x7f30b4103750 2024-09-21T02:32:46.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.174+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b4103bc0 con 0x7f30b4103750 2024-09-21T02:32:46.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.174+0000 7f30b1600640 1 -- 172.21.15.84:0/3883466871 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f30a4009a30 con 0x7f30b4103750 2024-09-21T02:32:46.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.175+0000 7f30b1600640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f309803fcc0 0x7f30980421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.175+0000 7f30b1600640 1 -- 172.21.15.84:0/3883466871 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f30a4053f40 con 0x7f30b4103750 2024-09-21T02:32:46.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.175+0000 7f30b3e00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f309803fcc0 0x7f30980421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.176+0000 7f30b3e00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f309803fcc0 0x7f30980421d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009b50 tx=0x7f30a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:46.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.180+0000 7f30b1600640 1 -- 172.21.15.84:0/3883466871 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30a40537b0 con 0x7f30b4103750 2024-09-21T02:32:46.266 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:32:46 smithi090 systemd[1]: Starting Ceph mgr.y for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:32:46.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.389+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f30b41a4720 con 0x7f30b4103750 2024-09-21T02:32:46.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.395+0000 7f30b1600640 1 -- 172.21.15.84:0/3883466871 <== mon.1 v2:172.21.15.172:3300/0 7 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f30a401ab00 con 0x7f30b4103750 2024-09-21T02:32:46.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.395+0000 7f30b1600640 1 -- 172.21.15.84:0/3883466871 <== mon.1 v2:172.21.15.172:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f30a4009d20 con 0x7f30b4103750 2024-09-21T02:32:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f309803fcc0 msgr2=0x7f30980421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f309803fcc0 0x7f30980421d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009b50 tx=0x7f30a0005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30b4103750 msgr2=0x7f30b419c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30b4103750 0x7f30b419c0d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30a400d950 tx=0x7f30a400de10 comp rx=0 tx=0).stop 2024-09-21T02:32:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 shutdown_connections 2024-09-21T02:32:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30b4105180 0x7f30b419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30b41047e0 0x7f30b419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f309803fcc0 0x7f30980421d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 --2- 172.21.15.84:0/3883466871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30b4103750 0x7f30b419c0d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.397+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 >> 172.21.15.84:0/3883466871 conn(0x7f30b40ff0e0 msgr2=0x7f30b40755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:46.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.398+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 shutdown_connections 2024-09-21T02:32:46.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.398+0000 7f30bbc00640 1 -- 172.21.15.84:0/3883466871 wait complete. 2024-09-21T02:32:46.596 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:46 smithi090 ceph-mon[34571]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:46.596 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:46 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:46.596 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:32:46 smithi090 podman[35371]: 2024-09-21 02:32:46.300479465 +0000 UTC m=+0.110180025 container create f1184dc398dbe42b0cdae8ef87f9a0505b6279223e5c1ae709b28408c2f4fa4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T02:32:46.597 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:32:46 smithi090 podman[35371]: 2024-09-21 02:32:46.205942613 +0000 UTC m=+0.015643172 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:32:46.597 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:32:46 smithi090 podman[35371]: 2024-09-21 02:32:46.503015166 +0000 UTC m=+0.312715722 container init f1184dc398dbe42b0cdae8ef87f9a0505b6279223e5c1ae709b28408c2f4fa4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T02:32:46.597 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:32:46 smithi090 podman[35371]: 2024-09-21 02:32:46.505749166 +0000 UTC m=+0.315449721 container start f1184dc398dbe42b0cdae8ef87f9a0505b6279223e5c1ae709b28408c2f4fa4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T02:32:46.597 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:32:46 smithi090 ceph-mgr[35390]: -- 172.21.15.90:0/2278940595 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c446a4d0e0 con 0x55c44b7f0480 2024-09-21T02:32:46.597 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:32:46 smithi090 bash[35371]: f1184dc398dbe42b0cdae8ef87f9a0505b6279223e5c1ae709b28408c2f4fa4f 2024-09-21T02:32:46.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:46 smithi084 ceph-mon[30747]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:46.640 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:46 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 -- 172.21.15.84:0/2459675425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104fa0 msgr2=0x7f47c010b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 --2- 172.21.15.84:0/2459675425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104fa0 0x7f47c010b940 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009be0 tx=0x7f47b802a750 comp rx=0 tx=0).stop 2024-09-21T02:32:46.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 -- 172.21.15.84:0/2459675425 shutdown_connections 2024-09-21T02:32:46.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 --2- 172.21.15.84:0/2459675425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0104600 0x7f47c0104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 --2- 172.21.15.84:0/2459675425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104fa0 0x7f47c010b940 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 --2- 172.21.15.84:0/2459675425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47c0103570 0x7f47c01039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 -- 172.21.15.84:0/2459675425 >> 172.21.15.84:0/2459675425 conn(0x7f47c00feec0 msgr2=0x7f47c0101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:46.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 -- 172.21.15.84:0/2459675425 shutdown_connections 2024-09-21T02:32:46.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.751+0000 7f47c6e00640 1 -- 172.21.15.84:0/2459675425 wait complete. 2024-09-21T02:32:46.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.752+0000 7f47c6e00640 1 Processor -- start 2024-09-21T02:32:46.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.752+0000 7f47c6e00640 1 -- start start 2024-09-21T02:32:46.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c6e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47c0103570 0x7f47c0076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c6e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104600 0x7f47c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c6e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0104fa0 0x7f47c0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c6e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f47c010f1d0 con 0x7f47c0104600 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c6e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47c010f050 con 0x7f47c0103570 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c6e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47c010f350 con 0x7f47c0104fa0 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47c0103570 0x7f47c0076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c5a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47c0103570 0x7f47c0076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56788/0 (socket says 172.21.15.84:56788) 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104600 0x7f47c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c5a00640 1 -- 172.21.15.84:0/1435056934 learned_addr learned my addr 172.21.15.84:0/1435056934 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.753+0000 7f47c6400640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0104fa0 0x7f47c0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47c5000640 1 -- 172.21.15.84:0/1435056934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0104fa0 msgr2=0x7f47c0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47c5000640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0104fa0 0x7f47c0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47c5000640 1 -- 172.21.15.84:0/1435056934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47c0103570 msgr2=0x7f47c0076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47c5000640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47c0103570 0x7f47c0076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47c5000640 1 -- 172.21.15.84:0/1435056934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c0076350 con 0x7f47c0104600 2024-09-21T02:32:46.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47c5000640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104600 0x7f47c0075710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e9f0 tx=0x7f47ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47be000640 1 -- 172.21.15.84:0/1435056934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00ccc0 con 0x7f47c0104600 2024-09-21T02:32:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47be000640 1 -- 172.21.15.84:0/1435056934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f47ac005020 con 0x7f47c0104600 2024-09-21T02:32:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.754+0000 7f47be000640 1 -- 172.21.15.84:0/1435056934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac004a00 con 0x7f47c0104600 2024-09-21T02:32:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.755+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c01a3e30 con 0x7f47c0104600 2024-09-21T02:32:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.755+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c01a41d0 con 0x7f47c0104600 2024-09-21T02:32:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.756+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c010a750 con 0x7f47c0104600 2024-09-21T02:32:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.756+0000 7f47be000640 1 -- 172.21.15.84:0/1435056934 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f47ac004ba0 con 0x7f47c0104600 2024-09-21T02:32:46.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.757+0000 7f47be000640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47a803fb20 0x7f47a8042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.757+0000 7f47c5a00640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47a803fb20 0x7f47a8042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.758+0000 7f47c5a00640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47a803fb20 0x7f47a8042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005c80 tx=0x7f47b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:46.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.759+0000 7f47be000640 1 -- 172.21.15.84:0/1435056934 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f47ac01fdd0 con 0x7f47c0104600 2024-09-21T02:32:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.764+0000 7f47be000640 1 -- 172.21.15.84:0/1435056934 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47ac00f3c0 con 0x7f47c0104600 2024-09-21T02:32:46.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.639+0000 7fa3ede00640 1 -- 172.21.15.84:0/3414140115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e81047f0 msgr2=0x7fa3e8104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.639+0000 7fa3ede00640 1 --2- 172.21.15.84:0/3414140115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e81047f0 0x7fa3e8104c00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009900 tx=0x7fa3d402a480 comp rx=0 tx=0).stop 2024-09-21T02:32:46.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.639+0000 7fa3ede00640 1 -- 172.21.15.84:0/3414140115 shutdown_connections 2024-09-21T02:32:46.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.639+0000 7fa3ede00640 1 --2- 172.21.15.84:0/3414140115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e8105190 0x7fa3e810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.639+0000 7fa3ede00640 1 --2- 172.21.15.84:0/3414140115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e81047f0 0x7fa3e8104c00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.639+0000 7fa3ede00640 1 --2- 172.21.15.84:0/3414140115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e8103760 0x7fa3e8103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.639+0000 7fa3ede00640 1 -- 172.21.15.84:0/3414140115 >> 172.21.15.84:0/3414140115 conn(0x7fa3e80ff0b0 msgr2=0x7fa3e8101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.639+0000 7fa3ede00640 1 -- 172.21.15.84:0/3414140115 shutdown_connections 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.641+0000 7fa3ede00640 1 -- 172.21.15.84:0/3414140115 wait complete. 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.641+0000 7fa3ede00640 1 Processor -- start 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3ede00640 1 -- start start 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e8103760 0x7fa3e819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e81047f0 0x7fa3e819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3ede00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e8105190 0x7fa3e819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3ede00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e810f410 con 0x7fa3e8105190 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3ede00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e810f290 con 0x7fa3e8103760 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3ede00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e810f590 con 0x7fa3e81047f0 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3e6000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e81047f0 0x7fa3e819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3e6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e8103760 0x7fa3e819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3e6000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e81047f0 0x7fa3e819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54232/0 (socket says 172.21.15.84:54232) 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3e7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e8105190 0x7fa3e819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3e6000640 1 -- 172.21.15.84:0/696483801 learned_addr learned my addr 172.21.15.84:0/696483801 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.642+0000 7fa3e6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e8103760 0x7fa3e819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56772/0 (socket says 172.21.15.84:56772) 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.643+0000 7fa3e6000640 1 -- 172.21.15.84:0/696483801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e8103760 msgr2=0x7fa3e819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.643+0000 7fa3e6000640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e8103760 0x7fa3e819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.643+0000 7fa3e6000640 1 -- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e8105190 msgr2=0x7fa3e819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.643+0000 7fa3e6000640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e8105190 0x7fa3e819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.643+0000 7fa3e6000640 1 -- 172.21.15.84:0/696483801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e819b9e0 con 0x7fa3e81047f0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.643+0000 7fa3e6000640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e81047f0 0x7fa3e819a690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005ab0 tx=0x7fa3d4004f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.643+0000 7fa3eca00640 1 -- 172.21.15.84:0/696483801 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d403f070 con 0x7fa3e81047f0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.644+0000 7fa3eca00640 1 -- 172.21.15.84:0/696483801 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fa3d4005430 con 0x7fa3e81047f0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.644+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e819bc70 con 0x7fa3e81047f0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.644+0000 7fa3eca00640 1 -- 172.21.15.84:0/696483801 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4035030 con 0x7fa3e81047f0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.644+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e81a23d0 con 0x7fa3e81047f0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.645+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e8103bd0 con 0x7fa3e81047f0 2024-09-21T02:32:46.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.645+0000 7fa3eca00640 1 -- 172.21.15.84:0/696483801 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7fa3d4042070 con 0x7fa3e81047f0 2024-09-21T02:32:46.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.646+0000 7fa3eca00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3cc03fb20 0x7fa3cc042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:46.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.646+0000 7fa3eca00640 1 -- 172.21.15.84:0/696483801 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa3d4074dc0 con 0x7fa3e81047f0 2024-09-21T02:32:46.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.646+0000 7fa3e6a00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3cc03fb20 0x7fa3cc042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:46.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.647+0000 7fa3e6a00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3cc03fb20 0x7fa3cc042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009bd0 tx=0x7fa3d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:46.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.651+0000 7fa3eca00640 1 -- 172.21.15.84:0/696483801 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3d4039df0 con 0x7fa3e81047f0 2024-09-21T02:32:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:46.809 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:46.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.905+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fa3e8063fc0 con 0x7fa3e81047f0 2024-09-21T02:32:46.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.911+0000 7fa3eca00640 1 -- 172.21.15.84:0/696483801 <== mon.1 v2:172.21.15.172:3300/0 7 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3d4003cc0 con 0x7fa3e81047f0 2024-09-21T02:32:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.911+0000 7fa3eca00640 1 -- 172.21.15.84:0/696483801 <== mon.1 v2:172.21.15.172:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fa3d404c350 con 0x7fa3e81047f0 2024-09-21T02:32:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.913+0000 7f47be000640 1 -- 172.21.15.84:0/1435056934 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47ac01e300 con 0x7f47c0104600 2024-09-21T02:32:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.914+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3cc03fb20 msgr2=0x7fa3cc042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.914+0000 7fa3ede00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3cc03fb20 0x7fa3cc042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009bd0 tx=0x7fa3d8005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.914+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e81047f0 msgr2=0x7fa3e819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.914+0000 7fa3ede00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e81047f0 0x7fa3e819a690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005ab0 tx=0x7fa3d4004f70 comp rx=0 tx=0).stop 2024-09-21T02:32:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.915+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 shutdown_connections 2024-09-21T02:32:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.915+0000 7fa3ede00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3cc03fb20 0x7fa3cc042030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.915+0000 7fa3ede00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3e81047f0 0x7fa3e819a690 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.915+0000 7fa3ede00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3e8105190 0x7fa3e819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.915+0000 7fa3ede00640 1 --2- 172.21.15.84:0/696483801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3e8103760 0x7fa3e819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.915+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 >> 172.21.15.84:0/696483801 conn(0x7fa3e80ff0b0 msgr2=0x7fa3e8107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.915+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 shutdown_connections 2024-09-21T02:32:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.915+0000 7fa3ede00640 1 -- 172.21.15.84:0/696483801 wait complete. 2024-09-21T02:32:46.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.984+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f47c0063fc0 con 0x7f47c0104600 2024-09-21T02:32:46.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.988+0000 7f47be000640 1 -- 172.21.15.84:0/1435056934 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f47ac0051d0 con 0x7f47c0104600 2024-09-21T02:32:46.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47a803fb20 msgr2=0x7f47a8042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47a803fb20 0x7f47a8042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005c80 tx=0x7f47b4009260 comp rx=0 tx=0).stop 2024-09-21T02:32:46.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104600 msgr2=0x7f47c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104600 0x7f47c0075710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e9f0 tx=0x7f47ac00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 shutdown_connections 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47a803fb20 0x7f47a8042030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47c0104fa0 0x7f47c0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47c0104600 0x7f47c0075710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 --2- 172.21.15.84:0/1435056934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47c0103570 0x7f47c0076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 >> 172.21.15.84:0/1435056934 conn(0x7f47c00feec0 msgr2=0x7f47c0107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 shutdown_connections 2024-09-21T02:32:46.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:46.991+0000 7f47c6e00640 1 -- 172.21.15.84:0/1435056934 wait complete. 2024-09-21T02:32:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:46 smithi172 ceph-mon[35067]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:46 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:47.016 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:32:46 smithi090 systemd[1]: Started Ceph mgr.y for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:32:47.237 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.237 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.238 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.484 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.490 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.493 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.501 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.599 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.828 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.830 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.832 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.834 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.836 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1435056934' entity='client.admin' 2024-09-21T02:32:47.860 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:47 smithi084 ceph-mon[30747]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1435056934' entity='client.admin' 2024-09-21T02:32:48.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:47 smithi172 ceph-mon[35067]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:48.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1435056934' entity='client.admin' 2024-09-21T02:32:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:47 smithi090 ceph-mon[34571]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 -- 172.21.15.84:0/589378143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74103570 msgr2=0x7fbd741039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 --2- 172.21.15.84:0/589378143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74103570 0x7fbd741039e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009900 tx=0x7fbd6402a480 comp rx=0 tx=0).stop 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 -- 172.21.15.84:0/589378143 shutdown_connections 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 --2- 172.21.15.84:0/589378143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd74104fa0 0x7fbd7410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 --2- 172.21.15.84:0/589378143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd74104600 0x7fbd74104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 --2- 172.21.15.84:0/589378143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74103570 0x7fbd741039e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 -- 172.21.15.84:0/589378143 >> 172.21.15.84:0/589378143 conn(0x7fbd740feec0 msgr2=0x7fbd74101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 -- 172.21.15.84:0/589378143 shutdown_connections 2024-09-21T02:32:48.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.415+0000 7fbd73e00640 1 -- 172.21.15.84:0/589378143 wait complete. 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.417+0000 7fbd73e00640 1 Processor -- start 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.417+0000 7fbd73e00640 1 -- start start 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd73e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd74103570 0x7fbd7419c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd73e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74104600 0x7fbd7419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd73e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd74104fa0 0x7fbd7419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd73e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7410f340 con 0x7fbd74104fa0 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd73e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7410f1c0 con 0x7fbd74103570 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd73e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7410f4c0 con 0x7fbd74104600 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd72a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd74103570 0x7fbd7419c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd72a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd74103570 0x7fbd7419c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56798/0 (socket says 172.21.15.84:56798) 2024-09-21T02:32:48.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd72a00640 1 -- 172.21.15.84:0/268467079 learned_addr learned my addr 172.21.15.84:0/268467079 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd6be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74104600 0x7fbd7419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd73400640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd74104fa0 0x7fbd7419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd6be00640 1 -- 172.21.15.84:0/268467079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd74103570 msgr2=0x7fbd7419c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd6be00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd74103570 0x7fbd7419c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd6be00640 1 -- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd74104fa0 msgr2=0x7fbd7419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd6be00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd74104fa0 0x7fbd7419d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd6be00640 1 -- 172.21.15.84:0/268467079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7419db00 con 0x7fbd74104600 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.418+0000 7fbd73400640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd74104fa0 0x7fbd7419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.419+0000 7fbd6be00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74104600 0x7fbd7419c740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e9f0 tx=0x7fbd5c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.419+0000 7fbd78a00640 1 -- 172.21.15.84:0/268467079 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00cd80 con 0x7fbd74104600 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.419+0000 7fbd78a00640 1 -- 172.21.15.84:0/268467079 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd5c0035f0 con 0x7fbd74104600 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.419+0000 7fbd78a00640 1 -- 172.21.15.84:0/268467079 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c010690 con 0x7fbd74104600 2024-09-21T02:32:48.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.419+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7419ddf0 con 0x7fbd74104600 2024-09-21T02:32:48.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.421+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd74105ae0 con 0x7fbd74104600 2024-09-21T02:32:48.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.422+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd7419e050 con 0x7fbd74104600 2024-09-21T02:32:48.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.423+0000 7fbd78a00640 1 -- 172.21.15.84:0/268467079 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7fbd5c0037a0 con 0x7fbd74104600 2024-09-21T02:32:48.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.424+0000 7fbd78a00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbd5803fb20 0x7fbd58042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:48.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.424+0000 7fbd78a00640 1 -- 172.21.15.84:0/268467079 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbd5c054800 con 0x7fbd74104600 2024-09-21T02:32:48.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.424+0000 7fbd72a00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbd5803fb20 0x7fbd58042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:48.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.425+0000 7fbd72a00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbd5803fb20 0x7fbd58042030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd64031570 tx=0x7fbd64031470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:48.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.428+0000 7fbd78a00640 1 -- 172.21.15.84:0/268467079 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd5c016590 con 0x7fbd74104600 2024-09-21T02:32:48.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.627+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fbd74106420 con 0x7fbd74104600 2024-09-21T02:32:48.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.635+0000 7fbd78a00640 1 -- 172.21.15.84:0/268467079 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v17)=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fbd5c016330 con 0x7fbd74104600 2024-09-21T02:32:48.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbd5803fb20 msgr2=0x7fbd58042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbd5803fb20 0x7fbd58042030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd64031570 tx=0x7fbd64031470 comp rx=0 tx=0).stop 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74104600 msgr2=0x7fbd7419c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74104600 0x7fbd7419c740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e9f0 tx=0x7fbd5c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 shutdown_connections 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbd5803fb20 0x7fbd58042030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd74104600 0x7fbd7419c740 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd74104fa0 0x7fbd7419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 --2- 172.21.15.84:0/268467079 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd74103570 0x7fbd7419c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 >> 172.21.15.84:0/268467079 conn(0x7fbd740feec0 msgr2=0x7fbd740755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 shutdown_connections 2024-09-21T02:32:48.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.637+0000 7fbd73e00640 1 -- 172.21.15.84:0/268467079 wait complete. 2024-09-21T02:32:48.978 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:48 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.978 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:48 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.978 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:48 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.979 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:48 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:48.979 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:48 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:48.979 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:48 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:49.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:48 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:49.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:48 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:48 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:48 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:48 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:48 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:48 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:48 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:48 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:48 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:49.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:48 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:49.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:48 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 -- 172.21.15.84:0/435779292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018104fa0 msgr2=0x7f001810b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 --2- 172.21.15.84:0/435779292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018104fa0 0x7f001810b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0010009ca0 tx=0x7f001002a950 comp rx=0 tx=0).stop 2024-09-21T02:32:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 -- 172.21.15.84:0/435779292 shutdown_connections 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 --2- 172.21.15.84:0/435779292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018104fa0 0x7f001810b940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 --2- 172.21.15.84:0/435779292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0018104600 0x7f0018104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 --2- 172.21.15.84:0/435779292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0018103570 0x7f00181039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 -- 172.21.15.84:0/435779292 >> 172.21.15.84:0/435779292 conn(0x7f00180feec0 msgr2=0x7f0018101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 -- 172.21.15.84:0/435779292 shutdown_connections 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.336+0000 7f001d000640 1 -- 172.21.15.84:0/435779292 wait complete. 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f001d000640 1 Processor -- start 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f001d000640 1 -- start start 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f001d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018103570 0x7f001819c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f001d000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0018104600 0x7f001819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f001d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0018104fa0 0x7f001819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f001d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f001810f340 con 0x7f0018104fa0 2024-09-21T02:32:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f001d000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f001810f1c0 con 0x7f0018103570 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f001d000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f001810f4c0 con 0x7f0018104600 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.337+0000 7f0017400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018103570 0x7f001819c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0018104fa0 0x7f001819d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0016a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0018104600 0x7f001819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018103570 0x7f001819c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56794/0 (socket says 172.21.15.84:56794) 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017400640 1 -- 172.21.15.84:0/1726472779 learned_addr learned my addr 172.21.15.84:0/1726472779 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017400640 1 -- 172.21.15.84:0/1726472779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0018104600 msgr2=0x7f001819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017400640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0018104600 0x7f001819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017400640 1 -- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0018104fa0 msgr2=0x7f001819d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017400640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0018104fa0 0x7f001819d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017400640 1 -- 172.21.15.84:0/1726472779 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001819da70 con 0x7f0018103570 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f0017400640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018103570 0x7f001819c040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f000800e9f0 tx=0x7f000800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f000fe00640 1 -- 172.21.15.84:0/1726472779 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000800cd80 con 0x7f0018103570 2024-09-21T02:32:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f000fe00640 1 -- 172.21.15.84:0/1726472779 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0008010900 con 0x7f0018103570 2024-09-21T02:32:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.338+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001819dd60 con 0x7f0018103570 2024-09-21T02:32:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.339+0000 7f000fe00640 1 -- 172.21.15.84:0/1726472779 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008018920 con 0x7f0018103570 2024-09-21T02:32:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.339+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00181a4460 con 0x7f0018103570 2024-09-21T02:32:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.340+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00181a4630 con 0x7f0018103570 2024-09-21T02:32:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.340+0000 7f000fe00640 1 -- 172.21.15.84:0/1726472779 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f0008018b00 con 0x7f0018103570 2024-09-21T02:32:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.340+0000 7f000fe00640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efffc03fb20 0x7efffc042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.340+0000 7f000fe00640 1 -- 172.21.15.84:0/1726472779 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0008054a20 con 0x7f0018103570 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.341+0000 7f0016a00640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efffc03fb20 0x7efffc042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.341+0000 7f0016a00640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efffc03fb20 0x7efffc042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0004009bd0 tx=0x7f0004005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.346+0000 7f000fe00640 1 -- 172.21.15.84:0/1726472779 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f000801d210 con 0x7f0018103570 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.548+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f00181a4800 con 0x7f0018103570 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.554+0000 7f000fe00640 1 -- 172.21.15.84:0/1726472779 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7f00080450b0 con 0x7f0018103570 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efffc03fb20 msgr2=0x7efffc042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efffc03fb20 0x7efffc042030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0004009bd0 tx=0x7f0004005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018103570 msgr2=0x7f001819c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018103570 0x7f001819c040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f000800e9f0 tx=0x7f000800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 shutdown_connections 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efffc03fb20 0x7efffc042030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0018104600 0x7f001819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0018104fa0 0x7f001819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 --2- 172.21.15.84:0/1726472779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0018103570 0x7f001819c040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 >> 172.21.15.84:0/1726472779 conn(0x7f00180feec0 msgr2=0x7f00180755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 shutdown_connections 2024-09-21T02:32:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.556+0000 7f001d000640 1 -- 172.21.15.84:0/1726472779 wait complete. 2024-09-21T02:32:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.174+0000 7f46dfe00640 1 -- 172.21.15.84:0/4099875284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 msgr2=0x7f46e0104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.174+0000 7f46dfe00640 1 --2- 172.21.15.84:0/4099875284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 0x7f46e0104a10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009900 tx=0x7f46c802a480 comp rx=0 tx=0).stop 2024-09-21T02:32:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.175+0000 7f46dfe00640 1 -- 172.21.15.84:0/4099875284 shutdown_connections 2024-09-21T02:32:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.175+0000 7f46dfe00640 1 --2- 172.21.15.84:0/4099875284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 0x7f46e0104a10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.175+0000 7f46dfe00640 1 --2- 172.21.15.84:0/4099875284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e0104fa0 0x7f46e010b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.175+0000 7f46dfe00640 1 --2- 172.21.15.84:0/4099875284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0103570 0x7f46e01039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.175+0000 7f46dfe00640 1 -- 172.21.15.84:0/4099875284 >> 172.21.15.84:0/4099875284 conn(0x7f46e00feec0 msgr2=0x7f46e0101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.175+0000 7f46dfe00640 1 -- 172.21.15.84:0/4099875284 shutdown_connections 2024-09-21T02:32:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.175+0000 7f46dfe00640 1 -- 172.21.15.84:0/4099875284 wait complete. 2024-09-21T02:32:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dfe00640 1 Processor -- start 2024-09-21T02:32:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dfe00640 1 -- start start 2024-09-21T02:32:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e0103570 0x7f46e019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dfe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 0x7f46e019c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dfe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0104fa0 0x7f46e019d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dfe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f46e010f2f0 con 0x7f46e0103570 2024-09-21T02:32:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dfe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f46e010f170 con 0x7f46e0104fa0 2024-09-21T02:32:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dfe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46e010f470 con 0x7f46e0104600 2024-09-21T02:32:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46d6000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 0x7f46e019c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46dea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e0103570 0x7f46e019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46df400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0104fa0 0x7f46e019d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46d6000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 0x7f46e019c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54310/0 (socket says 172.21.15.84:54310) 2024-09-21T02:32:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.176+0000 7f46d6000640 1 -- 172.21.15.84:0/3944043141 learned_addr learned my addr 172.21.15.84:0/3944043141 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46df400640 1 -- 172.21.15.84:0/3944043141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 msgr2=0x7f46e019c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46df400640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 0x7f46e019c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46df400640 1 -- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e0103570 msgr2=0x7f46e019c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46df400640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e0103570 0x7f46e019c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46df400640 1 -- 172.21.15.84:0/3944043141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e019db00 con 0x7f46e0104fa0 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46df400640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0104fa0 0x7f46e019d2e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46d800e970 tx=0x7f46d800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46d7e00640 1 -- 172.21.15.84:0/3944043141 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d800ccc0 con 0x7f46e0104fa0 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46d7e00640 1 -- 172.21.15.84:0/3944043141 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f46d8005020 con 0x7f46e0104fa0 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.177+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e019ddf0 con 0x7f46e0104fa0 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.178+0000 7f46d7e00640 1 -- 172.21.15.84:0/3944043141 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8004a00 con 0x7f46e0104fa0 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.178+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e01a44f0 con 0x7f46e0104fa0 2024-09-21T02:32:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.179+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e01a46c0 con 0x7f46e0104fa0 2024-09-21T02:32:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.180+0000 7f46d7e00640 1 -- 172.21.15.84:0/3944043141 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f46d8004ba0 con 0x7f46e0104fa0 2024-09-21T02:32:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.181+0000 7f46d7e00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c407afd0 0x7f46c407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.181+0000 7f46d7e00640 1 -- 172.21.15.84:0/3944043141 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f46d809ccb0 con 0x7f46e0104fa0 2024-09-21T02:32:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.181+0000 7f46dea00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c407afd0 0x7f46c407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.181+0000 7f46dea00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c407afd0 0x7f46c407d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f46d0005fd0 tx=0x7f46d0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.185+0000 7f46d7e00640 1 -- 172.21.15.84:0/3944043141 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46d80696f0 con 0x7f46e0104fa0 2024-09-21T02:32:50.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:50.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: Standby manager daemon z started 2024-09-21T02:32:50.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:32:50.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:32:50.255 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:32:50.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:32:50.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:50.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:50.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:50.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:50.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:50.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:50.256 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 -- 172.21.15.84:0/4256225319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc106820 msgr2=0x7f82bc106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4256225319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc106820 0x7f82bc106c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009900 tx=0x7f82a802a490 comp rx=0 tx=0).stop 2024-09-21T02:32:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 -- 172.21.15.84:0/4256225319 shutdown_connections 2024-09-21T02:32:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4256225319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82bc1071c0 0x7f82bc10db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4256225319 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc106820 0x7f82bc106c30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4256225319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82bc105790 0x7f82bc105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 -- 172.21.15.84:0/4256225319 >> 172.21.15.84:0/4256225319 conn(0x7f82bc101100 msgr2=0x7f82bc1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:50.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 -- 172.21.15.84:0/4256225319 shutdown_connections 2024-09-21T02:32:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.848+0000 7f82c2a00640 1 -- 172.21.15.84:0/4256225319 wait complete. 2024-09-21T02:32:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.849+0000 7f82c2a00640 1 Processor -- start 2024-09-21T02:32:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c2a00640 1 -- start start 2024-09-21T02:32:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc105790 0x7f82bc19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82bc106820 0x7f82bc19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82bc1071c0 0x7f82bc19d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c2a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc111560 con 0x7f82bc106820 2024-09-21T02:32:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1113e0 con 0x7f82bc105790 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c2a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1116e0 con 0x7f82bc1071c0 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c1600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc105790 0x7f82bc19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c1600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc105790 0x7f82bc19c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56820/0 (socket says 172.21.15.84:56820) 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c1600640 1 -- 172.21.15.84:0/4029301518 learned_addr learned my addr 172.21.15.84:0/4029301518 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c2000640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82bc1071c0 0x7f82bc19d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.850+0000 7f82c0c00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82bc106820 0x7f82bc19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c1600640 1 -- 172.21.15.84:0/4029301518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82bc1071c0 msgr2=0x7f82bc19d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c1600640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82bc1071c0 0x7f82bc19d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c1600640 1 -- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82bc106820 msgr2=0x7f82bc19c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c1600640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82bc106820 0x7f82bc19c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c1600640 1 -- 172.21.15.84:0/4029301518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc19db00 con 0x7f82bc105790 2024-09-21T02:32:50.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c2000640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82bc1071c0 0x7f82bc19d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c1600640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc105790 0x7f82bc19c0d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f82b000e9f0 tx=0x7f82b000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82ba000640 1 -- 172.21.15.84:0/4029301518 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b000cd80 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82ba000640 1 -- 172.21.15.84:0/4029301518 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f82b0010900 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc19ddf0 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82ba000640 1 -- 172.21.15.84:0/4029301518 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0018920 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.851+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc1a44f0 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.852+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82bc10c970 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.852+0000 7f82ba000640 1 -- 172.21.15.84:0/4029301518 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f82b0010430 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.853+0000 7f82ba000640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f82a403fb20 0x7f82a4042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.853+0000 7f82ba000640 1 -- 172.21.15.84:0/4029301518 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f82b0054a30 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.853+0000 7f82c0c00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f82a403fb20 0x7f82a4042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.854+0000 7f82c0c00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f82a403fb20 0x7f82a4042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82a8004770 tx=0x7f82a8031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:48.858+0000 7f82ba000640 1 -- 172.21.15.84:0/4029301518 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82b0010720 con 0x7f82bc105790 2024-09-21T02:32:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.049+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f82bc02e640 con 0x7f82bc105790 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.056+0000 7f82ba000640 1 -- 172.21.15.84:0/4029301518 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f82b0010ab0 con 0x7f82bc105790 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.058+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f82a403fb20 msgr2=0x7f82a4042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.058+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f82a403fb20 0x7f82a4042030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82a8004770 tx=0x7f82a8031510 comp rx=0 tx=0).stop 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.058+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc105790 msgr2=0x7f82bc19c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.058+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc105790 0x7f82bc19c0d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f82b000e9f0 tx=0x7f82b000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.059+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 shutdown_connections 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.059+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f82a403fb20 0x7f82a4042030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.059+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82bc1071c0 0x7f82bc19d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.059+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82bc106820 0x7f82bc19c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.059+0000 7f82c2a00640 1 --2- 172.21.15.84:0/4029301518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc105790 0x7f82bc19c0d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.059+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 >> 172.21.15.84:0/4029301518 conn(0x7f82bc101100 msgr2=0x7f82bc109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:50.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.059+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 shutdown_connections 2024-09-21T02:32:50.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:49.059+0000 7f82c2a00640 1 -- 172.21.15.84:0/4029301518 wait complete. 2024-09-21T02:32:50.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.388+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f46e01a4ce0 con 0x7f46e0104fa0 2024-09-21T02:32:50.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.396+0000 7f46d7e00640 1 -- 172.21.15.84:0/3944043141 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v19)=0 v19) ==== 127+0+0 (secure 0 0 0) 0x7f46d806e5a0 con 0x7f46e0104fa0 2024-09-21T02:32:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.398+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c407afd0 msgr2=0x7f46c407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.398+0000 7f46dfe00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c407afd0 0x7f46c407d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f46d0005fd0 tx=0x7f46d0009500 comp rx=0 tx=0).stop 2024-09-21T02:32:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.398+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0104fa0 msgr2=0x7f46e019d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.398+0000 7f46dfe00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0104fa0 0x7f46e019d2e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46d800e970 tx=0x7f46d800ee30 comp rx=0 tx=0).stop 2024-09-21T02:32:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.399+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 shutdown_connections 2024-09-21T02:32:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.399+0000 7f46dfe00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c407afd0 0x7f46c407d4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.399+0000 7f46dfe00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46e0104600 0x7f46e019c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.399+0000 7f46dfe00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46e0104fa0 0x7f46e019d2e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.399+0000 7f46dfe00640 1 --2- 172.21.15.84:0/3944043141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46e0103570 0x7f46e019c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.399+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 >> 172.21.15.84:0/3944043141 conn(0x7f46e00feec0 msgr2=0x7f46e00755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.399+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 shutdown_connections 2024-09-21T02:32:50.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:50.399+0000 7f46dfe00640 1 -- 172.21.15.84:0/3944043141 wait complete. 2024-09-21T02:32:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: Standby manager daemon z started 2024-09-21T02:32:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:32:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:32:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:32:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:32:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:50.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: Standby manager daemon z started 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.? 172.21.15.172:0/1582105522' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T02:32:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:51.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:51 smithi084 ceph-mon[30747]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:32:51.186 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:51 smithi084 ceph-mon[30747]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T02:32:51.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:51 smithi084 ceph-mon[30747]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-21T02:32:51.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:32:51.187 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:51 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:51.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:51 smithi172 ceph-mon[35067]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:32:51.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:51 smithi172 ceph-mon[35067]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T02:32:51.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:51 smithi172 ceph-mon[35067]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-21T02:32:51.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:32:51.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:51 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:51.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:51 smithi090 ceph-mon[34571]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T02:32:51.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:51 smithi090 ceph-mon[34571]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T02:32:51.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:51 smithi090 ceph-mon[34571]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-21T02:32:51.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T02:32:51.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:51 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:51.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 -- 172.21.15.84:0/617973133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104fa0 msgr2=0x7f288010b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 --2- 172.21.15.84:0/617973133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104fa0 0x7f288010b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2878009ca0 tx=0x7f287802a950 comp rx=0 tx=0).stop 2024-09-21T02:32:51.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 -- 172.21.15.84:0/617973133 shutdown_connections 2024-09-21T02:32:51.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 --2- 172.21.15.84:0/617973133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104fa0 0x7f288010b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 --2- 172.21.15.84:0/617973133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880104600 0x7f2880104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 --2- 172.21.15.84:0/617973133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2880103570 0x7f28801039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 -- 172.21.15.84:0/617973133 >> 172.21.15.84:0/617973133 conn(0x7f28800feec0 msgr2=0x7f2880101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 -- 172.21.15.84:0/617973133 shutdown_connections 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.636+0000 7f2885600640 1 -- 172.21.15.84:0/617973133 wait complete. 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.637+0000 7f2885600640 1 Processor -- start 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.637+0000 7f2885600640 1 -- start start 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f2885600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880103570 0x7f288019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f2885600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104600 0x7f288019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f2885600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2880104fa0 0x7f288019d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f2885600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f288010f340 con 0x7f2880103570 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f2885600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f288010f1c0 con 0x7f2880104600 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f2885600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f288010f4c0 con 0x7f2880104fa0 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880103570 0x7f288019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:51.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104600 0x7f288019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104600 0x7f288019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:48930/0 (socket says 172.21.15.84:48930) 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287f400640 1 -- 172.21.15.84:0/3200421751 learned_addr learned my addr 172.21.15.84:0/3200421751 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f2884c00640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2880104fa0 0x7f288019d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287f400640 1 -- 172.21.15.84:0/3200421751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2880104fa0 msgr2=0x7f288019d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287f400640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2880104fa0 0x7f288019d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287f400640 1 -- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880103570 msgr2=0x7f288019c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287f400640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880103570 0x7f288019c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f287f400640 1 -- 172.21.15.84:0/3200421751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288019da90 con 0x7f2880104600 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.638+0000 7f2884c00640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2880104fa0 0x7f288019d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.639+0000 7f287f400640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104600 0x7f288019c6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f286c00e9f0 tx=0x7f286c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.639+0000 7f287cc00640 1 -- 172.21.15.84:0/3200421751 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c00cd80 con 0x7f2880104600 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.639+0000 7f287cc00640 1 -- 172.21.15.84:0/3200421751 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f286c010900 con 0x7f2880104600 2024-09-21T02:32:51.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.639+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288019dd80 con 0x7f2880104600 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.639+0000 7f287cc00640 1 -- 172.21.15.84:0/3200421751 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c018920 con 0x7f2880104600 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.639+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28801a4480 con 0x7f2880104600 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.640+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28801a4650 con 0x7f2880104600 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.641+0000 7f287cc00640 1 -- 172.21.15.84:0/3200421751 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f286c010430 con 0x7f2880104600 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.643+0000 7f287cc00640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f286407afd0 0x7f286407d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.643+0000 7f287cc00640 1 -- 172.21.15.84:0/3200421751 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f286c09d120 con 0x7f2880104600 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.643+0000 7f287fe00640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f286407afd0 0x7f286407d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.643+0000 7f287fe00640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f286407afd0 0x7f286407d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2870009bd0 tx=0x7f2870005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:51.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.647+0000 7f287cc00640 1 -- 172.21.15.84:0/3200421751 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f286c010720 con 0x7f2880104600 2024-09-21T02:32:51.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.863+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f28801a4be0 con 0x7f2880104600 2024-09-21T02:32:51.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.864+0000 7f287cc00640 1 -- 172.21.15.84:0/3200421751 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7f286c069c20 con 0x7f2880104600 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.867+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f286407afd0 msgr2=0x7f286407d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.867+0000 7f2885600640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f286407afd0 0x7f286407d4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2870009bd0 tx=0x7f2870005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.867+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104600 msgr2=0x7f288019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.867+0000 7f2885600640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104600 0x7f288019c6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f286c00e9f0 tx=0x7f286c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.867+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 shutdown_connections 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.868+0000 7f2885600640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f286407afd0 0x7f286407d4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.868+0000 7f2885600640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2880104fa0 0x7f288019d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.868+0000 7f2885600640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2880104600 0x7f288019c6d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.868+0000 7f2885600640 1 --2- 172.21.15.84:0/3200421751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2880103570 0x7f288019c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:51.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.868+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 >> 172.21.15.84:0/3200421751 conn(0x7f28800feec0 msgr2=0x7f28800755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:51.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.868+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 shutdown_connections 2024-09-21T02:32:51.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.868+0000 7f2885600640 1 -- 172.21.15.84:0/3200421751 wait complete. 2024-09-21T02:32:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 -- 172.21.15.84:0/3575397091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8106820 msgr2=0x7f51c8106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 --2- 172.21.15.84:0/3575397091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8106820 0x7f51c8106c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009900 tx=0x7f51b002a480 comp rx=0 tx=0).stop 2024-09-21T02:32:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 -- 172.21.15.84:0/3575397091 shutdown_connections 2024-09-21T02:32:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 --2- 172.21.15.84:0/3575397091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c81071c0 0x7f51c810db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 --2- 172.21.15.84:0/3575397091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8106820 0x7f51c8106c30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 --2- 172.21.15.84:0/3575397091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51c8105790 0x7f51c8105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 -- 172.21.15.84:0/3575397091 >> 172.21.15.84:0/3575397091 conn(0x7f51c8101100 msgr2=0x7f51c81035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 -- 172.21.15.84:0/3575397091 shutdown_connections 2024-09-21T02:32:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.104+0000 7f51cce00640 1 -- 172.21.15.84:0/3575397091 wait complete. 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.105+0000 7f51cce00640 1 Processor -- start 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.105+0000 7f51cce00640 1 -- start start 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.105+0000 7f51cce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8105790 0x7f51c819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.105+0000 7f51cce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c8106820 0x7f51c819c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.105+0000 7f51cce00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51c81071c0 0x7f51c819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.105+0000 7f51cce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51c8111560 con 0x7f51c8105790 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.105+0000 7f51cce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51c81113e0 con 0x7f51c8106820 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.105+0000 7f51cce00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51c81116e0 con 0x7f51c81071c0 2024-09-21T02:32:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51c7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8105790 0x7f51c819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51c7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8105790 0x7f51c819c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50168/0 (socket says 172.21.15.84:50168) 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51c7400640 1 -- 172.21.15.84:0/3502550726 learned_addr learned my addr 172.21.15.84:0/3502550726 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51bea00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c8106820 0x7f51c819c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51c7e00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51c81071c0 0x7f51c819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51bea00640 1 -- 172.21.15.84:0/3502550726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51c81071c0 msgr2=0x7f51c819d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51bea00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51c81071c0 0x7f51c819d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51bea00640 1 -- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8105790 msgr2=0x7f51c819c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51bea00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8105790 0x7f51c819c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51bea00640 1 -- 172.21.15.84:0/3502550726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c819db30 con 0x7f51c8106820 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.106+0000 7f51c7400640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8105790 0x7f51c819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.107+0000 7f51bea00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c8106820 0x7f51c819c770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f51b002aa70 tx=0x7f51b0032c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.107+0000 7f51c4c00640 1 -- 172.21.15.84:0/3502550726 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b003f030 con 0x7f51c8106820 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.107+0000 7f51c4c00640 1 -- 172.21.15.84:0/3502550726 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51b0032e30 con 0x7f51c8106820 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.107+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c819ddc0 con 0x7f51c8106820 2024-09-21T02:32:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.107+0000 7f51c4c00640 1 -- 172.21.15.84:0/3502550726 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0035070 con 0x7f51c8106820 2024-09-21T02:32:52.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.107+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c81a4350 con 0x7f51c8106820 2024-09-21T02:32:52.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.108+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c810c970 con 0x7f51c8106820 2024-09-21T02:32:52.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.110+0000 7f51c4c00640 1 -- 172.21.15.84:0/3502550726 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f51b0042030 con 0x7f51c8106820 2024-09-21T02:32:52.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.112+0000 7f51c4c00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51ac0b6500 0x7f51ac0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.112+0000 7f51c4c00640 1 -- 172.21.15.84:0/3502550726 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f51b01059f0 con 0x7f51c8106820 2024-09-21T02:32:52.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.112+0000 7f51c7400640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51ac0b6500 0x7f51ac0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.112+0000 7f51c7400640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51ac0b6500 0x7f51ac0b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51b8011500 tx=0x7f51b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:52.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.115+0000 7f51c4c00640 1 -- 172.21.15.84:0/3502550726 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51b00cdeb0 con 0x7f51c8106820 2024-09-21T02:32:52.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.773+0000 7f44dda00640 1 -- 172.21.15.84:0/2698687062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104fa0 msgr2=0x7f44d810b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.773+0000 7f44dda00640 1 --2- 172.21.15.84:0/2698687062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104fa0 0x7f44d810b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009ca0 tx=0x7f44d002a950 comp rx=0 tx=0).stop 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.773+0000 7f44dda00640 1 -- 172.21.15.84:0/2698687062 shutdown_connections 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.773+0000 7f44dda00640 1 --2- 172.21.15.84:0/2698687062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44d8104600 0x7f44d8104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.773+0000 7f44dda00640 1 --2- 172.21.15.84:0/2698687062 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104fa0 0x7f44d810b940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.773+0000 7f44dda00640 1 --2- 172.21.15.84:0/2698687062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44d8103570 0x7f44d81039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.773+0000 7f44dda00640 1 -- 172.21.15.84:0/2698687062 >> 172.21.15.84:0/2698687062 conn(0x7f44d80feec0 msgr2=0x7f44d8101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.774+0000 7f44dda00640 1 -- 172.21.15.84:0/2698687062 shutdown_connections 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.774+0000 7f44dda00640 1 -- 172.21.15.84:0/2698687062 wait complete. 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dda00640 1 Processor -- start 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dda00640 1 -- start start 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dda00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44d8103570 0x7f44d819c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dda00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104600 0x7f44d819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dda00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44d8104fa0 0x7f44d819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dda00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f44d810f340 con 0x7f44d8103570 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dda00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44d810f1c0 con 0x7f44d8104600 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dda00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f44d810f4c0 con 0x7f44d8104fa0 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44d7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44d8103570 0x7f44d819c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44d7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104600 0x7f44d819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44d7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44d8103570 0x7f44d819c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50162/0 (socket says 172.21.15.84:50162) 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44d7e00640 1 -- 172.21.15.84:0/1400154568 learned_addr learned my addr 172.21.15.84:0/1400154568 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:52.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.775+0000 7f44dd000640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44d8104fa0 0x7f44d819d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.776+0000 7f44d7e00640 1 -- 172.21.15.84:0/1400154568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44d8104fa0 msgr2=0x7f44d819d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.776+0000 7f44d7e00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44d8104fa0 0x7f44d819d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.776+0000 7f44d7e00640 1 -- 172.21.15.84:0/1400154568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104600 msgr2=0x7f44d819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.776+0000 7f44d7e00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104600 0x7f44d819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.776+0000 7f44d7e00640 1 -- 172.21.15.84:0/1400154568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d819da70 con 0x7f44d8103570 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.776+0000 7f44d7400640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104600 0x7f44d819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.776+0000 7f44d7e00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44d8103570 0x7f44d819c040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f44c800e9f0 tx=0x7f44c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.776+0000 7f44d4c00640 1 -- 172.21.15.84:0/1400154568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c800cd80 con 0x7f44d8103570 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.777+0000 7f44d4c00640 1 -- 172.21.15.84:0/1400154568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44c8010900 con 0x7f44d8103570 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.777+0000 7f44d4c00640 1 -- 172.21.15.84:0/1400154568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c8018920 con 0x7f44d8103570 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.777+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d819dd60 con 0x7f44d8103570 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.777+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d81a4460 con 0x7f44d8103570 2024-09-21T02:32:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.778+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d81039e0 con 0x7f44d8103570 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.779+0000 7f44d4c00640 1 -- 172.21.15.84:0/1400154568 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f44c8010ab0 con 0x7f44d8103570 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.781+0000 7f44d4c00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44bc07afd0 0x7f44bc07d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.781+0000 7f44d4c00640 1 -- 172.21.15.84:0/1400154568 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f44c809d150 con 0x7f44d8103570 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.781+0000 7f44d7400640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44bc07afd0 0x7f44bc07d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.782+0000 7f44d7400640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44bc07afd0 0x7f44bc07d4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009fc0 tx=0x7f44c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.786+0000 7f44d4c00640 1 -- 172.21.15.84:0/1400154568 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44c8069c50 con 0x7f44d8103570 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:51.997+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f44d81a46d0 con 0x7f44d8103570 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.001+0000 7f44d4c00640 1 -- 172.21.15.84:0/1400154568 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7f44c806eb00 con 0x7f44d8103570 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.003+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44bc07afd0 msgr2=0x7f44bc07d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.003+0000 7f44dda00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44bc07afd0 0x7f44bc07d4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009fc0 tx=0x7f44c4005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.003+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44d8103570 msgr2=0x7f44d819c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.003+0000 7f44dda00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44d8103570 0x7f44d819c040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f44c800e9f0 tx=0x7f44c800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.004+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 shutdown_connections 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.004+0000 7f44dda00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44bc07afd0 0x7f44bc07d4e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.004+0000 7f44dda00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44d8104fa0 0x7f44d819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.004+0000 7f44dda00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44d8104600 0x7f44d819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.004+0000 7f44dda00640 1 --2- 172.21.15.84:0/1400154568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44d8103570 0x7f44d819c040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.004+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 >> 172.21.15.84:0/1400154568 conn(0x7f44d80feec0 msgr2=0x7f44d80755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.004+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 shutdown_connections 2024-09-21T02:32:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.004+0000 7f44dda00640 1 -- 172.21.15.84:0/1400154568 wait complete. 2024-09-21T02:32:52.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:52 smithi084 ceph-mon[30747]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:52.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:52 smithi084 ceph-mon[30747]: Standby manager daemon y started 2024-09-21T02:32:52.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:52 smithi084 ceph-mon[30747]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:32:52.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:52 smithi084 ceph-mon[30747]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:32:52.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:52 smithi084 ceph-mon[30747]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:32:52.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:52 smithi084 ceph-mon[30747]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:32:52.310 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:52 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1400154568' entity='client.admin' 2024-09-21T02:32:52.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.316+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f51c802e640 con 0x7f51c8106820 2024-09-21T02:32:52.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.327+0000 7f51c4c00640 1 -- 172.21.15.84:0/3502550726 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f51b00d2290 con 0x7f51c8106820 2024-09-21T02:32:52.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51ac0b6500 msgr2=0x7f51ac0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51ac0b6500 0x7f51ac0b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51b8011500 tx=0x7f51b8005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c8106820 msgr2=0x7f51c819c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c8106820 0x7f51c819c770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f51b002aa70 tx=0x7f51b0032c40 comp rx=0 tx=0).stop 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 shutdown_connections 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51ac0b6500 0x7f51ac0b8a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51c81071c0 0x7f51c819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51c8106820 0x7f51c819c770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 --2- 172.21.15.84:0/3502550726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51c8105790 0x7f51c819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 >> 172.21.15.84:0/3502550726 conn(0x7f51c8101100 msgr2=0x7f51c8109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 shutdown_connections 2024-09-21T02:32:52.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.330+0000 7f51cce00640 1 -- 172.21.15.84:0/3502550726 wait complete. 2024-09-21T02:32:52.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:52 smithi172 ceph-mon[35067]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:52.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:52 smithi172 ceph-mon[35067]: Standby manager daemon y started 2024-09-21T02:32:52.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:52 smithi172 ceph-mon[35067]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:32:52.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:52 smithi172 ceph-mon[35067]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:32:52.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:52 smithi172 ceph-mon[35067]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:32:52.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:52 smithi172 ceph-mon[35067]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:32:52.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:52 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1400154568' entity='client.admin' 2024-09-21T02:32:52.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:52 smithi090 ceph-mon[34571]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:52.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:52 smithi090 ceph-mon[34571]: Standby manager daemon y started 2024-09-21T02:32:52.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:52 smithi090 ceph-mon[34571]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T02:32:52.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:52 smithi090 ceph-mon[34571]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T02:32:52.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:52 smithi090 ceph-mon[34571]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T02:32:52.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:52 smithi090 ceph-mon[34571]: from='mgr.? 172.21.15.90:0/79682568' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T02:32:52.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:52 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1400154568' entity='client.admin' 2024-09-21T02:32:52.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 -- 172.21.15.84:0/1017811294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c01035a0 msgr2=0x7f53c0103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 --2- 172.21.15.84:0/1017811294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c01035a0 0x7f53c0103a10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009860 tx=0x7f53b402a3d0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 -- 172.21.15.84:0/1017811294 shutdown_connections 2024-09-21T02:32:52.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 --2- 172.21.15.84:0/1017811294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c0104fd0 0x7f53c010b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 --2- 172.21.15.84:0/1017811294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c0104630 0x7f53c0104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 --2- 172.21.15.84:0/1017811294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c01035a0 0x7f53c0103a10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 -- 172.21.15.84:0/1017811294 >> 172.21.15.84:0/1017811294 conn(0x7f53c00fef10 msgr2=0x7f53c01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 -- 172.21.15.84:0/1017811294 shutdown_connections 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.308+0000 7f53c7000640 1 -- 172.21.15.84:0/1017811294 wait complete. 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.309+0000 7f53c7000640 1 Processor -- start 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c7000640 1 -- start start 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c7000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c01035a0 0x7f53c019c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c7000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c0104630 0x7f53c019c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c7000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c0104fd0 0x7f53c019d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c7000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f53c010f370 con 0x7f53c0104fd0 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c7000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53c010f1f0 con 0x7f53c0104630 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c7000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53c010f4f0 con 0x7f53c01035a0 2024-09-21T02:32:52.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c6600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c0104fd0 0x7f53c019d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c5200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c0104630 0x7f53c019c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c6600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c0104fd0 0x7f53c019d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50182/0 (socket says 172.21.15.84:50182) 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c6600640 1 -- 172.21.15.84:0/1008882928 learned_addr learned my addr 172.21.15.84:0/1008882928 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.310+0000 7f53c5c00640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c01035a0 0x7f53c019c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53c5200640 1 -- 172.21.15.84:0/1008882928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c01035a0 msgr2=0x7f53c019c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53c5200640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c01035a0 0x7f53c019c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53c5200640 1 -- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c0104fd0 msgr2=0x7f53c019d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53c5200640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c0104fd0 0x7f53c019d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53c5200640 1 -- 172.21.15.84:0/1008882928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c019daf0 con 0x7f53c0104630 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53c5200640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c0104630 0x7f53c019c730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005fd0 tx=0x7f53ac00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53be000640 1 -- 172.21.15.84:0/1008882928 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00cd00 con 0x7f53c0104630 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53be000640 1 -- 172.21.15.84:0/1008882928 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f53ac0035f0 con 0x7f53c0104630 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53be000640 1 -- 172.21.15.84:0/1008882928 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac010690 con 0x7f53c0104630 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.311+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c019dde0 con 0x7f53c0104630 2024-09-21T02:32:52.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.312+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c01a44e0 con 0x7f53c0104630 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.313+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c01a46b0 con 0x7f53c0104630 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.315+0000 7f53be000640 1 -- 172.21.15.84:0/1008882928 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f53ac0037a0 con 0x7f53c0104630 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.317+0000 7f53be000640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53a80b6500 0x7f53a80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.317+0000 7f53be000640 1 -- 172.21.15.84:0/1008882928 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f53ac0e57e0 con 0x7f53c0104630 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.317+0000 7f53c5c00640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53a80b6500 0x7f53a80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.318+0000 7f53c5c00640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53a80b6500 0x7f53a80b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53b402a9c0 tx=0x7f53b4030980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.320+0000 7f53be000640 1 -- 172.21.15.84:0/1008882928 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53ac009510 con 0x7f53c0104630 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.516+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f53c01a4880 con 0x7f53c0104630 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.524+0000 7f53be000640 1 -- 172.21.15.84:0/1008882928 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v22)=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7f53ac0adca0 con 0x7f53c0104630 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.526+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53a80b6500 msgr2=0x7f53a80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53a80b6500 0x7f53a80b8a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53b402a9c0 tx=0x7f53b4030980 comp rx=0 tx=0).stop 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c0104630 msgr2=0x7f53c019c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c0104630 0x7f53c019c730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005fd0 tx=0x7f53ac00ee50 comp rx=0 tx=0).stop 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 shutdown_connections 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53c0104fd0 0x7f53c019d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53c0104630 0x7f53c019c730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53a80b6500 0x7f53a80b8a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 --2- 172.21.15.84:0/1008882928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53c01035a0 0x7f53c019c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 >> 172.21.15.84:0/1008882928 conn(0x7f53c00fef10 msgr2=0x7f53c00755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 shutdown_connections 2024-09-21T02:32:52.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:52.527+0000 7f53c7000640 1 -- 172.21.15.84:0/1008882928 wait complete. 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 -- 172.21.15.84:0/3972018190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104fa0 msgr2=0x7fa49810b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 --2- 172.21.15.84:0/3972018190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104fa0 0x7fa49810b940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa490009ca0 tx=0x7fa49002a950 comp rx=0 tx=0).stop 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 -- 172.21.15.84:0/3972018190 shutdown_connections 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 --2- 172.21.15.84:0/3972018190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa498104600 0x7fa498104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 --2- 172.21.15.84:0/3972018190 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104fa0 0x7fa49810b940 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 --2- 172.21.15.84:0/3972018190 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa498103570 0x7fa4981039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 -- 172.21.15.84:0/3972018190 >> 172.21.15.84:0/3972018190 conn(0x7fa4980feec0 msgr2=0x7fa498101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 -- 172.21.15.84:0/3972018190 shutdown_connections 2024-09-21T02:32:53.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.033+0000 7fa49da00640 1 -- 172.21.15.84:0/3972018190 wait complete. 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.034+0000 7fa49da00640 1 Processor -- start 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.034+0000 7fa49da00640 1 -- start start 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa49da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa498103570 0x7fa498199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa49da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104600 0x7fa49819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa49da00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa498104fa0 0x7fa49819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa49da00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810f340 con 0x7fa498104600 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa49da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810f1c0 con 0x7fa498103570 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa49da00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810f4c0 con 0x7fa498104fa0 2024-09-21T02:32:53.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa497400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104600 0x7fa49819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa497400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104600 0x7fa49819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50188/0 (socket says 172.21.15.84:50188) 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa497400640 1 -- 172.21.15.84:0/423186173 learned_addr learned my addr 172.21.15.84:0/423186173 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa497e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa498103570 0x7fa498199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.035+0000 7fa49d000640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa498104fa0 0x7fa49819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa497400640 1 -- 172.21.15.84:0/423186173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa498104fa0 msgr2=0x7fa49819b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa497400640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa498104fa0 0x7fa49819b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa497400640 1 -- 172.21.15.84:0/423186173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa498103570 msgr2=0x7fa498199e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa497400640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa498103570 0x7fa498199e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa497400640 1 -- 172.21.15.84:0/423186173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49819b8b0 con 0x7fa498104600 2024-09-21T02:32:53.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa497400640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104600 0x7fa49819a4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa48400e9f0 tx=0x7fa48400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa494c00640 1 -- 172.21.15.84:0/423186173 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48400cd80 con 0x7fa498104600 2024-09-21T02:32:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa494c00640 1 -- 172.21.15.84:0/423186173 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa4840054f0 con 0x7fa498104600 2024-09-21T02:32:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa494c00640 1 -- 172.21.15.84:0/423186173 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484010690 con 0x7fa498104600 2024-09-21T02:32:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49819bba0 con 0x7fa498104600 2024-09-21T02:32:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.036+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4981a22a0 con 0x7fa498104600 2024-09-21T02:32:53.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.038+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49810a750 con 0x7fa498104600 2024-09-21T02:32:53.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.041+0000 7fa494c00640 1 -- 172.21.15.84:0/423186173 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fa4840046c0 con 0x7fa498104600 2024-09-21T02:32:53.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.043+0000 7fa494c00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa47c0b6480 0x7fa47c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:53.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.043+0000 7fa494c00640 1 -- 172.21.15.84:0/423186173 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa4840e5a70 con 0x7fa498104600 2024-09-21T02:32:53.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.043+0000 7fa497e00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa47c0b6480 0x7fa47c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:53.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.044+0000 7fa497e00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa47c0b6480 0x7fa47c0b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa488009bd0 tx=0x7fa488005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:53.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.048+0000 7fa494c00640 1 -- 172.21.15.84:0/423186173 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4840adf30 con 0x7fa498104600 2024-09-21T02:32:53.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.239+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fa49802e640 con 0x7fa498104600 2024-09-21T02:32:53.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.245+0000 7fa494c00640 1 -- 172.21.15.84:0/423186173 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v23)=0 v23) ==== 119+0+0 (secure 0 0 0) 0x7fa4840b2310 con 0x7fa498104600 2024-09-21T02:32:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa47c0b6480 msgr2=0x7fa47c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa47c0b6480 0x7fa47c0b8990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa488009bd0 tx=0x7fa488005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104600 msgr2=0x7fa49819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:53.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104600 0x7fa49819a4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa48400e9f0 tx=0x7fa48400edf0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 shutdown_connections 2024-09-21T02:32:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa47c0b6480 0x7fa47c0b8990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa498104fa0 0x7fa49819b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa498104600 0x7fa49819a4f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 --2- 172.21.15.84:0/423186173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa498103570 0x7fa498199e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 >> 172.21.15.84:0/423186173 conn(0x7fa4980feec0 msgr2=0x7fa498107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 shutdown_connections 2024-09-21T02:32:53.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:53.248+0000 7fa49da00640 1 -- 172.21.15.84:0/423186173 wait complete. 2024-09-21T02:32:53.407 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:53 smithi172 ceph-mon[35067]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-21T02:32:53.407 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:53 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:32:53.407 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:53 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:53.408 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:53 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:53 smithi084 ceph-mon[30747]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-21T02:32:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:53 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:32:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:53 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:53 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:53.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:53 smithi090 ceph-mon[34571]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-21T02:32:53.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:53 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T02:32:53.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:53 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:53.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:53 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:54.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:54 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/423186173' entity='client.admin' 2024-09-21T02:32:54.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:54 smithi084 ceph-mon[30747]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:54.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:54 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/423186173' entity='client.admin' 2024-09-21T02:32:54.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:54 smithi172 ceph-mon[35067]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:54.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:54 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/423186173' entity='client.admin' 2024-09-21T02:32:54.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:54 smithi090 ceph-mon[34571]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 -- 172.21.15.84:0/1535129134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58081068e0 msgr2=0x7f5808108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 --2- 172.21.15.84:0/1535129134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58081068e0 0x7f5808108d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009860 tx=0x7f57f002a340 comp rx=0 tx=0).stop 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 -- 172.21.15.84:0/1535129134 shutdown_connections 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 --2- 172.21.15.84:0/1535129134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5808109480 0x7f580810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 --2- 172.21.15.84:0/1535129134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58081068e0 0x7f5808108d40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 --2- 172.21.15.84:0/1535129134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f580806c660 0x7f58081063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 -- 172.21.15.84:0/1535129134 >> 172.21.15.84:0/1535129134 conn(0x7f58080fdfe0 msgr2=0x7f5808100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 -- 172.21.15.84:0/1535129134 shutdown_connections 2024-09-21T02:32:55.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.526+0000 7f580d800640 1 -- 172.21.15.84:0/1535129134 wait complete. 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.527+0000 7f580d800640 1 Processor -- start 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f580d800640 1 -- start start 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f580d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f580806c660 0x7f580819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f580d800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58081068e0 0x7f580819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f580d800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5808109480 0x7f580819d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f580d800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f580810f4c0 con 0x7f580806c660 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f580d800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f580810f340 con 0x7f58081068e0 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f580d800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f580810f640 con 0x7f5808109480 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f5806a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f580806c660 0x7f580819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f5806a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f580806c660 0x7f580819c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50196/0 (socket says 172.21.15.84:50196) 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f5806a00640 1 -- 172.21.15.84:0/325229998 learned_addr learned my addr 172.21.15.84:0/325229998 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f5807400640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5808109480 0x7f580819d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.528+0000 7f57ffe00640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58081068e0 0x7f580819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:55.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f5806a00640 1 -- 172.21.15.84:0/325229998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5808109480 msgr2=0x7f580819d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f5806a00640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5808109480 0x7f580819d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f5806a00640 1 -- 172.21.15.84:0/325229998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58081068e0 msgr2=0x7f580819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f5806a00640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58081068e0 0x7f580819c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f5806a00640 1 -- 172.21.15.84:0/325229998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580819dd20 con 0x7f580806c660 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f57ffe00640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58081068e0 0x7f580819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f5806a00640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f580806c660 0x7f580819c2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9f0 tx=0x7f57f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f57ff400640 1 -- 172.21.15.84:0/325229998 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f800cd80 con 0x7f580806c660 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f57ff400640 1 -- 172.21.15.84:0/325229998 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f57f8010900 con 0x7f580806c660 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580819e010 con 0x7f580806c660 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f57ff400640 1 -- 172.21.15.84:0/325229998 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8018920 con 0x7f580806c660 2024-09-21T02:32:55.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.529+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58081a4710 con 0x7f580806c660 2024-09-21T02:32:55.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.531+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5808103870 con 0x7f580806c660 2024-09-21T02:32:55.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.533+0000 7f57ff400640 1 -- 172.21.15.84:0/325229998 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f57f8010ab0 con 0x7f580806c660 2024-09-21T02:32:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.534+0000 7f57ff400640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f57ec0b6500 0x7f57ec0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.535+0000 7f57ff400640 1 -- 172.21.15.84:0/325229998 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f57f80e5a70 con 0x7f580806c660 2024-09-21T02:32:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.535+0000 7f57ffe00640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f57ec0b6500 0x7f57ec0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:55.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.535+0000 7f57ffe00640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f57ec0b6500 0x7f57ec0b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f57f0000c00 tx=0x7f57f00058b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:55.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.539+0000 7f57ff400640 1 -- 172.21.15.84:0/325229998 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57f80adf30 con 0x7f580806c660 2024-09-21T02:32:55.730 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T02:32:55.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.736+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f580802e640 con 0x7f580806c660 2024-09-21T02:32:55.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.740+0000 7f57ff400640 1 -- 172.21.15.84:0/325229998 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f57f80b2310 con 0x7f580806c660 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f57ec0b6500 msgr2=0x7f57ec0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f57ec0b6500 0x7f57ec0b8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f57f0000c00 tx=0x7f57f00058b0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f580806c660 msgr2=0x7f580819c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f580806c660 0x7f580819c2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9f0 tx=0x7f57f800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 shutdown_connections 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f57ec0b6500 0x7f57ec0b8a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5808109480 0x7f580819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58081068e0 0x7f580819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 --2- 172.21.15.84:0/325229998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f580806c660 0x7f580819c2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:55.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.742+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 >> 172.21.15.84:0/325229998 conn(0x7f58080fdfe0 msgr2=0x7f5808100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:55.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.743+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 shutdown_connections 2024-09-21T02:32:55.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:55.743+0000 7f580d800640 1 -- 172.21.15.84:0/325229998 wait complete. 2024-09-21T02:32:56.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 -- 172.21.15.84:0/3918631741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f681071c0 msgr2=0x7f1f6810db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:56.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 --2- 172.21.15.84:0/3918631741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f681071c0 0x7f1f6810db60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1f60009900 tx=0x7f1f6002a480 comp rx=0 tx=0).stop 2024-09-21T02:32:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 -- 172.21.15.84:0/3918631741 shutdown_connections 2024-09-21T02:32:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 --2- 172.21.15.84:0/3918631741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f68106820 0x7f1f68106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 --2- 172.21.15.84:0/3918631741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f681071c0 0x7f1f6810db60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 --2- 172.21.15.84:0/3918631741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f68105790 0x7f1f68105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 -- 172.21.15.84:0/3918631741 >> 172.21.15.84:0/3918631741 conn(0x7f1f681010e0 msgr2=0x7f1f681035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 -- 172.21.15.84:0/3918631741 shutdown_connections 2024-09-21T02:32:56.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.857+0000 7f1f6e600640 1 -- 172.21.15.84:0/3918631741 wait complete. 2024-09-21T02:32:56.859 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:56 smithi084 ceph-mon[30747]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:56.859 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:56 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/325229998' entity='client.admin' 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.858+0000 7f1f6e600640 1 Processor -- start 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.858+0000 7f1f6e600640 1 -- start start 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6e600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f68105790 0x7f1f6819c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6e600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f68106820 0x7f1f6819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6e600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f681071c0 0x7f1f6819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6e600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f68111510 con 0x7f1f681071c0 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6e600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1f68111390 con 0x7f1f68105790 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6e600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f68111690 con 0x7f1f68106820 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f68105790 0x7f1f6819c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f68105790 0x7f1f6819c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:49030/0 (socket says 172.21.15.84:49030) 2024-09-21T02:32:56.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6d200640 1 -- 172.21.15.84:0/2636614715 learned_addr learned my addr 172.21.15.84:0/2636614715 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f6dc00640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f681071c0 0x7f1f6819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.859+0000 7f1f67e00640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f68106820 0x7f1f6819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f6d200640 1 -- 172.21.15.84:0/2636614715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f68106820 msgr2=0x7f1f6819c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f6d200640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f68106820 0x7f1f6819c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f6d200640 1 -- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f681071c0 msgr2=0x7f1f6819d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f6d200640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f681071c0 0x7f1f6819d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:56.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f6d200640 1 -- 172.21.15.84:0/2636614715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6819da90 con 0x7f1f68105790 2024-09-21T02:32:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f6d200640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f68105790 0x7f1f6819c060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800ebc0 tx=0x7f1f5800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f65600640 1 -- 172.21.15.84:0/2636614715 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f58010630 con 0x7f1f68105790 2024-09-21T02:32:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f65600640 1 -- 172.21.15.84:0/2636614715 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f58010ca0 con 0x7f1f68105790 2024-09-21T02:32:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f65600640 1 -- 172.21.15.84:0/2636614715 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f58018ba0 con 0x7f1f68105790 2024-09-21T02:32:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.860+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6819dd80 con 0x7f1f68105790 2024-09-21T02:32:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.861+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f681a4480 con 0x7f1f68105790 2024-09-21T02:32:56.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.862+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f68105c00 con 0x7f1f68105790 2024-09-21T02:32:56.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.864+0000 7f1f65600640 1 -- 172.21.15.84:0/2636614715 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f1f580107d0 con 0x7f1f68105790 2024-09-21T02:32:56.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.865+0000 7f1f65600640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1f4c0b6480 0x7f1f4c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:56.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.866+0000 7f1f65600640 1 -- 172.21.15.84:0/2636614715 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1f580e5f00 con 0x7f1f68105790 2024-09-21T02:32:56.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.866+0000 7f1f67e00640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1f4c0b6480 0x7f1f4c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:56.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.866+0000 7f1f67e00640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1f4c0b6480 0x7f1f4c0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005d00 tx=0x7f1f5400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:56.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:56.867+0000 7f1f65600640 1 -- 172.21.15.84:0/2636614715 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f58010ac0 con 0x7f1f68105790 2024-09-21T02:32:57.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:56 smithi172 ceph-mon[35067]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:57.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:56 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/325229998' entity='client.admin' 2024-09-21T02:32:57.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:56 smithi090 ceph-mon[34571]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:57.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:56 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/325229998' entity='client.admin' 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.063+0000 7fbf4c600640 1 -- 172.21.15.84:0/1651243719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf44077080 msgr2=0x7fbf44075750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.063+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1651243719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf44077080 0x7fbf44075750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009900 tx=0x7fbf3802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.063+0000 7fbf4c600640 1 -- 172.21.15.84:0/1651243719 shutdown_connections 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.063+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1651243719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf44075c90 0x7fbf440760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.063+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1651243719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf4410b750 0x7fbf4410db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.063+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1651243719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf44077080 0x7fbf44075750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.063+0000 7fbf4c600640 1 -- 172.21.15.84:0/1651243719 >> 172.21.15.84:0/1651243719 conn(0x7fbf440ff0c0 msgr2=0x7fbf44101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.064+0000 7fbf4c600640 1 -- 172.21.15.84:0/1651243719 shutdown_connections 2024-09-21T02:32:57.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.064+0000 7fbf4c600640 1 -- 172.21.15.84:0/1651243719 wait complete. 2024-09-21T02:32:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.064+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f1f6802e640 con 0x7f1f68105790 2024-09-21T02:32:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4c600640 1 Processor -- start 2024-09-21T02:32:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4c600640 1 -- start start 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4c600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf44075c90 0x7fbf4419c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4c600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf44077080 0x7fbf4419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4410b750 0x7fbf4419d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44111710 con 0x7fbf4410b750 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4c600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44111590 con 0x7fbf44077080 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4c600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44111890 con 0x7fbf44075c90 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf49200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf44077080 0x7fbf4419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf4a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4410b750 0x7fbf4419d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:57.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf49200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf44077080 0x7fbf4419c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:49052/0 (socket says 172.21.15.84:49052) 2024-09-21T02:32:57.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf49200640 1 -- 172.21.15.84:0/1206702389 learned_addr learned my addr 172.21.15.84:0/1206702389 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:57.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.065+0000 7fbf49c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf44075c90 0x7fbf4419c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:57.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7f1f65600640 1 -- 172.21.15.84:0/2636614715 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v24)=0 v24) ==== 106+0+0 (secure 0 0 0) 0x7f1f580b27a0 con 0x7f1f68105790 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf4a600640 1 -- 172.21.15.84:0/1206702389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf44075c90 msgr2=0x7fbf4419c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf4a600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf44075c90 0x7fbf4419c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf4a600640 1 -- 172.21.15.84:0/1206702389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf44077080 msgr2=0x7fbf4419c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf4a600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf44077080 0x7fbf4419c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf4a600640 1 -- 172.21.15.84:0/1206702389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4419dcb0 con 0x7fbf4410b750 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf49200640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf44077080 0x7fbf4419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf49c00640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf44075c90 0x7fbf4419c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.066+0000 7fbf4a600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4410b750 0x7fbf4419d490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00e940 tx=0x7fbf3c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.067+0000 7fbf42000640 1 -- 172.21.15.84:0/1206702389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c004d20 con 0x7fbf4410b750 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.067+0000 7fbf42000640 1 -- 172.21.15.84:0/1206702389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf3c005020 con 0x7fbf4410b750 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.067+0000 7fbf42000640 1 -- 172.21.15.84:0/1206702389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0116d0 con 0x7fbf4410b750 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.067+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4419dfa0 con 0x7fbf4410b750 2024-09-21T02:32:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.067+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf441a46a0 con 0x7fbf4410b750 2024-09-21T02:32:57.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.068+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf44109e50 con 0x7fbf4410b750 2024-09-21T02:32:57.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1f4c0b6480 msgr2=0x7f1f4c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1f4c0b6480 0x7f1f4c0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f54005d00 tx=0x7f1f5400b410 comp rx=0 tx=0).stop 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f68105790 msgr2=0x7f1f6819c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f68105790 0x7f1f6819c060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800ebc0 tx=0x7f1f5800c6a0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 shutdown_connections 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1f4c0b6480 0x7f1f4c0b8990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f68106820 0x7f1f6819c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f681071c0 0x7f1f6819d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 --2- 172.21.15.84:0/2636614715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f68105790 0x7f1f6819c060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 >> 172.21.15.84:0/2636614715 conn(0x7f1f681010e0 msgr2=0x7f1f68109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 shutdown_connections 2024-09-21T02:32:57.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.069+0000 7f1f6e600640 1 -- 172.21.15.84:0/2636614715 wait complete. 2024-09-21T02:32:57.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.071+0000 7fbf42000640 1 -- 172.21.15.84:0/1206702389 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fbf3c0054f0 con 0x7fbf4410b750 2024-09-21T02:32:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.073+0000 7fbf42000640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf2c0b6500 0x7fbf2c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.073+0000 7fbf42000640 1 -- 172.21.15.84:0/1206702389 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbf3c0e5600 con 0x7fbf4410b750 2024-09-21T02:32:57.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.073+0000 7fbf49c00640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf2c0b6500 0x7fbf2c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:57.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.074+0000 7fbf49c00640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf2c0b6500 0x7fbf2c0b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf38004770 tx=0x7fbf38031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:57.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.077+0000 7fbf42000640 1 -- 172.21.15.84:0/1206702389 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf3c016030 con 0x7fbf4410b750 2024-09-21T02:32:57.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.277+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fbf4402e640 con 0x7fbf4410b750 2024-09-21T02:32:57.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.282+0000 7fbf42000640 1 -- 172.21.15.84:0/1206702389 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7fbf3c0b1f20 con 0x7fbf4410b750 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf2c0b6500 msgr2=0x7fbf2c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf2c0b6500 0x7fbf2c0b8a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf38004770 tx=0x7fbf38031510 comp rx=0 tx=0).stop 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4410b750 msgr2=0x7fbf4419d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4410b750 0x7fbf4419d490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00e940 tx=0x7fbf3c00ee00 comp rx=0 tx=0).stop 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 shutdown_connections 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf4410b750 0x7fbf4419d490 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf44077080 0x7fbf4419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf2c0b6500 0x7fbf2c0b8a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 --2- 172.21.15.84:0/1206702389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf44075c90 0x7fbf4419c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.284+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 >> 172.21.15.84:0/1206702389 conn(0x7fbf440ff0c0 msgr2=0x7fbf441014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.285+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 shutdown_connections 2024-09-21T02:32:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.285+0000 7fbf4c600640 1 -- 172.21.15.84:0/1206702389 wait complete. 2024-09-21T02:32:57.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 -- 172.21.15.84:0/3731463787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4498105980 msgr2=0x7f4498105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 --2- 172.21.15.84:0/3731463787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4498105980 0x7f4498105df0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4488009900 tx=0x7f448802a480 comp rx=0 tx=0).stop 2024-09-21T02:32:57.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 -- 172.21.15.84:0/3731463787 shutdown_connections 2024-09-21T02:32:57.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 --2- 172.21.15.84:0/3731463787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44981073b0 0x7f449810dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 --2- 172.21.15.84:0/3731463787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4498106a10 0x7f4498106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 --2- 172.21.15.84:0/3731463787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4498105980 0x7f4498105df0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 -- 172.21.15.84:0/3731463787 >> 172.21.15.84:0/3731463787 conn(0x7f44981012f0 msgr2=0x7f44981037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:57.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 -- 172.21.15.84:0/3731463787 shutdown_connections 2024-09-21T02:32:57.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.948+0000 7f449ce00640 1 -- 172.21.15.84:0/3731463787 wait complete. 2024-09-21T02:32:57.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.949+0000 7f449ce00640 1 Processor -- start 2024-09-21T02:32:57.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.949+0000 7f449ce00640 1 -- start start 2024-09-21T02:32:57.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.949+0000 7f449ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4498105980 0x7f449819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:57.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.949+0000 7f449ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4498106a10 0x7f449819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:57.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.949+0000 7f449ce00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44981073b0 0x7f449819d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.949+0000 7f449ce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4498111750 con 0x7f4498106a10 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.949+0000 7f449ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44981115d0 con 0x7f4498105980 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.949+0000 7f449ce00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f44981118d0 con 0x7f44981073b0 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4498105980 0x7f449819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4498105980 0x7f449819c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:49072/0 (socket says 172.21.15.84:49072) 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 -- 172.21.15.84:0/88912572 learned_addr learned my addr 172.21.15.84:0/88912572 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f448fe00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4498106a10 0x7f449819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4496800640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44981073b0 0x7f449819d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 -- 172.21.15.84:0/88912572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44981073b0 msgr2=0x7f449819d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44981073b0 0x7f449819d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 -- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4498106a10 msgr2=0x7f449819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4498106a10 0x7f449819c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:57.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 -- 172.21.15.84:0/88912572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449819dcf0 con 0x7f4498105980 2024-09-21T02:32:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.950+0000 7f4495e00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4498105980 0x7f449819c2c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f44880314b0 tx=0x7f4488032c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.951+0000 7f448ea00640 1 -- 172.21.15.84:0/88912572 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448803f030 con 0x7f4498105980 2024-09-21T02:32:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.951+0000 7f448ea00640 1 -- 172.21.15.84:0/88912572 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4488032e30 con 0x7f4498105980 2024-09-21T02:32:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.951+0000 7f448ea00640 1 -- 172.21.15.84:0/88912572 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488035070 con 0x7f4498105980 2024-09-21T02:32:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.951+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449819df80 con 0x7f4498105980 2024-09-21T02:32:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.951+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44981a4510 con 0x7f4498105980 2024-09-21T02:32:57.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.952+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449810cb60 con 0x7f4498105980 2024-09-21T02:32:57.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.954+0000 7f448ea00640 1 -- 172.21.15.84:0/88912572 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f4488042030 con 0x7f4498105980 2024-09-21T02:32:57.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.955+0000 7f448ea00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f447c0b6500 0x7f447c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:57.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.956+0000 7f448ea00640 1 -- 172.21.15.84:0/88912572 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4488105ee0 con 0x7f4498105980 2024-09-21T02:32:57.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.956+0000 7f448fe00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f447c0b6500 0x7f447c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:57.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.956+0000 7f448fe00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f447c0b6500 0x7f447c0b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f44800095f0 tx=0x7f4480005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:57.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:57.957+0000 7f448ea00640 1 -- 172.21.15.84:0/88912572 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44880ce3a0 con 0x7f4498105980 2024-09-21T02:32:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.162+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f449802e640 con 0x7f4498105980 2024-09-21T02:32:58.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.167+0000 7f448ea00640 1 -- 172.21.15.84:0/88912572 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v26)=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f44880d2780 con 0x7f4498105980 2024-09-21T02:32:58.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f447c0b6500 msgr2=0x7f447c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:58.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f447c0b6500 0x7f447c0b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f44800095f0 tx=0x7f4480005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:58.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4498105980 msgr2=0x7f449819c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4498105980 0x7f449819c2c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f44880314b0 tx=0x7f4488032c40 comp rx=0 tx=0).stop 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 shutdown_connections 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f447c0b6500 0x7f447c0b8a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44981073b0 0x7f449819d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4498106a10 0x7f449819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 --2- 172.21.15.84:0/88912572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4498105980 0x7f449819c2c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 >> 172.21.15.84:0/88912572 conn(0x7f44981012f0 msgr2=0x7f4498109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 shutdown_connections 2024-09-21T02:32:58.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:58.170+0000 7f449ce00640 1 -- 172.21.15.84:0/88912572 wait complete. 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1206702389' entity='client.admin' 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:32:58 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1206702389' entity='client.admin' 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:32:58 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:32:58.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1206702389' entity='client.admin' 2024-09-21T02:32:58.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:32:58.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:32:58.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:32:58.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:32:58.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:32:58.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:32:58 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:32:59.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.266+0000 7fcd3b200640 1 -- 172.21.15.84:0/3551999084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd3c104fe0 msgr2=0x7fcd3c10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.266+0000 7fcd3b200640 1 --2- 172.21.15.84:0/3551999084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd3c104fe0 0x7fcd3c10b980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009ca0 tx=0x7fcd3402a950 comp rx=0 tx=0).stop 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.266+0000 7fcd3b200640 1 -- 172.21.15.84:0/3551999084 shutdown_connections 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.266+0000 7fcd3b200640 1 --2- 172.21.15.84:0/3551999084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd3c104fe0 0x7fcd3c10b980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.266+0000 7fcd3b200640 1 --2- 172.21.15.84:0/3551999084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c104640 0x7fcd3c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.266+0000 7fcd3b200640 1 --2- 172.21.15.84:0/3551999084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd3c1035b0 0x7fcd3c103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.266+0000 7fcd3b200640 1 -- 172.21.15.84:0/3551999084 >> 172.21.15.84:0/3551999084 conn(0x7fcd3c0fef20 msgr2=0x7fcd3c1013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.267+0000 7fcd3b200640 1 -- 172.21.15.84:0/3551999084 shutdown_connections 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.267+0000 7fcd3b200640 1 -- 172.21.15.84:0/3551999084 wait complete. 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.268+0000 7fcd3b200640 1 Processor -- start 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.268+0000 7fcd3b200640 1 -- start start 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.268+0000 7fcd3b200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd3c1035b0 0x7fcd3c199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.268+0000 7fcd3b200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd3c104640 0x7fcd3c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:59.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.268+0000 7fcd3b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c104fe0 0x7fcd3c19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.268+0000 7fcd3b200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c10f330 con 0x7fcd3c104fe0 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.268+0000 7fcd3b200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c10f1b0 con 0x7fcd3c1035b0 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.268+0000 7fcd3b200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3c10f4b0 con 0x7fcd3c104640 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd3a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c104fe0 0x7fcd3c19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd3a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c104fe0 0x7fcd3c19b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50274/0 (socket says 172.21.15.84:50274) 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd39400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd3c104640 0x7fcd3c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd3a800640 1 -- 172.21.15.84:0/1749113152 learned_addr learned my addr 172.21.15.84:0/1749113152 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd3a800640 1 -- 172.21.15.84:0/1749113152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd3c104640 msgr2=0x7fcd3c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd3a800640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd3c104640 0x7fcd3c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd3a800640 1 -- 172.21.15.84:0/1749113152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd3c1035b0 msgr2=0x7fcd3c199e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd3a800640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd3c1035b0 0x7fcd3c199e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.269+0000 7fcd3a800640 1 -- 172.21.15.84:0/1749113152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3c19b880 con 0x7fcd3c104fe0 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.270+0000 7fcd3a800640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c104fe0 0x7fcd3c19b060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd34006010 tx=0x7fcd3402fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:59.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.270+0000 7fcd32a00640 1 -- 172.21.15.84:0/1749113152 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34034040 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.270+0000 7fcd32a00640 1 -- 172.21.15.84:0/1749113152 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcd34030910 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.270+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3c19bb10 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.271+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3c1a2270 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.271+0000 7fcd32a00640 1 -- 172.21.15.84:0/1749113152 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34039430 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.272+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c0052c0 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.275+0000 7fcd32a00640 1 -- 172.21.15.84:0/1749113152 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fcd34037020 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.278+0000 7fcd32a00640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd200b6500 0x7fcd200b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.278+0000 7fcd32a00640 1 -- 172.21.15.84:0/1749113152 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcd34106500 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.281+0000 7fcd32a00640 1 -- 172.21.15.84:0/1749113152 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd3404a060 con 0x7fcd3c104fe0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.281+0000 7fcd39e00640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd200b6500 0x7fcd200b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:32:59.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.281+0000 7fcd39e00640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd200b6500 0x7fcd200b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009a90 tx=0x7fcd2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:32:59.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.479+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fcd1c0055b0 con 0x7fcd3c104fe0 2024-09-21T02:32:59.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.484+0000 7fcd32a00640 1 -- 172.21.15.84:0/1749113152 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7fcd340098b0 con 0x7fcd3c104fe0 2024-09-21T02:32:59.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.486+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd200b6500 msgr2=0x7fcd200b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:59.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.486+0000 7fcd3b200640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd200b6500 0x7fcd200b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009a90 tx=0x7fcd2c005f90 comp rx=0 tx=0).stop 2024-09-21T02:32:59.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.486+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c104fe0 msgr2=0x7fcd3c19b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:32:59.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.486+0000 7fcd3b200640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c104fe0 0x7fcd3c19b060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd34006010 tx=0x7fcd3402fa20 comp rx=0 tx=0).stop 2024-09-21T02:32:59.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.487+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 shutdown_connections 2024-09-21T02:32:59.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.487+0000 7fcd3b200640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd200b6500 0x7fcd200b8a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.487+0000 7fcd3b200640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd3c104640 0x7fcd3c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.487+0000 7fcd3b200640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd3c104fe0 0x7fcd3c19b060 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.487+0000 7fcd3b200640 1 --2- 172.21.15.84:0/1749113152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd3c1035b0 0x7fcd3c199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:32:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.487+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 >> 172.21.15.84:0/1749113152 conn(0x7fcd3c0fef20 msgr2=0x7fcd3c107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:32:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.487+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 shutdown_connections 2024-09-21T02:32:59.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:32:59.487+0000 7fcd3b200640 1 -- 172.21.15.84:0/1749113152 wait complete. 2024-09-21T02:33:00.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:00 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1749113152' entity='client.admin' 2024-09-21T02:33:00.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:00 smithi172 ceph-mon[35067]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:00.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:00 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1749113152' entity='client.admin' 2024-09-21T02:33:00.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:00 smithi084 ceph-mon[30747]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:00.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:00 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1749113152' entity='client.admin' 2024-09-21T02:33:00.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:00 smithi090 ceph-mon[34571]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:01.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 -- 172.21.15.84:0/522609777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c105980 msgr2=0x7f181c105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 --2- 172.21.15.84:0/522609777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c105980 0x7f181c105df0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f180c009900 tx=0x7f180c02a480 comp rx=0 tx=0).stop 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 -- 172.21.15.84:0/522609777 shutdown_connections 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 --2- 172.21.15.84:0/522609777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f181c106a10 0x7f181c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 --2- 172.21.15.84:0/522609777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f181c1073b0 0x7f181c10dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 --2- 172.21.15.84:0/522609777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c105980 0x7f181c105df0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 -- 172.21.15.84:0/522609777 >> 172.21.15.84:0/522609777 conn(0x7f181c1012f0 msgr2=0x7f181c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 -- 172.21.15.84:0/522609777 shutdown_connections 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.157+0000 7f1822a00640 1 -- 172.21.15.84:0/522609777 wait complete. 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.158+0000 7f1822a00640 1 Processor -- start 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.158+0000 7f1822a00640 1 -- start start 2024-09-21T02:33:01.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f1822a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f181c105980 0x7f181c19c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f1822a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c106a10 0x7f181c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f1822a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f181c1073b0 0x7f181c19d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f1822a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f181c111750 con 0x7f181c106a10 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f1822a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f181c1115d0 con 0x7f181c105980 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f1822a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f181c1118d0 con 0x7f181c1073b0 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f181b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c106a10 0x7f181c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f181b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c106a10 0x7f181c19c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36878/0 (socket says 172.21.15.84:36878) 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f181b400640 1 -- 172.21.15.84:0/808111514 learned_addr learned my addr 172.21.15.84:0/808111514 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f181be00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f181c105980 0x7f181c19c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.159+0000 7f1820a00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f181c1073b0 0x7f181c19d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:01.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f181b400640 1 -- 172.21.15.84:0/808111514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f181c1073b0 msgr2=0x7f181c19d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f181b400640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f181c1073b0 0x7f181c19d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f181b400640 1 -- 172.21.15.84:0/808111514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f181c105980 msgr2=0x7f181c19c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f181b400640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f181c105980 0x7f181c19c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f181b400640 1 -- 172.21.15.84:0/808111514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c19dc80 con 0x7f181c106a10 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f181b400640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c106a10 0x7f181c19c950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f180800e9f0 tx=0x7f180800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f1818c00640 1 -- 172.21.15.84:0/808111514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180800cd80 con 0x7f181c106a10 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c19df70 con 0x7f181c106a10 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f1818c00640 1 -- 172.21.15.84:0/808111514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f18080054f0 con 0x7f181c106a10 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f1818c00640 1 -- 172.21.15.84:0/808111514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808010690 con 0x7f181c106a10 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.160+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c1a4700 con 0x7f181c106a10 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.162+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c10cb60 con 0x7f181c106a10 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.165+0000 7f1818c00640 1 -- 172.21.15.84:0/808111514 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f18080046c0 con 0x7f181c106a10 2024-09-21T02:33:01.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.166+0000 7f1818c00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f18000b6500 0x7f18000b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:01.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.166+0000 7f1818c00640 1 -- 172.21.15.84:0/808111514 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f18080e59a0 con 0x7f181c106a10 2024-09-21T02:33:01.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.166+0000 7f181be00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f18000b6500 0x7f18000b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:01.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.167+0000 7f181be00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f18000b6500 0x7f18000b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f180c004770 tx=0x7f180c031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:01.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.170+0000 7f1818c00640 1 -- 172.21.15.84:0/808111514 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18080ade60 con 0x7f181c106a10 2024-09-21T02:33:01.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.364+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f181c02e640 con 0x7f181c106a10 2024-09-21T02:33:01.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.369+0000 7f1818c00640 1 -- 172.21.15.84:0/808111514 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v28)=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f18080b2240 con 0x7f181c106a10 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f18000b6500 msgr2=0x7f18000b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f18000b6500 0x7f18000b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f180c004770 tx=0x7f180c031510 comp rx=0 tx=0).stop 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c106a10 msgr2=0x7f181c19c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c106a10 0x7f181c19c950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f180800e9f0 tx=0x7f180800edf0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 shutdown_connections 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f18000b6500 0x7f18000b8a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f181c1073b0 0x7f181c19d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f181c106a10 0x7f181c19c950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 --2- 172.21.15.84:0/808111514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f181c105980 0x7f181c19c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.371+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 >> 172.21.15.84:0/808111514 conn(0x7f181c1012f0 msgr2=0x7f181c109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.372+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 shutdown_connections 2024-09-21T02:33:01.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:01.372+0000 7f1822a00640 1 -- 172.21.15.84:0/808111514 wait complete. 2024-09-21T02:33:01.874 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 -- 172.21.15.84:0/2301901646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd120075cf0 msgr2=0x7fd120076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:02.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 --2- 172.21.15.84:0/2301901646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd120075cf0 0x7fd120076100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd108009900 tx=0x7fd10802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 -- 172.21.15.84:0/2301901646 shutdown_connections 2024-09-21T02:33:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 --2- 172.21.15.84:0/2301901646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd12010fee0 0x7fd120112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 --2- 172.21.15.84:0/2301901646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd120075cf0 0x7fd120076100 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 --2- 172.21.15.84:0/2301901646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1200770e0 0x7fd1200757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 -- 172.21.15.84:0/2301901646 >> 172.21.15.84:0/2301901646 conn(0x7fd1200ff0e0 msgr2=0x7fd120101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 -- 172.21.15.84:0/2301901646 shutdown_connections 2024-09-21T02:33:02.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.412+0000 7fd126400640 1 -- 172.21.15.84:0/2301901646 wait complete. 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.413+0000 7fd126400640 1 Processor -- start 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.413+0000 7fd126400640 1 -- start start 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.413+0000 7fd126400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd120075cf0 0x7fd1201a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.413+0000 7fd126400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1200770e0 0x7fd1201a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd126400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd12010fee0 0x7fd1201a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd126400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd120115b30 con 0x7fd12010fee0 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd126400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1201159b0 con 0x7fd1200770e0 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd126400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd120115cb0 con 0x7fd120075cf0 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd117e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1200770e0 0x7fd1201a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd11f400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd120075cf0 0x7fd1201a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:02.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd12010fee0 0x7fd1201a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd117e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1200770e0 0x7fd1201a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:45212/0 (socket says 172.21.15.84:45212) 2024-09-21T02:33:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd117e00640 1 -- 172.21.15.84:0/2810267558 learned_addr learned my addr 172.21.15.84:0/2810267558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:33:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd117e00640 1 -- 172.21.15.84:0/2810267558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd120075cf0 msgr2=0x7fd1201a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd117e00640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd120075cf0 0x7fd1201a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd117e00640 1 -- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd12010fee0 msgr2=0x7fd1201a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd117e00640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd12010fee0 0x7fd1201a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.414+0000 7fd117e00640 1 -- 172.21.15.84:0/2810267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1201a20d0 con 0x7fd1200770e0 2024-09-21T02:33:02.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.415+0000 7fd117e00640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1200770e0 0x7fd1201a0d10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd1080314e0 tx=0x7fd1080045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.415+0000 7fd11cc00640 1 -- 172.21.15.84:0/2810267558 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10803f070 con 0x7fd1200770e0 2024-09-21T02:33:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.415+0000 7fd11cc00640 1 -- 172.21.15.84:0/2810267558 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd108005490 con 0x7fd1200770e0 2024-09-21T02:33:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.415+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1201a2360 con 0x7fd1200770e0 2024-09-21T02:33:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.415+0000 7fd11cc00640 1 -- 172.21.15.84:0/2810267558 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108035030 con 0x7fd1200770e0 2024-09-21T02:33:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.415+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1201a8ac0 con 0x7fd1200770e0 2024-09-21T02:33:02.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.416+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd120076100 con 0x7fd1200770e0 2024-09-21T02:33:02.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.418+0000 7fd11cc00640 1 -- 172.21.15.84:0/2810267558 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fd108042070 con 0x7fd1200770e0 2024-09-21T02:33:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.420+0000 7fd11cc00640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd1040b6500 0x7fd1040b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.420+0000 7fd11f400640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd1040b6500 0x7fd1040b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.420+0000 7fd11cc00640 1 -- 172.21.15.84:0/2810267558 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd108105de0 con 0x7fd1200770e0 2024-09-21T02:33:02.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.420+0000 7fd11f400640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd1040b6500 0x7fd1040b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd110009bd0 tx=0x7fd110005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:02.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.424+0000 7fd11cc00640 1 -- 172.21.15.84:0/2810267558 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1080d2680 con 0x7fd1200770e0 2024-09-21T02:33:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:02 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/808111514' entity='client.admin' 2024-09-21T02:33:02.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:02 smithi084 ceph-mon[30747]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:02.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.618+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fd120063fc0 con 0x7fd1200770e0 2024-09-21T02:33:02.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.626+0000 7fd11cc00640 1 -- 172.21.15.84:0/2810267558 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7fd1080d75c0 con 0x7fd1200770e0 2024-09-21T02:33:02.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd1040b6500 msgr2=0x7fd1040b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd1040b6500 0x7fd1040b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd110009bd0 tx=0x7fd110005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1200770e0 msgr2=0x7fd1201a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1200770e0 0x7fd1201a0d10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd1080314e0 tx=0x7fd1080045b0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 shutdown_connections 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd12010fee0 0x7fd1201a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1200770e0 0x7fd1201a0d10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd1040b6500 0x7fd1040b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 --2- 172.21.15.84:0/2810267558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd120075cf0 0x7fd1201a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 >> 172.21.15.84:0/2810267558 conn(0x7fd1200ff0e0 msgr2=0x7fd120103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 shutdown_connections 2024-09-21T02:33:02.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:02.629+0000 7fd126400640 1 -- 172.21.15.84:0/2810267558 wait complete. 2024-09-21T02:33:02.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:02 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/808111514' entity='client.admin' 2024-09-21T02:33:02.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:02 smithi172 ceph-mon[35067]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:02.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:02 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/808111514' entity='client.admin' 2024-09-21T02:33:02.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:02 smithi090 ceph-mon[34571]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:03.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:03 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:33:03.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:03 smithi084 ceph-mon[30747]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:03 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:33:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:03 smithi172 ceph-mon[35067]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:04.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:03 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:33:04.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:03 smithi090 ceph-mon[34571]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:04.300 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi084') 2024-09-21T02:33:04.300 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi084') 2024-09-21T02:33:04.300 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi084') 2024-09-21T02:33:04.300 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi084') 2024-09-21T02:33:04.301 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi084') 2024-09-21T02:33:04.852 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi084') 2024-09-21T02:33:04.852 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi084') 2024-09-21T02:33:05.642 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:05.990 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi084') 2024-09-21T02:33:05.991 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi084') 2024-09-21T02:33:05.991 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T02:33:05.991 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi084') 2024-09-21T02:33:05.991 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T02:33:05.991 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T02:33:06.744 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:06 smithi084 ceph-mon[30747]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:06.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 -- 172.21.15.84:0/1373194200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2c0770e0 msgr2=0x7fae2c0757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:06.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 --2- 172.21.15.84:0/1373194200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2c0770e0 0x7fae2c0757b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae20009860 tx=0x7fae2002a340 comp rx=0 tx=0).stop 2024-09-21T02:33:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 -- 172.21.15.84:0/1373194200 shutdown_connections 2024-09-21T02:33:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 --2- 172.21.15.84:0/1373194200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2c10b6f0 0x7fae2c10db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 --2- 172.21.15.84:0/1373194200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae2c075cf0 0x7fae2c076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 --2- 172.21.15.84:0/1373194200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2c0770e0 0x7fae2c0757b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 -- 172.21.15.84:0/1373194200 >> 172.21.15.84:0/1373194200 conn(0x7fae2c0ff0e0 msgr2=0x7fae2c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 -- 172.21.15.84:0/1373194200 shutdown_connections 2024-09-21T02:33:06.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.750+0000 7fae33400640 1 -- 172.21.15.84:0/1373194200 wait complete. 2024-09-21T02:33:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.751+0000 7fae33400640 1 Processor -- start 2024-09-21T02:33:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.751+0000 7fae33400640 1 -- start start 2024-09-21T02:33:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae33400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2c075cf0 0x7fae2c19c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae33400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2c0770e0 0x7fae2c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae33400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae2c10b6f0 0x7fae2c19d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae33400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1116c0 con 0x7fae2c075cf0 2024-09-21T02:33:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae33400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c111540 con 0x7fae2c10b6f0 2024-09-21T02:33:06.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae33400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c111840 con 0x7fae2c0770e0 2024-09-21T02:33:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae30a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2c075cf0 0x7fae2c19c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae30a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2c075cf0 0x7fae2c19c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36926/0 (socket says 172.21.15.84:36926) 2024-09-21T02:33:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae30a00640 1 -- 172.21.15.84:0/893654393 learned_addr learned my addr 172.21.15.84:0/893654393 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:33:06.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae31400640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae2c10b6f0 0x7fae2c19d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae30a00640 1 -- 172.21.15.84:0/893654393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2c0770e0 msgr2=0x7fae2c19c8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae30a00640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2c0770e0 0x7fae2c19c8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae30a00640 1 -- 172.21.15.84:0/893654393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae2c10b6f0 msgr2=0x7fae2c19d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae30a00640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae2c10b6f0 0x7fae2c19d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae30a00640 1 -- 172.21.15.84:0/893654393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c19dc90 con 0x7fae2c075cf0 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.752+0000 7fae31400640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae2c10b6f0 0x7fae2c19d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.753+0000 7fae30a00640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2c075cf0 0x7fae2c19c260 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae20035040 tx=0x7fae200326d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.753+0000 7fae29600640 1 -- 172.21.15.84:0/893654393 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20040070 con 0x7fae2c075cf0 2024-09-21T02:33:06.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.753+0000 7fae29600640 1 -- 172.21.15.84:0/893654393 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae200308e0 con 0x7fae2c075cf0 2024-09-21T02:33:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.753+0000 7fae29600640 1 -- 172.21.15.84:0/893654393 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20037040 con 0x7fae2c075cf0 2024-09-21T02:33:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.753+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c19df20 con 0x7fae2c075cf0 2024-09-21T02:33:06.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.753+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c1a44b0 con 0x7fae2c075cf0 2024-09-21T02:33:06.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.754+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2c109df0 con 0x7fae2c075cf0 2024-09-21T02:33:06.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.758+0000 7fae29600640 1 -- 172.21.15.84:0/893654393 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fae20043070 con 0x7fae2c075cf0 2024-09-21T02:33:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.759+0000 7fae29600640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae140b6500 0x7fae140b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.759+0000 7fae29600640 1 -- 172.21.15.84:0/893654393 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fae201047f0 con 0x7fae2c075cf0 2024-09-21T02:33:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.759+0000 7fae2be00640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae140b6500 0x7fae140b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.760+0000 7fae2be00640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae140b6500 0x7fae140b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fae180096c0 tx=0x7fae18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.763+0000 7fae29600640 1 -- 172.21.15.84:0/893654393 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae200ccd30 con 0x7fae2c075cf0 2024-09-21T02:33:06.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.958+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fae2c02e640 con 0x7fae2c075cf0 2024-09-21T02:33:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.964+0000 7fae29600640 1 -- 172.21.15.84:0/893654393 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v30)=0 v30) ==== 120+0+0 (secure 0 0 0) 0x7fae200d1110 con 0x7fae2c075cf0 2024-09-21T02:33:06.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae140b6500 msgr2=0x7fae140b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:06.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae140b6500 0x7fae140b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fae180096c0 tx=0x7fae18009260 comp rx=0 tx=0).stop 2024-09-21T02:33:06.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2c075cf0 msgr2=0x7fae2c19c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2c075cf0 0x7fae2c19c260 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae20035040 tx=0x7fae200326d0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 shutdown_connections 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae140b6500 0x7fae140b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2c0770e0 0x7fae2c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae2c10b6f0 0x7fae2c19d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 --2- 172.21.15.84:0/893654393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2c075cf0 0x7fae2c19c260 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 >> 172.21.15.84:0/893654393 conn(0x7fae2c0ff0e0 msgr2=0x7fae2c101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 shutdown_connections 2024-09-21T02:33:06.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:06.967+0000 7fae33400640 1 -- 172.21.15.84:0/893654393 wait complete. 2024-09-21T02:33:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:06 smithi172 ceph-mon[35067]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:07.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:06 smithi090 ceph-mon[34571]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:07.524 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:08.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:07 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/893654393' entity='client.admin' 2024-09-21T02:33:08.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:07 smithi090 ceph-mon[34571]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:08.143 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:07 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/893654393' entity='client.admin' 2024-09-21T02:33:08.143 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:07 smithi084 ceph-mon[30747]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:08.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:07 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/893654393' entity='client.admin' 2024-09-21T02:33:08.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:07 smithi172 ceph-mon[35067]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:08.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 -- 172.21.15.84:0/2117396786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7b8075cf0 msgr2=0x7ff7b8076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:08.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 --2- 172.21.15.84:0/2117396786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7b8075cf0 0x7ff7b8076100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009930 tx=0x7ff7a402a420 comp rx=0 tx=0).stop 2024-09-21T02:33:08.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 -- 172.21.15.84:0/2117396786 shutdown_connections 2024-09-21T02:33:08.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 --2- 172.21.15.84:0/2117396786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7b810fee0 0x7ff7b8112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 --2- 172.21.15.84:0/2117396786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7b8075cf0 0x7ff7b8076100 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 --2- 172.21.15.84:0/2117396786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b80770e0 0x7ff7b80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 -- 172.21.15.84:0/2117396786 >> 172.21.15.84:0/2117396786 conn(0x7ff7b80ff0c0 msgr2=0x7ff7b8101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:08.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 -- 172.21.15.84:0/2117396786 shutdown_connections 2024-09-21T02:33:08.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.317+0000 7ff7be400640 1 -- 172.21.15.84:0/2117396786 wait complete. 2024-09-21T02:33:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.318+0000 7ff7be400640 1 Processor -- start 2024-09-21T02:33:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.318+0000 7ff7be400640 1 -- start start 2024-09-21T02:33:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.318+0000 7ff7be400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7b8075cf0 0x7ff7b81a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.318+0000 7ff7be400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7b80770e0 0x7ff7b81a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.318+0000 7ff7be400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b810fee0 0x7ff7b81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.318+0000 7ff7be400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8115ae0 con 0x7ff7b810fee0 2024-09-21T02:33:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.318+0000 7ff7be400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8115960 con 0x7ff7b8075cf0 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.318+0000 7ff7be400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b8115c60 con 0x7ff7b80770e0 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b810fee0 0x7ff7b81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7b80770e0 0x7ff7b81a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b810fee0 0x7ff7b81a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36940/0 (socket says 172.21.15.84:36940) 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7b80770e0 0x7ff7b81a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:45960/0 (socket says 172.21.15.84:45960) 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7e00640 1 -- 172.21.15.84:0/2981994244 learned_addr learned my addr 172.21.15.84:0/2981994244 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7b8075cf0 0x7ff7b81a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7e00640 1 -- 172.21.15.84:0/2981994244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7b80770e0 msgr2=0x7ff7b81a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7e00640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7b80770e0 0x7ff7b81a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7e00640 1 -- 172.21.15.84:0/2981994244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7b8075cf0 msgr2=0x7ff7b81a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:08.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7e00640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7b8075cf0 0x7ff7b81a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b7e00640 1 -- 172.21.15.84:0/2981994244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b81a20e0 con 0x7ff7b810fee0 2024-09-21T02:33:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.319+0000 7ff7b6a00640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7b80770e0 0x7ff7b81a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.320+0000 7ff7b7e00640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b810fee0 0x7ff7b81a18c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000eb10 tx=0x7ff7b000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.320+0000 7ff7afe00640 1 -- 172.21.15.84:0/2981994244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0004b20 con 0x7ff7b810fee0 2024-09-21T02:33:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.320+0000 7ff7afe00640 1 -- 172.21.15.84:0/2981994244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff7b0004cc0 con 0x7ff7b810fee0 2024-09-21T02:33:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.320+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b81a23d0 con 0x7ff7b810fee0 2024-09-21T02:33:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.320+0000 7ff7afe00640 1 -- 172.21.15.84:0/2981994244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0010720 con 0x7ff7b810fee0 2024-09-21T02:33:08.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.320+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b81a8ad0 con 0x7ff7b810fee0 2024-09-21T02:33:08.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.321+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b8105f70 con 0x7ff7b810fee0 2024-09-21T02:33:08.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.324+0000 7ff7afe00640 1 -- 172.21.15.84:0/2981994244 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7ff7b0005000 con 0x7ff7b810fee0 2024-09-21T02:33:08.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.325+0000 7ff7afe00640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff79c0b6500 0x7ff79c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:08.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.325+0000 7ff7afe00640 1 -- 172.21.15.84:0/2981994244 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff7b00e5e10 con 0x7ff7b810fee0 2024-09-21T02:33:08.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.325+0000 7ff7b7400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff79c0b6500 0x7ff79c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:08.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.326+0000 7ff7b7400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff79c0b6500 0x7ff79c0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009bd0 tx=0x7ff7a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:08.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.327+0000 7ff7afe00640 1 -- 172.21.15.84:0/2981994244 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7b0056710 con 0x7ff7b810fee0 2024-09-21T02:33:08.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.522+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7ff7b802e640 con 0x7ff7b810fee0 2024-09-21T02:33:08.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.527+0000 7ff7afe00640 1 -- 172.21.15.84:0/2981994244 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v31)=0 v31) ==== 111+0+0 (secure 0 0 0) 0x7ff7b00ae2d0 con 0x7ff7b810fee0 2024-09-21T02:33:08.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff79c0b6500 msgr2=0x7ff79c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff79c0b6500 0x7ff79c0b8a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009bd0 tx=0x7ff7a8005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b810fee0 msgr2=0x7ff7b81a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b810fee0 0x7ff7b81a18c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000eb10 tx=0x7ff7b000c2d0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 shutdown_connections 2024-09-21T02:33:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff79c0b6500 0x7ff79c0b8a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7b80770e0 0x7ff7b81a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7b810fee0 0x7ff7b81a18c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 --2- 172.21.15.84:0/2981994244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7b8075cf0 0x7ff7b81a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:08.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 >> 172.21.15.84:0/2981994244 conn(0x7ff7b80ff0c0 msgr2=0x7ff7b8103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:08.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 shutdown_connections 2024-09-21T02:33:08.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:08.530+0000 7ff7be400640 1 -- 172.21.15.84:0/2981994244 wait complete. 2024-09-21T02:33:08.598 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T02:33:08.599 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi084') 2024-09-21T02:33:08.599 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi084') 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 -- 172.21.15.84:0/3537420258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7dc1073b0 msgr2=0x7fa7dc10dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/3537420258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7dc1073b0 0x7fa7dc10dd50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009ca0 tx=0x7fa7d402a950 comp rx=0 tx=0).stop 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 -- 172.21.15.84:0/3537420258 shutdown_connections 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/3537420258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7dc1073b0 0x7fa7dc10dd50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/3537420258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7dc106a10 0x7fa7dc106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/3537420258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7dc105980 0x7fa7dc105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 -- 172.21.15.84:0/3537420258 >> 172.21.15.84:0/3537420258 conn(0x7fa7dc1012f0 msgr2=0x7fa7dc1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 -- 172.21.15.84:0/3537420258 shutdown_connections 2024-09-21T02:33:09.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.341+0000 7fa7e0a00640 1 -- 172.21.15.84:0/3537420258 wait complete. 2024-09-21T02:33:09.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.342+0000 7fa7e0a00640 1 Processor -- start 2024-09-21T02:33:09.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.342+0000 7fa7e0a00640 1 -- start start 2024-09-21T02:33:09.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7e0a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7dc105980 0x7fa7dc19c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7e0a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7dc106a10 0x7fa7dc19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7e0a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7dc1073b0 0x7fa7dc19d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7e0a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc111700 con 0x7fa7dc106a10 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7e0a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc111580 con 0x7fa7dc105980 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7e0a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc111880 con 0x7fa7dc1073b0 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7dc105980 0x7fa7dc19c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7dc105980 0x7fa7dc19c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:45250/0 (socket says 172.21.15.84:45250) 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d9e00640 1 -- 172.21.15.84:0/540512263 learned_addr learned my addr 172.21.15.84:0/540512263 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d1400640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7dc106a10 0x7fa7dc19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7da800640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7dc1073b0 0x7fa7dc19d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d9e00640 1 -- 172.21.15.84:0/540512263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7dc1073b0 msgr2=0x7fa7dc19d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d9e00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7dc1073b0 0x7fa7dc19d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d9e00640 1 -- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7dc106a10 msgr2=0x7fa7dc19c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d9e00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7dc106a10 0x7fa7dc19c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.343+0000 7fa7d9e00640 1 -- 172.21.15.84:0/540512263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc19dc70 con 0x7fa7dc105980 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.344+0000 7fa7d9e00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7dc105980 0x7fa7dc19c240 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00e9f0 tx=0x7fa7cc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.344+0000 7fa7d3400640 1 -- 172.21.15.84:0/540512263 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00cd80 con 0x7fa7dc105980 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.344+0000 7fa7d3400640 1 -- 172.21.15.84:0/540512263 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa7cc010900 con 0x7fa7dc105980 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.344+0000 7fa7d3400640 1 -- 172.21.15.84:0/540512263 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc018920 con 0x7fa7dc105980 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.344+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc19df60 con 0x7fa7dc105980 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.344+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc1a4660 con 0x7fa7dc105980 2024-09-21T02:33:09.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.345+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7dc105df0 con 0x7fa7dc105980 2024-09-21T02:33:09.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.347+0000 7fa7d3400640 1 -- 172.21.15.84:0/540512263 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fa7cc010ab0 con 0x7fa7dc105980 2024-09-21T02:33:09.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.349+0000 7fa7d3400640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa7c00b6500 0x7fa7c00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:09.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.349+0000 7fa7d3400640 1 -- 172.21.15.84:0/540512263 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa7cc0e5f10 con 0x7fa7dc105980 2024-09-21T02:33:09.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.349+0000 7fa7d1400640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa7c00b6500 0x7fa7c00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:09.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.349+0000 7fa7d1400640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa7c00b6500 0x7fa7c00b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009bd0 tx=0x7fa7c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:09.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.350+0000 7fa7d3400640 1 -- 172.21.15.84:0/540512263 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7cc0ae3d0 con 0x7fa7dc105980 2024-09-21T02:33:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.544+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fa7dc10cb60 con 0x7fa7dc105980 2024-09-21T02:33:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.552+0000 7fa7d3400640 1 -- 172.21.15.84:0/540512263 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v32)=0 v32) ==== 125+0+0 (secure 0 0 0) 0x7fa7cc0b27b0 con 0x7fa7dc105980 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.554+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa7c00b6500 msgr2=0x7fa7c00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.554+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa7c00b6500 0x7fa7c00b8a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009bd0 tx=0x7fa7c4005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.554+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7dc105980 msgr2=0x7fa7dc19c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.554+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7dc105980 0x7fa7dc19c240 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00e9f0 tx=0x7fa7cc00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.555+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 shutdown_connections 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.555+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa7c00b6500 0x7fa7c00b8a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.555+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7dc1073b0 0x7fa7dc19d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.555+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7dc106a10 0x7fa7dc19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.555+0000 7fa7e0a00640 1 --2- 172.21.15.84:0/540512263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7dc105980 0x7fa7dc19c240 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:09.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.555+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 >> 172.21.15.84:0/540512263 conn(0x7fa7dc1012f0 msgr2=0x7fa7dc109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:09.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.555+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 shutdown_connections 2024-09-21T02:33:09.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:09.555+0000 7fa7e0a00640 1 -- 172.21.15.84:0/540512263 wait complete. 2024-09-21T02:33:09.620 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi084') 2024-09-21T02:33:09.620 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi084') 2024-09-21T02:33:09.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:09 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2981994244' entity='client.admin' 2024-09-21T02:33:09.893 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:09 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:09.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:09 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:09.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:09 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:09.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:09 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:09 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2981994244' entity='client.admin' 2024-09-21T02:33:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:09 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:09 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:09 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:09 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:10.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:09 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2981994244' entity='client.admin' 2024-09-21T02:33:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:09 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:09 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:09 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:09 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:10.242 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi084') 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1973225073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f34105790 msgr2=0x7f5f34105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1973225073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f34105790 0x7f5f34105c00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009900 tx=0x7f5f2802a480 comp rx=0 tx=0).stop 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1973225073 shutdown_connections 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1973225073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f341071c0 0x7f5f3410db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1973225073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f34106820 0x7f5f34106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1973225073 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f34105790 0x7f5f34105c00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1973225073 >> 172.21.15.84:0/1973225073 conn(0x7f5f341010e0 msgr2=0x7f5f341035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1973225073 shutdown_connections 2024-09-21T02:33:10.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.507+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1973225073 wait complete. 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.508+0000 7f5f3aa00640 1 Processor -- start 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.508+0000 7f5f3aa00640 1 -- start start 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f34105790 0x7f5f3419c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f34106820 0x7f5f3419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f341071c0 0x7f5f3419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3aa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f34111560 con 0x7f5f341071c0 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3aa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f341113e0 con 0x7f5f34106820 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3aa00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f341116e0 con 0x7f5f34105790 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f341071c0 0x7f5f3419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f341071c0 0x7f5f3419d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53896/0 (socket says 172.21.15.84:53896) 2024-09-21T02:33:10.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3a000640 1 -- 172.21.15.84:0/1676469609 learned_addr learned my addr 172.21.15.84:0/1676469609 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:33:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f39600640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f34105790 0x7f5f3419c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f38c00640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f34106820 0x7f5f3419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3a000640 1 -- 172.21.15.84:0/1676469609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f34105790 msgr2=0x7f5f3419c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3a000640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f34105790 0x7f5f3419c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3a000640 1 -- 172.21.15.84:0/1676469609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f34106820 msgr2=0x7f5f3419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.509+0000 7f5f3a000640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f34106820 0x7f5f3419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.510+0000 7f5f3a000640 1 -- 172.21.15.84:0/1676469609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3419db00 con 0x7f5f341071c0 2024-09-21T02:33:10.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.510+0000 7f5f3a000640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f341071c0 0x7f5f3419d2e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00eb10 tx=0x7f5f2c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.510+0000 7f5f32000640 1 -- 172.21.15.84:0/1676469609 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c004b20 con 0x7f5f341071c0 2024-09-21T02:33:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.510+0000 7f5f32000640 1 -- 172.21.15.84:0/1676469609 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f2c004cc0 con 0x7f5f341071c0 2024-09-21T02:33:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.510+0000 7f5f32000640 1 -- 172.21.15.84:0/1676469609 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c010720 con 0x7f5f341071c0 2024-09-21T02:33:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.510+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3419ddf0 con 0x7f5f341071c0 2024-09-21T02:33:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.510+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f341a44f0 con 0x7f5f341071c0 2024-09-21T02:33:10.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.511+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f3410c970 con 0x7f5f341071c0 2024-09-21T02:33:10.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.514+0000 7f5f32000640 1 -- 172.21.15.84:0/1676469609 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5f2c005020 con 0x7f5f341071c0 2024-09-21T02:33:10.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.515+0000 7f5f32000640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f1c0b6500 0x7f5f1c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:10.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.515+0000 7f5f32000640 1 -- 172.21.15.84:0/1676469609 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5f2c0e5d90 con 0x7f5f341071c0 2024-09-21T02:33:10.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.515+0000 7f5f39600640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f1c0b6500 0x7f5f1c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:10.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.516+0000 7f5f39600640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f1c0b6500 0x7f5f1c0b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f28004770 tx=0x7f5f28031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:10.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.517+0000 7f5f32000640 1 -- 172.21.15.84:0/1676469609 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f2c056710 con 0x7f5f341071c0 2024-09-21T02:33:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.732+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f5f3402e640 con 0x7f5f341071c0 2024-09-21T02:33:10.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.736+0000 7f5f32000640 1 -- 172.21.15.84:0/1676469609 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f5f2c0ae250 con 0x7f5f341071c0 2024-09-21T02:33:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f1c0b6500 msgr2=0x7f5f1c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f1c0b6500 0x7f5f1c0b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f28004770 tx=0x7f5f28031510 comp rx=0 tx=0).stop 2024-09-21T02:33:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f341071c0 msgr2=0x7f5f3419d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f341071c0 0x7f5f3419d2e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00eb10 tx=0x7f5f2c00c2d0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 shutdown_connections 2024-09-21T02:33:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f341071c0 0x7f5f3419d2e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f34106820 0x7f5f3419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f1c0b6500 0x7f5f1c0b8a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 --2- 172.21.15.84:0/1676469609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f34105790 0x7f5f3419c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 >> 172.21.15.84:0/1676469609 conn(0x7f5f341010e0 msgr2=0x7f5f34109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 shutdown_connections 2024-09-21T02:33:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:10.739+0000 7f5f3aa00640 1 -- 172.21.15.84:0/1676469609 wait complete. 2024-09-21T02:33:10.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:10 smithi084 ceph-mon[30747]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:10.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:10 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' 2024-09-21T02:33:10.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:10.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:10.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:10.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:10.887 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi084') 2024-09-21T02:33:10.887 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5b18da14-77c1-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T02:33:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:10 smithi172 ceph-mon[35067]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:10 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' 2024-09-21T02:33:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:11.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:11.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:11.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:10 smithi090 ceph-mon[34571]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:11.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:10 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' 2024-09-21T02:33:11.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:11.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:11.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:11.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:11.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T02:33:11.808 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:11 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1676469609' entity='client.admin' 2024-09-21T02:33:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:11 smithi172 ceph-mon[35067]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:11 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1676469609' entity='client.admin' 2024-09-21T02:33:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:11 smithi084 ceph-mon[30747]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:12.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:11 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1676469609' entity='client.admin' 2024-09-21T02:33:12.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:11 smithi090 ceph-mon[34571]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 -- 172.21.15.84:0/2325615577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 msgr2=0x7f8ff4076080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2325615577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 0x7f8ff4076080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009900 tx=0x7f8fe002a410 comp rx=0 tx=0).stop 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 -- 172.21.15.84:0/2325615577 shutdown_connections 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2325615577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff410b590 0x7f8ff410d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2325615577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 0x7f8ff4076080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2325615577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff4077060 0x7f8ff4075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 -- 172.21.15.84:0/2325615577 >> 172.21.15.84:0/2325615577 conn(0x7f8ff40feec0 msgr2=0x7f8ff4101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 -- 172.21.15.84:0/2325615577 shutdown_connections 2024-09-21T02:33:12.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.398+0000 7f8ffa800640 1 -- 172.21.15.84:0/2325615577 wait complete. 2024-09-21T02:33:12.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.399+0000 7f8ffa800640 1 Processor -- start 2024-09-21T02:33:12.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.399+0000 7f8ffa800640 1 -- start start 2024-09-21T02:33:12.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ffa800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 0x7f8ff419c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:12.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ffa800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff4077060 0x7f8ff419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:12.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ffa800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff410b590 0x7f8ff419d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:12.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ffa800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4111530 con 0x7f8ff4075c70 2024-09-21T02:33:12.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ffa800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41113b0 con 0x7f8ff410b590 2024-09-21T02:33:12.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ffa800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41116b0 con 0x7f8ff4077060 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 0x7f8ff419c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff410b590 0x7f8ff419d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 0x7f8ff419c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53910/0 (socket says 172.21.15.84:53910) 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9400640 1 -- 172.21.15.84:0/2253171128 learned_addr learned my addr 172.21.15.84:0/2253171128 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff8a00640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff4077060 0x7f8ff419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9400640 1 -- 172.21.15.84:0/2253171128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff4077060 msgr2=0x7f8ff419c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9400640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff4077060 0x7f8ff419c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9400640 1 -- 172.21.15.84:0/2253171128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff410b590 msgr2=0x7f8ff419d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9400640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff410b590 0x7f8ff419d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9400640 1 -- 172.21.15.84:0/2253171128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff419daf0 con 0x7f8ff4075c70 2024-09-21T02:33:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.400+0000 7f8ff9e00640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff410b590 0x7f8ff419d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.401+0000 7f8ff9400640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 0x7f8ff419c0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800e9f0 tx=0x7f8fe800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.401+0000 7f8ff2000640 1 -- 172.21.15.84:0/2253171128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe800cd80 con 0x7f8ff4075c70 2024-09-21T02:33:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.401+0000 7f8ff2000640 1 -- 172.21.15.84:0/2253171128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8fe80054f0 con 0x7f8ff4075c70 2024-09-21T02:33:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.401+0000 7f8ff2000640 1 -- 172.21.15.84:0/2253171128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8010690 con 0x7f8ff4075c70 2024-09-21T02:33:12.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.401+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff419dde0 con 0x7f8ff4075c70 2024-09-21T02:33:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.401+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff41a44e0 con 0x7f8ff4075c70 2024-09-21T02:33:12.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.403+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff4109c90 con 0x7f8ff4075c70 2024-09-21T02:33:12.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.405+0000 7f8ff2000640 1 -- 172.21.15.84:0/2253171128 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f8fe80046c0 con 0x7f8ff4075c70 2024-09-21T02:33:12.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.406+0000 7f8ff2000640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8fdc0b6500 0x7f8fdc0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.407+0000 7f8ff2000640 1 -- 172.21.15.84:0/2253171128 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8fe80e59a0 con 0x7f8ff4075c70 2024-09-21T02:33:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.407+0000 7f8ff8a00640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8fdc0b6500 0x7f8fdc0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:12.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.407+0000 7f8ff8a00640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8fdc0b6500 0x7f8fdc0b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0004770 tx=0x7f8fe0031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:12.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.411+0000 7f8ff2000640 1 -- 172.21.15.84:0/2253171128 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fe80ade60 con 0x7f8ff4075c70 2024-09-21T02:33:12.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.595+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8ff4063fc0 con 0x7f8ff4075c70 2024-09-21T02:33:12.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.596+0000 7f8ff2000640 1 -- 172.21.15.84:0/2253171128 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21315 (secure 0 0 0) 0x7f8fe80b2240 con 0x7f8ff4075c70 2024-09-21T02:33:12.598 INFO:teuthology.orchestra.run.smithi084.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T02:33:12.598 INFO:teuthology.orchestra.run.smithi084.stdout:global dev auth_debug true 2024-09-21T02:33:12.598 INFO:teuthology.orchestra.run.smithi084.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_file true 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_journald false 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_stderr false 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_allow_pool_delete true 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T02:33:12.599 INFO:teuthology.orchestra.run.smithi084.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_bug true 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_old_message true 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_skipped_message false 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_mon 20/20 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_ms 1/1 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_paxos 20/20 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T02:33:12.600 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced client_mount_timeout 30 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_client 20/20 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_mgr 20/20 2024-09-21T02:33:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_ms 1/1 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bdev_debug_aio true 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_bluefs 20/20 2024-09-21T02:33:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_bluestore 20/20 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_ms 1/1 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_osd 20/20 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_op_order true 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_shutdown true 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T02:33:12.603 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T02:33:12.604 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds 20/20 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_ms 2/2 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_size 100 2024-09-21T02:33:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_frag true 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_scatterstat true 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_verify_scatter true 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced client_dirsize_rbytes false * 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced client_mount_timeout 600 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_client 20/20 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_ms 1/1 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T02:33:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T02:33:12.607 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T02:33:12.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8fdc0b6500 msgr2=0x7f8fdc0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:12.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8fdc0b6500 0x7f8fdc0b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0004770 tx=0x7f8fe0031510 comp rx=0 tx=0).stop 2024-09-21T02:33:12.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 msgr2=0x7f8ff419c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:12.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 0x7f8ff419c0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800e9f0 tx=0x7f8fe800edf0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 shutdown_connections 2024-09-21T02:33:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8fdc0b6500 0x7f8fdc0b8a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ff4077060 0x7f8ff419c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff410b590 0x7f8ff419d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 --2- 172.21.15.84:0/2253171128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4075c70 0x7f8ff419c0c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 >> 172.21.15.84:0/2253171128 conn(0x7f8ff40feec0 msgr2=0x7f8ff4101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 shutdown_connections 2024-09-21T02:33:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:12.599+0000 7f8ffa800640 1 -- 172.21.15.84:0/2253171128 wait complete. 2024-09-21T02:33:12.998 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:12 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2253171128' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:33:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:12 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2253171128' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:33:13.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:12 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2253171128' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T02:33:13.304 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T02:33:13.304 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:33:13.304 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:33:13.340 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:33:13.340 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-09-21T02:33:13.416 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:33:13.416 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:13.416 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-21T02:33:13.416 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:13.416 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:13.416 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 02:31:57.791641371 +0000 2024-09-21T02:33:13.416 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 02:27:02.423413316 +0000 2024-09-21T02:33:13.416 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 02:27:02.423413316 +0000 2024-09-21T02:33:13.417 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 02:27:02.423413316 +0000 2024-09-21T02:33:13.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:33:13.509 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T02:33:13.509 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T02:33:13.510 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000316683 s, 1.6 MB/s 2024-09-21T02:33:13.512 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:33:13.548 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 02:31:57.837640535 +0000 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 02:27:02.906404467 +0000 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 02:27:02.906404467 +0000 2024-09-21T02:33:13.624 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 02:27:02.906404467 +0000 2024-09-21T02:33:13.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:33:13.716 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T02:33:13.716 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T02:33:13.716 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000309141 s, 1.7 MB/s 2024-09-21T02:33:13.719 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:33:13.756 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 02:31:57.882639716 +0000 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 02:27:03.385395691 +0000 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 02:27:03.385395691 +0000 2024-09-21T02:33:13.832 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 02:27:03.385395691 +0000 2024-09-21T02:33:13.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:33:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T02:33:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T02:33:13.924 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000307965 s, 1.7 MB/s 2024-09-21T02:33:13.927 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:33:13.963 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-09-21T02:33:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:13 smithi172 ceph-mon[35067]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:14.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:13 smithi084 ceph-mon[30747]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:14.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:13 smithi090 ceph-mon[34571]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:14.038 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:33:14.038 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:14.038 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-09-21T02:33:14.038 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:14.039 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:14.039 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 02:31:57.929638862 +0000 2024-09-21T02:33:14.039 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 02:27:03.837387410 +0000 2024-09-21T02:33:14.039 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 02:27:03.837387410 +0000 2024-09-21T02:33:14.039 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 02:27:03.837387410 +0000 2024-09-21T02:33:14.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:33:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T02:33:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T02:33:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000276191 s, 1.9 MB/s 2024-09-21T02:33:14.133 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:33:14.169 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-09-21T02:33:14.169 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:33:14.189 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:33:14.189 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-09-21T02:33:14.247 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:33:14.247 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:14.247 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T02:33:14.247 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:14.248 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:14.248 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 02:32:46.031988339 +0000 2024-09-21T02:33:14.248 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 02:26:33.798407865 +0000 2024-09-21T02:33:14.248 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 02:26:33.798407865 +0000 2024-09-21T02:33:14.248 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 02:26:33.798407865 +0000 2024-09-21T02:33:14.248 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:33:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T02:33:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T02:33:14.317 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000290722 s, 1.8 MB/s 2024-09-21T02:33:14.318 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:33:14.377 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-09-21T02:33:14.434 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:33:14.434 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:14.434 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T02:33:14.434 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:14.434 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:14.434 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 02:32:46.031988339 +0000 2024-09-21T02:33:14.434 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 02:26:34.124402639 +0000 2024-09-21T02:33:14.435 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 02:26:34.124402639 +0000 2024-09-21T02:33:14.435 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 02:26:34.124402639 +0000 2024-09-21T02:33:14.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:33:14.500 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T02:33:14.501 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T02:33:14.501 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000209666 s, 2.4 MB/s 2024-09-21T02:33:14.502 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:33:14.560 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-09-21T02:33:14.616 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:33:14.616 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:14.616 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T02:33:14.616 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:14.617 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:14.617 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 02:32:46.031988339 +0000 2024-09-21T02:33:14.617 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 02:26:34.456397316 +0000 2024-09-21T02:33:14.617 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 02:26:34.456397316 +0000 2024-09-21T02:33:14.617 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 02:26:34.456397316 +0000 2024-09-21T02:33:14.617 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:33:14.682 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T02:33:14.682 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T02:33:14.682 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000191643 s, 2.7 MB/s 2024-09-21T02:33:14.683 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:33:14.741 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-09-21 02:32:46.032988323 +0000 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-09-21 02:26:34.769392298 +0000 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-09-21 02:26:34.769392298 +0000 2024-09-21T02:33:14.797 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-09-21 02:26:34.769392298 +0000 2024-09-21T02:33:14.798 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:33:14.861 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-09-21T02:33:14.861 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-09-21T02:33:14.861 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000199425 s, 2.6 MB/s 2024-09-21T02:33:14.862 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:33:14.919 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T02:33:14.920 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T02:33:14.940 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T02:33:14.940 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-21T02:33:14.998 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T02:33:14.999 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:14.999 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T02:33:14.999 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:14.999 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:14.999 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-21 02:32:43.792312627 +0000 2024-09-21T02:33:14.999 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-21 02:26:32.329939625 +0000 2024-09-21T02:33:14.999 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-21 02:26:32.329939625 +0000 2024-09-21T02:33:14.999 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-21 02:26:32.329939625 +0000 2024-09-21T02:33:14.999 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T02:33:15.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-21T02:33:15.070 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-21T02:33:15.070 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000327137 s, 1.6 MB/s 2024-09-21T02:33:15.071 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T02:33:15.130 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-21T02:33:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T02:33:15.188 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:15.188 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T02:33:15.188 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:15.188 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:15.188 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-21 02:32:43.793312603 +0000 2024-09-21T02:33:15.189 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-21 02:26:32.664931331 +0000 2024-09-21T02:33:15.189 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-21 02:26:32.664931331 +0000 2024-09-21T02:33:15.189 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-21 02:26:32.664931331 +0000 2024-09-21T02:33:15.189 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T02:33:15.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-21T02:33:15.254 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-21T02:33:15.254 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000184226 s, 2.8 MB/s 2024-09-21T02:33:15.256 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T02:33:15.315 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-21T02:33:15.371 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T02:33:15.371 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:15.371 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T02:33:15.372 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:15.372 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:15.372 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-21 02:32:43.793312603 +0000 2024-09-21T02:33:15.372 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-21 02:26:32.987923335 +0000 2024-09-21T02:33:15.372 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-21 02:26:32.987923335 +0000 2024-09-21T02:33:15.372 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-21 02:26:32.987923335 +0000 2024-09-21T02:33:15.372 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T02:33:15.437 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-21T02:33:15.437 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-21T02:33:15.437 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000199076 s, 2.6 MB/s 2024-09-21T02:33:15.438 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T02:33:15.496 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-21T02:33:15.552 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T02:33:15.553 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T02:33:15.553 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-21T02:33:15.553 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:33:15.553 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T02:33:15.553 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-21 02:32:43.793312603 +0000 2024-09-21T02:33:15.553 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-21 02:26:33.312915290 +0000 2024-09-21T02:33:15.553 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-21 02:26:33.312915290 +0000 2024-09-21T02:33:15.553 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-21 02:26:33.312915290 +0000 2024-09-21T02:33:15.553 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T02:33:15.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-21T02:33:15.617 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-21T02:33:15.617 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000212616 s, 2.4 MB/s 2024-09-21T02:33:15.618 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T02:33:15.676 INFO:tasks.cephadm:Deploying osd.0 on smithi084 with /dev/vg_nvme/lv_4... 2024-09-21T02:33:15.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:33:16.037 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:16.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:16 smithi084 ceph-mon[30747]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:16 smithi172 ceph-mon[35067]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:17.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:16 smithi090 ceph-mon[34571]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:18.972 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:18 smithi084 ceph-mon[30747]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:18.979 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:33:19.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:18 smithi172 ceph-mon[35067]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:19.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-09-21T02:33:19.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:18 smithi090 ceph-mon[34571]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:33:19.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.942+0000 7f90f1e00640 1 -- 172.21.15.84:0/2542784180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec104870 msgr2=0x7f90ec104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:19.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.942+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2542784180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec104870 0x7f90ec104c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009900 tx=0x7f90d402a480 comp rx=0 tx=0).stop 2024-09-21T02:33:19.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.942+0000 7f90f1e00640 1 -- 172.21.15.84:0/2542784180 shutdown_connections 2024-09-21T02:33:19.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.942+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2542784180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90ec105210 0x7f90ec10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:19.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.942+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2542784180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec104870 0x7f90ec104c80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:19.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.942+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2542784180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec1037e0 0x7f90ec103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:19.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.942+0000 7f90f1e00640 1 -- 172.21.15.84:0/2542784180 >> 172.21.15.84:0/2542784180 conn(0x7f90ec0ff150 msgr2=0x7f90ec101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:19.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.942+0000 7f90f1e00640 1 -- 172.21.15.84:0/2542784180 shutdown_connections 2024-09-21T02:33:19.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.943+0000 7f90f1e00640 1 -- 172.21.15.84:0/2542784180 wait complete. 2024-09-21T02:33:19.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.944+0000 7f90f1e00640 1 Processor -- start 2024-09-21T02:33:19.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.944+0000 7f90f1e00640 1 -- start start 2024-09-21T02:33:19.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.944+0000 7f90f1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90ec1037e0 0x7f90ec19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:19.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.944+0000 7f90f1e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec104870 0x7f90ec19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:19.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.944+0000 7f90f1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec105210 0x7f90ec19b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:19.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.944+0000 7f90f1e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec10f4f0 con 0x7f90ec105210 2024-09-21T02:33:19.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.944+0000 7f90f1e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec10f370 con 0x7f90ec1037e0 2024-09-21T02:33:19.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.944+0000 7f90f1e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec10f670 con 0x7f90ec104870 2024-09-21T02:33:19.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90e3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec104870 0x7f90ec19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:19.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90eaa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90ec1037e0 0x7f90ec19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:19.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90eb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec105210 0x7f90ec19b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:19.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90e3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec104870 0x7f90ec19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:33980/0 (socket says 172.21.15.84:33980) 2024-09-21T02:33:19.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90e3e00640 1 -- 172.21.15.84:0/2817704945 learned_addr learned my addr 172.21.15.84:0/2817704945 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:33:19.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90eaa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90ec1037e0 0x7f90ec19a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:38756/0 (socket says 172.21.15.84:38756) 2024-09-21T02:33:19.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90e3e00640 1 -- 172.21.15.84:0/2817704945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90ec1037e0 msgr2=0x7f90ec19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90e3e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90ec1037e0 0x7f90ec19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90e3e00640 1 -- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec105210 msgr2=0x7f90ec19b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90e3e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec105210 0x7f90ec19b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90e3e00640 1 -- 172.21.15.84:0/2817704945 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec19bac0 con 0x7f90ec104870 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.945+0000 7f90eb400640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec105210 0x7f90ec19b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.946+0000 7f90e3e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec104870 0x7f90ec19a700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f90d4004770 tx=0x7f90d40042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.946+0000 7f90f0a00640 1 -- 172.21.15.84:0/2817704945 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d403f030 con 0x7f90ec104870 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.946+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec19bd50 con 0x7f90ec104870 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.946+0000 7f90f0a00640 1 -- 172.21.15.84:0/2817704945 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f90d4003cd0 con 0x7f90ec104870 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.946+0000 7f90f0a00640 1 -- 172.21.15.84:0/2817704945 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d4035070 con 0x7f90ec104870 2024-09-21T02:33:19.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.946+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec1a24b0 con 0x7f90ec104870 2024-09-21T02:33:19.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.947+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec103c50 con 0x7f90ec104870 2024-09-21T02:33:19.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.949+0000 7f90f0a00640 1 -- 172.21.15.84:0/2817704945 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f90d4042030 con 0x7f90ec104870 2024-09-21T02:33:19.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.951+0000 7f90f0a00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90d00b6480 0x7f90d00b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:19.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.951+0000 7f90f0a00640 1 -- 172.21.15.84:0/2817704945 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f90d4105e40 con 0x7f90ec104870 2024-09-21T02:33:19.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.951+0000 7f90eaa00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90d00b6480 0x7f90d00b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:19.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.951+0000 7f90eaa00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90d00b6480 0x7f90d00b8990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009bd0 tx=0x7f90dc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:19.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:19.953+0000 7f90f0a00640 1 -- 172.21.15.84:0/2817704945 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90d40d26e0 con 0x7f90ec104870 2024-09-21T02:33:20.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:20.148+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f90ec063800 con 0x7f90d00b6480 2024-09-21T02:33:20.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:20 smithi084 ceph-mon[30747]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:20.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:33:20.894 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:33:20.895 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:21.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:20 smithi172 ceph-mon[35067]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:21.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:33:21.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:33:21.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:21.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:20 smithi090 ceph-mon[34571]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:21.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:33:21.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:33:21.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:21.672 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:21 smithi084 ceph-mon[30747]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:21 smithi172 ceph-mon[35067]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:22.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:21 smithi090 ceph-mon[34571]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:23.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:22 smithi172 ceph-mon[35067]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:23.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:22 smithi084 ceph-mon[30747]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:23.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:22 smithi090 ceph-mon[34571]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:23.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:23 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3509104434' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d5e3c2be-3797-41fc-ad09-a84eaae5cd87"} : dispatch 2024-09-21T02:33:23.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:23 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3509104434' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5e3c2be-3797-41fc-ad09-a84eaae5cd87"}]': finished 2024-09-21T02:33:23.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:23 smithi084 ceph-mon[30747]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:33:23.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:23 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:23.907 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:23 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3509104434' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d5e3c2be-3797-41fc-ad09-a84eaae5cd87"} : dispatch 2024-09-21T02:33:23.907 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:23 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3509104434' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5e3c2be-3797-41fc-ad09-a84eaae5cd87"}]': finished 2024-09-21T02:33:23.908 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:23 smithi172 ceph-mon[35067]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:33:23.908 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:23 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:23 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3509104434' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d5e3c2be-3797-41fc-ad09-a84eaae5cd87"} : dispatch 2024-09-21T02:33:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:23 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3509104434' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5e3c2be-3797-41fc-ad09-a84eaae5cd87"}]': finished 2024-09-21T02:33:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:23 smithi090 ceph-mon[34571]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T02:33:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:23 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:25.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:24 smithi172 ceph-mon[35067]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:25.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:24 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2154129300' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:33:25.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:24 smithi084 ceph-mon[30747]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:25.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:24 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2154129300' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:33:25.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:24 smithi090 ceph-mon[34571]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:25.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:24 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2154129300' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:33:27.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:26 smithi172 ceph-mon[35067]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:27.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:26 smithi084 ceph-mon[30747]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:27.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:26 smithi090 ceph-mon[34571]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:27.918 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:27 smithi090 ceph-mon[34571]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:27.959 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:27 smithi084 ceph-mon[30747]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:27 smithi172 ceph-mon[35067]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:30.761 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:30 smithi084 ceph-mon[30747]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:31.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:30 smithi172 ceph-mon[35067]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:31.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:30 smithi090 ceph-mon[34571]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:32.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:32 smithi084 ceph-mon[30747]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:32.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:33:32.871 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:32 smithi172 ceph-mon[35067]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:33:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:32 smithi090 ceph-mon[34571]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T02:33:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:33.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:33 smithi084 ceph-mon[30747]: Deploying daemon osd.0 on smithi084 2024-09-21T02:33:34.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:33 smithi172 ceph-mon[35067]: Deploying daemon osd.0 on smithi084 2024-09-21T02:33:34.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:33 smithi090 ceph-mon[34571]: Deploying daemon osd.0 on smithi084 2024-09-21T02:33:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:34 smithi084 ceph-mon[30747]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:35.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:34 smithi172 ceph-mon[35067]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:35.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:34 smithi090 ceph-mon[34571]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:36.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:36 smithi084 ceph-mon[30747]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:37.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:36 smithi172 ceph-mon[35067]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:37.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:36 smithi090 ceph-mon[34571]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:38.911 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:38 smithi084 ceph-mon[30747]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:39.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:38 smithi172 ceph-mon[35067]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:39.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:38 smithi090 ceph-mon[34571]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:39.889 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:39 smithi084 ceph-mon[30747]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:40.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:39 smithi172 ceph-mon[35067]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:40.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:39 smithi090 ceph-mon[34571]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:41.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:42.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:41 smithi084 ceph-mon[30747]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:42.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:41 smithi172 ceph-mon[35067]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:42.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:41 smithi090 ceph-mon[34571]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:44 smithi172 ceph-mon[35067]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:44 smithi084 ceph-mon[30747]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:45.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:44 smithi090 ceph-mon[34571]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:45.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:45.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:45.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:45.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:45.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:46.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.138+0000 7f90f0a00640 1 -- 172.21.15.84:0/2817704945 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f90ec063800 con 0x7f90d00b6480 2024-09-21T02:33:46.140 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 0 on host 'smithi084' 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90d00b6480 msgr2=0x7f90d00b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90d00b6480 0x7f90d00b8990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009bd0 tx=0x7f90dc005f90 comp rx=0 tx=0).stop 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec104870 msgr2=0x7f90ec19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec104870 0x7f90ec19a700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f90d4004770 tx=0x7f90d40042f0 comp rx=0 tx=0).stop 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 shutdown_connections 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90d00b6480 0x7f90d00b8990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ec104870 0x7f90ec19a700 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90ec105210 0x7f90ec19b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 --2- 172.21.15.84:0/2817704945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90ec1037e0 0x7f90ec19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.141+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 >> 172.21.15.84:0/2817704945 conn(0x7f90ec0ff150 msgr2=0x7f90ec107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:46.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.142+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 shutdown_connections 2024-09-21T02:33:46.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:33:46.142+0000 7f90f1e00640 1 -- 172.21.15.84:0/2817704945 wait complete. 2024-09-21T02:33:46.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:46 smithi084 ceph-mon[30747]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:46.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:46.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:46.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:46.874 DEBUG:teuthology.orchestra.run.smithi084:osd.0> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T02:33:46.878 INFO:tasks.cephadm:Deploying osd.1 on smithi090 with /dev/vg_nvme/lv_4... 2024-09-21T02:33:46.878 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:33:46.905 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:46 smithi090 ceph-mon[34571]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:46.905 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:46.905 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:46.905 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:46 smithi172 ceph-mon[35067]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:47.078 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:33:47.078 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:47.078 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:47.128 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:33:47.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:47 smithi084 ceph-mon[30747]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:33:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:47 smithi172 ceph-mon[35067]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:33:48.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:47 smithi090 ceph-mon[34571]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T02:33:48.714 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:48 smithi084 ceph-mon[30747]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:48.714 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:48 smithi084 ceph-mon[30747]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:33:48.714 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:48 smithi084 ceph-mon[30747]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:33:48.714 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:48 smithi084 ceph-mon[30747]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:33:48.714 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:48 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:48.714 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:33:48 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0[46140]: 2024-09-21T02:33:48.584+0000 7fca10e00640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T02:33:48.714 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:33:48 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0[46140]: 2024-09-21T02:33:48.587+0000 7fca0be00640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:33:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:48 smithi172 ceph-mon[35067]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:48 smithi172 ceph-mon[35067]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:33:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:48 smithi172 ceph-mon[35067]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:33:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:48 smithi172 ceph-mon[35067]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:33:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:48 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:48 smithi090 ceph-mon[34571]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:48 smithi090 ceph-mon[34571]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T02:33:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:48 smithi090 ceph-mon[34571]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T02:33:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:48 smithi090 ceph-mon[34571]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:33:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:48 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:49.401 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:33:49.426 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi090:vg_nvme/lv_4 2024-09-21T02:33:49.717 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:33:49.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:49 smithi090 ceph-mon[34571]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:33:49.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:49 smithi090 ceph-mon[34571]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:33:49.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:49 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:49.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:49 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:50.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:49 smithi172 ceph-mon[35067]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:33:50.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:49 smithi172 ceph-mon[35067]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:33:50.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:49 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:50.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:49 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:49 smithi084 ceph-mon[30747]: from='osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:33:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:49 smithi084 ceph-mon[30747]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T02:33:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:49 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:49 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:50.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 -- 172.21.15.90:0/3394138821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 msgr2=0x7f5f28102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:50.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/3394138821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 0x7f5f28102ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c009900 tx=0x7f5f1c02a480 comp rx=0 tx=0).stop 2024-09-21T02:33:50.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 -- 172.21.15.90:0/3394138821 shutdown_connections 2024-09-21T02:33:50.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/3394138821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f281040a0 0x7f5f2810aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:50.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/3394138821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f28103700 0x7f5f28103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:50.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/3394138821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 0x7f5f28102ae0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 -- 172.21.15.90:0/3394138821 >> 172.21.15.90:0/3394138821 conn(0x7f5f280fe000 msgr2=0x7f5f28100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 -- 172.21.15.90:0/3394138821 shutdown_connections 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.146+0000 7f5f2edeb640 1 -- 172.21.15.90:0/3394138821 wait complete. 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2edeb640 1 Processor -- start 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2edeb640 1 -- start start 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2edeb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 0x7f5f28198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2edeb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f28103700 0x7f5f28199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2edeb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f281040a0 0x7f5f2819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2edeb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2810e3f0 con 0x7f5f28103700 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2edeb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2810e270 con 0x7f5f28102670 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2edeb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2810e570 con 0x7f5f281040a0 2024-09-21T02:33:50.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2cb87640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 0x7f5f28198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2cb87640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 0x7f5f28198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42324/0 (socket says 172.21.15.90:42324) 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2cb87640 1 -- 172.21.15.90:0/273026687 learned_addr learned my addr 172.21.15.90:0/273026687 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f27fff640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f28103700 0x7f5f28199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.147+0000 7f5f2d388640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f281040a0 0x7f5f2819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f2cb87640 1 -- 172.21.15.90:0/273026687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f281040a0 msgr2=0x7f5f2819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f2cb87640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f281040a0 0x7f5f2819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f2cb87640 1 -- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f28103700 msgr2=0x7f5f28199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f2cb87640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f28103700 0x7f5f28199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f2cb87640 1 -- 172.21.15.90:0/273026687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2819a9c0 con 0x7f5f28102670 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f2cb87640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 0x7f5f28198f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006010 tx=0x7f5f1c004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:50.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f25ffb640 1 -- 172.21.15.90:0/273026687 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c03f030 con 0x7f5f28102670 2024-09-21T02:33:50.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f25ffb640 1 -- 172.21.15.90:0/273026687 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f1c003cd0 con 0x7f5f28102670 2024-09-21T02:33:50.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f25ffb640 1 -- 172.21.15.90:0/273026687 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c035070 con 0x7f5f28102670 2024-09-21T02:33:50.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2819ac50 con 0x7f5f28102670 2024-09-21T02:33:50.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.148+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f281a11e0 con 0x7f5f28102670 2024-09-21T02:33:50.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.149+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f28109850 con 0x7f5f28102670 2024-09-21T02:33:50.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.151+0000 7f5f25ffb640 1 -- 172.21.15.90:0/273026687 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5f1c042030 con 0x7f5f28102670 2024-09-21T02:33:50.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.152+0000 7f5f25ffb640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f180b6500 0x7f5f180b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:33:50.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.152+0000 7f5f27fff640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f180b6500 0x7f5f180b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:33:50.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.152+0000 7f5f25ffb640 1 -- 172.21.15.90:0/273026687 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f5f1c106220 con 0x7f5f28102670 2024-09-21T02:33:50.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.153+0000 7f5f27fff640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f180b6500 0x7f5f180b8a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400bbe0 tx=0x7f5f1400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:33:50.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.156+0000 7f5f25ffb640 1 -- 172.21.15.90:0/273026687 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f1c0ce520 con 0x7f5f28102670 2024-09-21T02:33:50.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:33:50.350+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5f28063800 con 0x7f5f180b6500 2024-09-21T02:33:50.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:33:50.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:33:50.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:50.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] boot 2024-09-21T02:33:50.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:33:50.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi084 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi084 to 17089M 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:50.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:50.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:50.847 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:33:50.847 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] boot 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi084 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi084 to 17089M 2024-09-21T02:33:50.848 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:50.849 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:50.849 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:50.849 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:33:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:33:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T02:33:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: osd.0 [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] boot 2024-09-21T02:33:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T02:33:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T02:33:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi084 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi084 to 17089M 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:33:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:33:51.652 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:51 smithi090 ceph-mon[34571]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:33:51.652 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:51 smithi090 ceph-mon[34571]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:51 smithi172 ceph-mon[35067]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:33:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:51 smithi172 ceph-mon[35067]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:51 smithi084 ceph-mon[30747]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T02:33:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:51 smithi084 ceph-mon[30747]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:52.961 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:52 smithi090 ceph-mon[34571]: from='client.? 172.21.15.90:0/754378343' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"} : dispatch 2024-09-21T02:33:52.961 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:52 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"} : dispatch 2024-09-21T02:33:52.961 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:52 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"}]': finished 2024-09-21T02:33:52.961 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:52 smithi090 ceph-mon[34571]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:33:52.961 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:52 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:33:53.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:52 smithi172 ceph-mon[35067]: from='client.? 172.21.15.90:0/754378343' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"} : dispatch 2024-09-21T02:33:53.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:52 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"} : dispatch 2024-09-21T02:33:53.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:52 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"}]': finished 2024-09-21T02:33:53.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:52 smithi172 ceph-mon[35067]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:33:53.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:52 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:33:53.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:52 smithi084 ceph-mon[30747]: from='client.? 172.21.15.90:0/754378343' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"} : dispatch 2024-09-21T02:33:53.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:52 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"} : dispatch 2024-09-21T02:33:53.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:52 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "04282e2a-4e57-4b6a-9e35-2acbf64bc65f"}]': finished 2024-09-21T02:33:53.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:52 smithi084 ceph-mon[30747]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T02:33:53.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:52 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:33:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:53 smithi172 ceph-mon[35067]: from='client.? 172.21.15.90:0/3740721059' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:33:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:53 smithi172 ceph-mon[35067]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:54.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:53 smithi084 ceph-mon[30747]: from='client.? 172.21.15.90:0/3740721059' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:33:54.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:53 smithi084 ceph-mon[30747]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:54.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:53 smithi090 ceph-mon[34571]: from='client.? 172.21.15.90:0/3740721059' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:33:54.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:53 smithi090 ceph-mon[34571]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:57.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:56 smithi172 ceph-mon[35067]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:57.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:56 smithi084 ceph-mon[30747]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:57.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:56 smithi090 ceph-mon[34571]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:58.747 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:33:58 smithi090 ceph-mon[34571]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:33:58 smithi084 ceph-mon[30747]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:33:59.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:33:58 smithi172 ceph-mon[35067]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:00.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:00 smithi084 ceph-mon[30747]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:00.864 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:00 smithi090 ceph-mon[34571]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:01.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:00 smithi172 ceph-mon[35067]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:01.922 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:34:01.922 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:02.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:34:02.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:02.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T02:34:02.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:02.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:02 smithi090 ceph-mon[34571]: Deploying daemon osd.1 on smithi090 2024-09-21T02:34:02.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:02 smithi090 ceph-mon[34571]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:03.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:02 smithi172 ceph-mon[35067]: Deploying daemon osd.1 on smithi090 2024-09-21T02:34:03.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:02 smithi172 ceph-mon[35067]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:03.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:02 smithi084 ceph-mon[30747]: Deploying daemon osd.1 on smithi090 2024-09-21T02:34:03.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:02 smithi084 ceph-mon[30747]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:04 smithi172 ceph-mon[35067]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:05.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:04 smithi084 ceph-mon[30747]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:04 smithi090 ceph-mon[34571]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:05.958 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:05 smithi090 ceph-mon[34571]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:05 smithi172 ceph-mon[35067]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:05 smithi084 ceph-mon[30747]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:07.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:07.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:07.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:07.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:07.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:07.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:07.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:07.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:07.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:08.755 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:08 smithi090 ceph-mon[34571]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:08.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:08 smithi172 ceph-mon[35067]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:08.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:08 smithi084 ceph-mon[30747]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:10.964 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:10 smithi090 ceph-mon[34571]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:10.964 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:10.964 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:10.964 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:10.964 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:10.964 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:10 smithi172 ceph-mon[35067]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:11.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:10 smithi084 ceph-mon[30747]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:11.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:11.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:11.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:11.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:11.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:11.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.653+0000 7f5f25ffb640 1 -- 172.21.15.90:0/273026687 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5f28063800 con 0x7f5f180b6500 2024-09-21T02:34:11.654 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 1 on host 'smithi090' 2024-09-21T02:34:11.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f180b6500 msgr2=0x7f5f180b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:11.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f180b6500 0x7f5f180b8a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400bbe0 tx=0x7f5f1400b390 comp rx=0 tx=0).stop 2024-09-21T02:34:11.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 msgr2=0x7f5f28198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:11.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 0x7f5f28198f90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006010 tx=0x7f5f1c004430 comp rx=0 tx=0).stop 2024-09-21T02:34:11.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 shutdown_connections 2024-09-21T02:34:11.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5f180b6500 0x7f5f180b8a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f281040a0 0x7f5f2819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f28103700 0x7f5f28199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 --2- 172.21.15.90:0/273026687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f28102670 0x7f5f28198f90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:11.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 >> 172.21.15.90:0/273026687 conn(0x7f5f280fe000 msgr2=0x7f5f28106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:11.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 shutdown_connections 2024-09-21T02:34:11.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:34:11.656+0000 7f5f2edeb640 1 -- 172.21.15.90:0/273026687 wait complete. 2024-09-21T02:34:12.283 DEBUG:teuthology.orchestra.run.smithi090:osd.1> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T02:34:12.285 INFO:tasks.cephadm:Deploying osd.2 on smithi172 with /dev/vg_nvme/lv_4... 2024-09-21T02:34:12.285 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T02:34:12.535 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:34:12.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:12 smithi172 ceph-mon[35067]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:12.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:12.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:12.655 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:13.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:12 smithi084 ceph-mon[30747]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:13.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:13.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:13.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:13.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:12 smithi090 ceph-mon[34571]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:13.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:13.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:13.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:13.517 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:13 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1[38510]: 2024-09-21T02:34:13.228+0000 7f5ff084f640 -1 osd.1 0 log_to_monitors true 2024-09-21T02:34:13.813 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:13 smithi090 ceph-mon[34571]: from='osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:34:13.813 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:13 smithi090 ceph-mon[34571]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:34:13.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:13 smithi172 ceph-mon[35067]: from='osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:34:13.876 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:13 smithi172 ceph-mon[35067]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:34:14.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:13 smithi084 ceph-mon[30747]: from='osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:34:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:13 smithi084 ceph-mon[30747]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T02:34:14.701 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:14 smithi090 ceph-mon[34571]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:14.701 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:14 smithi090 ceph-mon[34571]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:34:14.701 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:14 smithi090 ceph-mon[34571]: from='osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:34:14.701 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:14 smithi090 ceph-mon[34571]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:34:14.702 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:14 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:14.702 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:14 smithi090 ceph-mon[34571]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:34:14.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:14 smithi172 ceph-mon[35067]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:14.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:14 smithi172 ceph-mon[35067]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:34:14.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:14 smithi172 ceph-mon[35067]: from='osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:34:14.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:14 smithi172 ceph-mon[35067]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:34:14.833 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:14 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:14.834 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:14 smithi172 ceph-mon[35067]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:34:14.971 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:34:14.998 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-09-21T02:34:15.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:14 smithi084 ceph-mon[30747]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:15.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:14 smithi084 ceph-mon[30747]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T02:34:15.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:14 smithi084 ceph-mon[30747]: from='osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:34:15.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:14 smithi084 ceph-mon[30747]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T02:34:15.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:15.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:14 smithi084 ceph-mon[30747]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:34:15.265 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:34:15.575 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1[38510]: 2024-09-21T02:34:15.288+0000 7f5fec7d1640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T02:34:15.575 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1[38510]: 2024-09-21T02:34:15.292+0000 7f5fe45c7640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi090 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:34:15.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi090 to 17088M 2024-09-21T02:34:15.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:15.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:15.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:15.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:15.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: from='osd.1 ' entity='osd.1' 2024-09-21T02:34:15.640 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:15 smithi172 ceph-mon[35067]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 -- 172.21.15.172:0/465751361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 msgr2=0x7f78f410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 --2- 172.21.15.172:0/465751361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 0x7f78f410aa10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009ca0 tx=0x7f78ec02a950 comp rx=0 tx=0).stop 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 -- 172.21.15.172:0/465751361 shutdown_connections 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 --2- 172.21.15.172:0/465751361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 0x7f78f410aa10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 --2- 172.21.15.172:0/465751361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f41036d0 0x7f78f4103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 --2- 172.21.15.172:0/465751361 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78f4102640 0x7f78f4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 -- 172.21.15.172:0/465751361 >> 172.21.15.172:0/465751361 conn(0x7f78f40fdfb0 msgr2=0x7f78f4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 -- 172.21.15.172:0/465751361 shutdown_connections 2024-09-21T02:34:15.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 -- 172.21.15.172:0/465751361 wait complete. 2024-09-21T02:34:15.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.645+0000 7f78facc6640 1 Processor -- start 2024-09-21T02:34:15.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78facc6640 1 -- start start 2024-09-21T02:34:15.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78facc6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f4102640 0x7f78f4198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:15.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78facc6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78f41036d0 0x7f78f4199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:15.648 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78facc6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 0x7f78f419a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78facc6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f78f410e3c0 con 0x7f78f4102640 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78facc6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78f410e240 con 0x7f78f41036d0 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78facc6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78f410e540 con 0x7f78f4104070 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f9263640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 0x7f78f419a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f9263640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 0x7f78f419a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60224/0 (socket says 172.21.15.172:60224) 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f9263640 1 -- 172.21.15.172:0/3559557883 learned_addr learned my addr 172.21.15.172:0/3559557883 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f3fff640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78f41036d0 0x7f78f4199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f8a62640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f4102640 0x7f78f4198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f9263640 1 -- 172.21.15.172:0/3559557883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78f41036d0 msgr2=0x7f78f4199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f9263640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78f41036d0 0x7f78f4199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f9263640 1 -- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f4102640 msgr2=0x7f78f4198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:15.649 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f9263640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f4102640 0x7f78f4198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:15.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.646+0000 7f78f9263640 1 -- 172.21.15.172:0/3559557883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f419a8c0 con 0x7f78f4104070 2024-09-21T02:34:15.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.647+0000 7f78f9263640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 0x7f78f419a130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f78ec006010 tx=0x7f78ec02faa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:15.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.647+0000 7f78f1ffb640 1 -- 172.21.15.172:0/3559557883 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec034040 con 0x7f78f4104070 2024-09-21T02:34:15.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.647+0000 7f78f1ffb640 1 -- 172.21.15.172:0/3559557883 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78ec030910 con 0x7f78f4104070 2024-09-21T02:34:15.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.648+0000 7f78f1ffb640 1 -- 172.21.15.172:0/3559557883 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec004800 con 0x7f78f4104070 2024-09-21T02:34:15.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.648+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f419ab50 con 0x7f78f4104070 2024-09-21T02:34:15.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.648+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f41a1170 con 0x7f78f4104070 2024-09-21T02:34:15.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.649+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f4102ab0 con 0x7f78f4104070 2024-09-21T02:34:15.651 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.650+0000 7f78f1ffb640 1 -- 172.21.15.172:0/3559557883 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f78ec037020 con 0x7f78f4104070 2024-09-21T02:34:15.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.651+0000 7f78f1ffb640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f78e40b6350 0x7f78e40b8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:15.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.651+0000 7f78f1ffb640 1 -- 172.21.15.172:0/3559557883 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f78ec106810 con 0x7f78f4104070 2024-09-21T02:34:15.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.651+0000 7f78f8a62640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f78e40b6350 0x7f78e40b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:15.652 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.652+0000 7f78f8a62640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f78e40b6350 0x7f78e40b8860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009b60 tx=0x7f78e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:15.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.656+0000 7f78f1ffb640 1 -- 172.21.15.172:0/3559557883 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78ec04a060 con 0x7f78f4104070 2024-09-21T02:34:15.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:15.843+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f78f402ea10 con 0x7f78e40b6350 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi090 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:34:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi090 to 17088M 2024-09-21T02:34:16.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:16.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:16.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:16.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:16.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: from='osd.1 ' entity='osd.1' 2024-09-21T02:34:16.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:15 smithi084 ceph-mon[30747]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi090 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi090 to 17088M 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:16.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:16.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: from='osd.1 ' entity='osd.1' 2024-09-21T02:34:16.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:15 smithi090 ceph-mon[34571]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T02:34:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:34:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:34:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:34:17.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:34:17.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:17.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] boot 2024-09-21T02:34:17.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:34:17.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] boot 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:34:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: osd.1 [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] boot 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T02:34:17.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T02:34:17.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:17 smithi172 ceph-mon[35067]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:17 smithi084 ceph-mon[30747]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:18.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:17 smithi090 ceph-mon[34571]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:18.697 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:18 smithi172 ceph-mon[35067]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T02:34:18.697 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:18 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/2977801040' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"} : dispatch 2024-09-21T02:34:18.697 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:18 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"} : dispatch 2024-09-21T02:34:18.697 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:18 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"}]': finished 2024-09-21T02:34:18.697 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:18 smithi172 ceph-mon[35067]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:34:18.697 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:18 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:19.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:18 smithi084 ceph-mon[30747]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T02:34:19.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:18 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/2977801040' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"} : dispatch 2024-09-21T02:34:19.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:18 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"} : dispatch 2024-09-21T02:34:19.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:18 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"}]': finished 2024-09-21T02:34:19.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:18 smithi084 ceph-mon[30747]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:34:19.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:18 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:19.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:18 smithi090 ceph-mon[34571]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T02:34:19.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:18 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/2977801040' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"} : dispatch 2024-09-21T02:34:19.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:18 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"} : dispatch 2024-09-21T02:34:19.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:18 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44e5c979-386a-496f-97a0-6fd02825c725"}]': finished 2024-09-21T02:34:19.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:18 smithi090 ceph-mon[34571]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T02:34:19.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:18 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:19 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/2073215019' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:34:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:19 smithi172 ceph-mon[35067]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:20.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:19 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/2073215019' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:34:20.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:19 smithi084 ceph-mon[30747]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:20.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:19 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/2073215019' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:34:20.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:19 smithi090 ceph-mon[34571]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:23.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:22 smithi172 ceph-mon[35067]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:23.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:22 smithi084 ceph-mon[30747]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:23.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:22 smithi090 ceph-mon[34571]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:24.625 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:24 smithi172 ceph-mon[35067]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:25.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:24 smithi084 ceph-mon[30747]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:25.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:24 smithi090 ceph-mon[34571]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:26.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:26 smithi172 ceph-mon[35067]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:26.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:34:26.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:26 smithi084 ceph-mon[30747]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:34:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:27.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:26 smithi090 ceph-mon[34571]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:27.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:26 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T02:34:27.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:26 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:27.627 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:27 smithi172 ceph-mon[35067]: Deploying daemon osd.2 on smithi172 2024-09-21T02:34:27.918 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:27 smithi090 ceph-mon[34571]: Deploying daemon osd.2 on smithi172 2024-09-21T02:34:28.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:27 smithi084 ceph-mon[30747]: Deploying daemon osd.2 on smithi172 2024-09-21T02:34:28.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:28 smithi172 ceph-mon[35067]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:28.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:28 smithi084 ceph-mon[30747]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:28.934 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:28 smithi090 ceph-mon[34571]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:29 smithi172 ceph-mon[35067]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:29 smithi084 ceph-mon[30747]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:30.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:29 smithi090 ceph-mon[34571]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:32.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:32 smithi172 ceph-mon[35067]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:32.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:32.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:32.831 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:32 smithi084 ceph-mon[30747]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:33.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:32 smithi090 ceph-mon[34571]: pgmap v90: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:35.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:34 smithi172 ceph-mon[35067]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:35.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:34 smithi084 ceph-mon[30747]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:35.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:34 smithi090 ceph-mon[34571]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:35.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:35.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:35.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:35.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:35.838 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:36.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:36.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:36.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:36.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:36.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:36.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:36.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:36.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:36.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:36.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:36.510 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.508+0000 7f78f1ffb640 1 -- 172.21.15.172:0/3559557883 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f78e8011be0 con 0x7f78e40b6350 2024-09-21T02:34:36.510 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 2 on host 'smithi172' 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f78e40b6350 msgr2=0x7f78e40b8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f78e40b6350 0x7f78e40b8860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009b60 tx=0x7f78e8005f90 comp rx=0 tx=0).stop 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 msgr2=0x7f78f419a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 0x7f78f419a130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f78ec006010 tx=0x7f78ec02faa0 comp rx=0 tx=0).stop 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 shutdown_connections 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f78e40b6350 0x7f78e40b8860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78f4104070 0x7f78f419a130 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78f41036d0 0x7f78f4199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 --2- 172.21.15.172:0/3559557883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f78f4102640 0x7f78f4198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:36.513 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 >> 172.21.15.172:0/3559557883 conn(0x7f78f40fdfb0 msgr2=0x7f78f41069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:36.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 shutdown_connections 2024-09-21T02:34:36.514 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:34:36.511+0000 7f78facc6640 1 -- 172.21.15.172:0/3559557883 wait complete. 2024-09-21T02:34:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:36 smithi172 ceph-mon[35067]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:37.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:36 smithi084 ceph-mon[30747]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:37.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:37.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:37.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:37.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:36 smithi090 ceph-mon[34571]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:37.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:34:37.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:37.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:37.146 DEBUG:teuthology.orchestra.run.smithi172:osd.2> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T02:34:37.148 INFO:tasks.cephadm:Deploying osd.3 on smithi084 with /dev/vg_nvme/lv_3... 2024-09-21T02:34:37.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:34:37.516 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:37 smithi172 ceph-mon[35067]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:37.855 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:37 smithi084 ceph-mon[30747]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:37 smithi090 ceph-mon[34571]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:38.488 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:38 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2[39496]: 2024-09-21T02:34:38.367+0000 7f56d1214640 -1 osd.2 0 log_to_monitors true 2024-09-21T02:34:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:38 smithi172 ceph-mon[35067]: from='osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:34:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:38 smithi172 ceph-mon[35067]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:34:38.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:38 smithi084 ceph-mon[30747]: from='osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:34:38.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:38 smithi084 ceph-mon[30747]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:34:39.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:38 smithi090 ceph-mon[34571]: from='osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:34:39.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:38 smithi090 ceph-mon[34571]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T02:34:39.876 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:39 smithi084 ceph-mon[30747]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:34:39.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:39 smithi084 ceph-mon[30747]: from='osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:34:39.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:39 smithi084 ceph-mon[30747]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:34:39.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:39.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:39 smithi084 ceph-mon[30747]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:34:39.877 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:39 smithi084 ceph-mon[30747]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:39.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:39 smithi172 ceph-mon[35067]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:34:39.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:39 smithi172 ceph-mon[35067]: from='osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:34:39.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:39 smithi172 ceph-mon[35067]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:34:39.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:39.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:39 smithi172 ceph-mon[35067]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:34:39.925 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:39 smithi172 ceph-mon[35067]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:39 smithi090 ceph-mon[34571]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T02:34:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:39 smithi090 ceph-mon[34571]: from='osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:34:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:39 smithi090 ceph-mon[34571]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T02:34:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:39 smithi090 ceph-mon[34571]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:34:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:39 smithi090 ceph-mon[34571]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:40.599 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2[39496]: 2024-09-21T02:34:40.286+0000 7f56cd196640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T02:34:40.599 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2[39496]: 2024-09-21T02:34:40.291+0000 7f56c4f8c640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:34:40.658 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:34:40.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-09-21T02:34:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:34:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T02:34:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi172 2024-09-21T02:34:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:34:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-21T02:34:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:40 smithi172 ceph-mon[35067]: from='osd.2 ' entity='osd.2' 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi172 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:41.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:40 smithi084 ceph-mon[30747]: from='osd.2 ' entity='osd.2' 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi172 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:34:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:41.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:40 smithi090 ceph-mon[34571]: from='osd.2 ' entity='osd.2' 2024-09-21T02:34:41.049 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:34:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 -- 172.21.15.84:0/3847916949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf84106710 msgr2=0x7fbf84108b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 --2- 172.21.15.84:0/3847916949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf84106710 0x7fbf84108b70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009900 tx=0x7fbf7002a410 comp rx=0 tx=0).stop 2024-09-21T02:34:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 -- 172.21.15.84:0/3847916949 shutdown_connections 2024-09-21T02:34:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 --2- 172.21.15.84:0/3847916949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf841092b0 0x7fbf8410b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 --2- 172.21.15.84:0/3847916949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf84106710 0x7fbf84108b70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:41.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 --2- 172.21.15.84:0/3847916949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf8406c500 0x7fbf841061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 -- 172.21.15.84:0/3847916949 >> 172.21.15.84:0/3847916949 conn(0x7fbf840fde10 msgr2=0x7fbf841002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:34:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 -- 172.21.15.84:0/3847916949 shutdown_connections 2024-09-21T02:34:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.701+0000 7fbf89000640 1 -- 172.21.15.84:0/3847916949 wait complete. 2024-09-21T02:34:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.702+0000 7fbf89000640 1 Processor -- start 2024-09-21T02:34:41.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.702+0000 7fbf89000640 1 -- start start 2024-09-21T02:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.702+0000 7fbf89000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf8406c500 0x7fbf84199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.702+0000 7fbf89000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf84106710 0x7fbf8419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.702+0000 7fbf89000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf841092b0 0x7fbf8419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:41.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.702+0000 7fbf89000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8410f2f0 con 0x7fbf8406c500 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.702+0000 7fbf89000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8410f170 con 0x7fbf84106710 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.702+0000 7fbf89000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8410f470 con 0x7fbf841092b0 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf83400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf8406c500 0x7fbf84199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf82a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf84106710 0x7fbf8419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf82a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf84106710 0x7fbf8419a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:36664/0 (socket says 172.21.15.84:36664) 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf82a00640 1 -- 172.21.15.84:0/1636507683 learned_addr learned my addr 172.21.15.84:0/1636507683 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf83e00640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf841092b0 0x7fbf8419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf83400640 1 -- 172.21.15.84:0/1636507683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf841092b0 msgr2=0x7fbf8419b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf83400640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf841092b0 0x7fbf8419b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf83400640 1 -- 172.21.15.84:0/1636507683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf84106710 msgr2=0x7fbf8419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf83400640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf84106710 0x7fbf8419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf83400640 1 -- 172.21.15.84:0/1636507683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8419b910 con 0x7fbf8406c500 2024-09-21T02:34:41.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.703+0000 7fbf83400640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf8406c500 0x7fbf84199ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400e9f0 tx=0x7fbf7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.704+0000 7fbf7be00640 1 -- 172.21.15.84:0/1636507683 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400ccc0 con 0x7fbf8406c500 2024-09-21T02:34:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.704+0000 7fbf7be00640 1 -- 172.21.15.84:0/1636507683 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf74005020 con 0x7fbf8406c500 2024-09-21T02:34:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.704+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8419bc00 con 0x7fbf8406c500 2024-09-21T02:34:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.704+0000 7fbf7be00640 1 -- 172.21.15.84:0/1636507683 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf740049c0 con 0x7fbf8406c500 2024-09-21T02:34:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.704+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf841a2300 con 0x7fbf8406c500 2024-09-21T02:34:41.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.705+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf840ff930 con 0x7fbf8406c500 2024-09-21T02:34:41.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.707+0000 7fbf7be00640 1 -- 172.21.15.84:0/1636507683 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fbf740051d0 con 0x7fbf8406c500 2024-09-21T02:34:41.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.709+0000 7fbf7be00640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf680b6500 0x7fbf680b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:34:41.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.709+0000 7fbf7be00640 1 -- 172.21.15.84:0/1636507683 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fbf740e5d40 con 0x7fbf8406c500 2024-09-21T02:34:41.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.709+0000 7fbf82a00640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf680b6500 0x7fbf680b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:34:41.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.710+0000 7fbf82a00640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf680b6500 0x7fbf680b8a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf700096c0 tx=0x7fbf70031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:34:41.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.711+0000 7fbf7be00640 1 -- 172.21.15.84:0/1636507683 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf740adbf0 con 0x7fbf8406c500 2024-09-21T02:34:41.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:41.915+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbf84063800 con 0x7fbf680b6500 2024-09-21T02:34:41.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:41 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:34:41.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:41 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:34:41.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:41.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:41 smithi084 ceph-mon[30747]: osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] boot 2024-09-21T02:34:41.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:41 smithi084 ceph-mon[30747]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:34:41.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:41.916 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:41 smithi084 ceph-mon[30747]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:41 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:34:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:41 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:34:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:41 smithi172 ceph-mon[35067]: osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] boot 2024-09-21T02:34:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:41 smithi172 ceph-mon[35067]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:34:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:41 smithi172 ceph-mon[35067]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:42.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:41 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:34:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:41 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:34:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:41 smithi090 ceph-mon[34571]: osd.2 [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] boot 2024-09-21T02:34:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:41 smithi090 ceph-mon[34571]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T02:34:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T02:34:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:41 smithi090 ceph-mon[34571]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T02:34:42.731 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:34:42.731 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:42 smithi084 ceph-mon[30747]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:42.731 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:34:42.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:34:42.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:42.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:34:42.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:42 smithi084 ceph-mon[30747]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:34:42.732 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:34:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:34:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:42 smithi172 ceph-mon[35067]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:34:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:34:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:34:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:42 smithi172 ceph-mon[35067]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:34:43.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:34:43.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:34:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:42 smithi090 ceph-mon[34571]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:34:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:34:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:34:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T02:34:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:42 smithi090 ceph-mon[34571]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T02:34:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:34:43.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50267]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:34:43.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50267]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:43.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:43.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50267]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:43.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50270]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:34:43.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50270]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:43.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:43.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50270]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:43.759 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42260]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:34:43.759 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42260]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:43.759 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:43.759 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42260]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:43.759 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42263]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:34:43.759 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42263]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:43.759 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:43.759 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42263]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:43.906 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50273]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:34:43.906 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50273]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:43.906 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:43.906 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50273]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:43.906 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50276]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:34:43.906 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50276]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:43.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:43.907 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:43 smithi084 sudo[50276]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43440]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:34:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43440]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43440]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43443]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:34:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43443]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:44.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:44.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43443]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:44.007 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43434]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:34:44.007 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43434]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:44.007 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:44.007 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43434]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:44.007 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43437]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:34:44.007 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43437]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:44.007 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:44.007 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:34:43 smithi172 sudo[43437]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:44.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42266]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T02:34:44.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42266]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42266]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42269]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T02:34:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42269]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T02:34:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T02:34:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:43 smithi090 sudo[42269]: pam_unix(sudo:session): session closed for user root 2024-09-21T02:34:44.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:34:44.488+0000 7fbf7be00640 1 -- 172.21.15.84:0/1636507683 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbf740a9760 con 0x7fbf8406c500 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:44.491 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.492 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.493 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:44 smithi084 ceph-mon[30747]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:34:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T02:34:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:44 smithi172 ceph-mon[35067]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:44.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T02:34:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T02:34:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T02:34:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T02:34:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:44 smithi090 ceph-mon[34571]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T02:34:45.684 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:45 smithi084 ceph-mon[30747]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T02:34:45.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:45 smithi084 ceph-mon[30747]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-09-21T02:34:45.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:45 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2669122077' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "990a6d3d-f181-4236-8f89-89ccf33456dc"} : dispatch 2024-09-21T02:34:45.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:45 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2669122077' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "990a6d3d-f181-4236-8f89-89ccf33456dc"}]': finished 2024-09-21T02:34:45.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:45 smithi084 ceph-mon[30747]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:34:45.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:45 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:34:45.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:45 smithi172 ceph-mon[35067]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T02:34:45.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:45 smithi172 ceph-mon[35067]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-09-21T02:34:45.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:45 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2669122077' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "990a6d3d-f181-4236-8f89-89ccf33456dc"} : dispatch 2024-09-21T02:34:45.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:45 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2669122077' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "990a6d3d-f181-4236-8f89-89ccf33456dc"}]': finished 2024-09-21T02:34:45.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:45 smithi172 ceph-mon[35067]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:34:45.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:45 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:34:45.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:45 smithi090 ceph-mon[34571]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T02:34:45.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:45 smithi090 ceph-mon[34571]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-09-21T02:34:45.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:45 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2669122077' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "990a6d3d-f181-4236-8f89-89ccf33456dc"} : dispatch 2024-09-21T02:34:45.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:45 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2669122077' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "990a6d3d-f181-4236-8f89-89ccf33456dc"}]': finished 2024-09-21T02:34:45.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:45 smithi090 ceph-mon[34571]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T02:34:45.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:45 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:34:46.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:46 smithi172 ceph-mon[35067]: pgmap v104: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:46.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:46 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3024942801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:34:46.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:46 smithi084 ceph-mon[30747]: pgmap v104: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:46.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:46 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3024942801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:34:46.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:46 smithi090 ceph-mon[34571]: pgmap v104: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:46.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:46 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3024942801' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:34:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:48 smithi172 ceph-mon[35067]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:49.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:48 smithi084 ceph-mon[30747]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:49.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:48 smithi090 ceph-mon[34571]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:50 smithi172 ceph-mon[35067]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:51.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:50 smithi084 ceph-mon[30747]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:51.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:50 smithi090 ceph-mon[34571]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:52.709 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:52 smithi084 ceph-mon[30747]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:53.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:52 smithi172 ceph-mon[35067]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:53.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:52 smithi090 ceph-mon[34571]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:54.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:54 smithi084 ceph-mon[30747]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:54.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:34:54.873 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:54 smithi172 ceph-mon[35067]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:34:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:55.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:54 smithi090 ceph-mon[34571]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:55.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T02:34:55.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:34:55.904 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:55 smithi084 ceph-mon[30747]: Deploying daemon osd.3 on smithi084 2024-09-21T02:34:56.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:55 smithi172 ceph-mon[35067]: Deploying daemon osd.3 on smithi084 2024-09-21T02:34:56.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:55 smithi090 ceph-mon[34571]: Deploying daemon osd.3 on smithi084 2024-09-21T02:34:56.667 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:56 smithi084 ceph-mon[30747]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:57.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:56 smithi172 ceph-mon[35067]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:57.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:56 smithi090 ceph-mon[34571]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:57.839 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:34:57 smithi084 ceph-mon[30747]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:57.918 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:34:57 smithi090 ceph-mon[34571]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:34:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:34:57 smithi172 ceph-mon[35067]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:00.890 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:00 smithi084 ceph-mon[30747]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:01.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:00 smithi172 ceph-mon[35067]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:01.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:00 smithi090 ceph-mon[34571]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:02.883 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:02 smithi084 ceph-mon[30747]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:03.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:02 smithi172 ceph-mon[35067]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:03.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:02 smithi090 ceph-mon[34571]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:03.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:03.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:03.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:04.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:04.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:04.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:04.724 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:04 smithi084 ceph-mon[30747]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:04 smithi172 ceph-mon[35067]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:05.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:04 smithi090 ceph-mon[34571]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:06 smithi172 ceph-mon[35067]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:06 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:06 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:06 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:06 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:07.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:06 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:07.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:06 smithi084 ceph-mon[30747]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:07.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:06 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:07.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:06 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:07.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:06 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:07.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:06 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:07.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:06 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:07.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:06 smithi090 ceph-mon[34571]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:07.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:06 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:06 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:06 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:06 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:06 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:08.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.377+0000 7fbf7be00640 1 -- 172.21.15.84:0/1636507683 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf84063800 con 0x7fbf680b6500 2024-09-21T02:35:08.378 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 3 on host 'smithi084' 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.379+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf680b6500 msgr2=0x7fbf680b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.379+0000 7fbf89000640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf680b6500 0x7fbf680b8a10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf700096c0 tx=0x7fbf70031510 comp rx=0 tx=0).stop 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.379+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf8406c500 msgr2=0x7fbf84199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.379+0000 7fbf89000640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf8406c500 0x7fbf84199ee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400e9f0 tx=0x7fbf7400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.380+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 shutdown_connections 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.380+0000 7fbf89000640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf680b6500 0x7fbf680b8a10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.380+0000 7fbf89000640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf841092b0 0x7fbf8419b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.380+0000 7fbf89000640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf84106710 0x7fbf8419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.380+0000 7fbf89000640 1 --2- 172.21.15.84:0/1636507683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf8406c500 0x7fbf84199ee0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.380+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 >> 172.21.15.84:0/1636507683 conn(0x7fbf840fde10 msgr2=0x7fbf84104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.380+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 shutdown_connections 2024-09-21T02:35:08.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:35:08.380+0000 7fbf89000640 1 -- 172.21.15.84:0/1636507683 wait complete. 2024-09-21T02:35:08.896 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:08 smithi084 ceph-mon[30747]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:08.896 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:08.896 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:08.896 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:08 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:09.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:08 smithi172 ceph-mon[35067]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:09.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:08 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:09.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:08 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:09.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:08 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:09.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:08 smithi090 ceph-mon[34571]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:09.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:08 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:09.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:08 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:09.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:08 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:09.285 DEBUG:teuthology.orchestra.run.smithi084:osd.3> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T02:35:09.289 INFO:tasks.cephadm:Deploying osd.4 on smithi090 with /dev/vg_nvme/lv_3... 2024-09-21T02:35:09.289 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:35:09.538 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:35:09.842 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:09 smithi084 ceph-mon[30747]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:35:09.910 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:09 smithi090 ceph-mon[34571]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:35:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:09 smithi172 ceph-mon[35067]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T02:35:10.674 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:10 smithi090 ceph-mon[34571]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:10.674 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:10 smithi090 ceph-mon[34571]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:35:10.674 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:10 smithi090 ceph-mon[34571]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:35:10.675 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:10 smithi090 ceph-mon[34571]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:35:10.675 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:10 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:10.911 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:10 smithi084 ceph-mon[30747]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:10.912 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:10 smithi084 ceph-mon[30747]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:35:10.912 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:10 smithi084 ceph-mon[30747]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:35:10.912 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:10 smithi084 ceph-mon[30747]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:35:10.912 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:10 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:10.912 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:35:10 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3[52360]: 2024-09-21T02:35:10.607+0000 7f3358c00640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T02:35:10.912 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:35:10 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3[52360]: 2024-09-21T02:35:10.613+0000 7f3353c00640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:35:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:10 smithi172 ceph-mon[35067]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:10 smithi172 ceph-mon[35067]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T02:35:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:10 smithi172 ceph-mon[35067]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T02:35:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:10 smithi172 ceph-mon[35067]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:35:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:10 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:11.836 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:11 smithi090 ceph-mon[34571]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:35:11.837 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:11 smithi090 ceph-mon[34571]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T02:35:11.837 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:11 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:11.837 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:11 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:11.837 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:11 smithi090 ceph-mon[34571]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:11 smithi172 ceph-mon[35067]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:35:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:11 smithi172 ceph-mon[35067]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T02:35:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:11 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:11 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:11 smithi172 ceph-mon[35067]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:12.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:11 smithi084 ceph-mon[30747]: from='osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:35:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:11 smithi084 ceph-mon[30747]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T02:35:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:11 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:11 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:11 smithi084 ceph-mon[30747]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-21T02:35:12.071 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:35:12.096 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi090:vg_nvme/lv_3 2024-09-21T02:35:12.349 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:35:12.740 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:12 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:35:12.740 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:12 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:35:12.740 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:12 smithi090 ceph-mon[34571]: osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] boot 2024-09-21T02:35:12.740 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:12 smithi090 ceph-mon[34571]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:35:12.740 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 -- 172.21.15.90:0/612407253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 msgr2=0x7fbacc104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 --2- 172.21.15.90:0/612407253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 0x7fbacc104bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009900 tx=0x7fbabc02a480 comp rx=0 tx=0).stop 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 -- 172.21.15.90:0/612407253 shutdown_connections 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 --2- 172.21.15.90:0/612407253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbacc105180 0x7fbacc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 --2- 172.21.15.90:0/612407253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 0x7fbacc104bf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 --2- 172.21.15.90:0/612407253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbacc103750 0x7fbacc103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 -- 172.21.15.90:0/612407253 >> 172.21.15.90:0/612407253 conn(0x7fbacc0ff0c0 msgr2=0x7fbacc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 -- 172.21.15.90:0/612407253 shutdown_connections 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.832+0000 7fbad45eb640 1 -- 172.21.15.90:0/612407253 wait complete. 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad45eb640 1 Processor -- start 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad45eb640 1 -- start start 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad45eb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbacc103750 0x7fbacc076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad45eb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 0x7fbacc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad45eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbacc105180 0x7fbacc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad45eb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc10f530 con 0x7fbacc105180 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad45eb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc10f3b0 con 0x7fbacc1047e0 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad45eb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc10f6b0 con 0x7fbacc103750 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad1b86640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 0x7fbacc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad1b86640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 0x7fbacc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59866/0 (socket says 172.21.15.90:59866) 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad1b86640 1 -- 172.21.15.90:0/443304159 learned_addr learned my addr 172.21.15.90:0/443304159 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad2387640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbacc103750 0x7fbacc076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad2b88640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbacc105180 0x7fbacc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad1b86640 1 -- 172.21.15.90:0/443304159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbacc103750 msgr2=0x7fbacc076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad1b86640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbacc103750 0x7fbacc076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad1b86640 1 -- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbacc105180 msgr2=0x7fbacc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad1b86640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbacc105180 0x7fbacc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad1b86640 1 -- 172.21.15.90:0/443304159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc076350 con 0x7fbacc1047e0 2024-09-21T02:35:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.833+0000 7fbad2b88640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbacc105180 0x7fbacc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:35:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.834+0000 7fbad1b86640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 0x7fbacc075710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006010 tx=0x7fbabc004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.834+0000 7fbac37fe640 1 -- 172.21.15.90:0/443304159 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc03f030 con 0x7fbacc1047e0 2024-09-21T02:35:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.834+0000 7fbac37fe640 1 -- 172.21.15.90:0/443304159 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbabc003cd0 con 0x7fbacc1047e0 2024-09-21T02:35:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.834+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbacc1a4180 con 0x7fbacc1047e0 2024-09-21T02:35:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.834+0000 7fbac37fe640 1 -- 172.21.15.90:0/443304159 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc035070 con 0x7fbacc1047e0 2024-09-21T02:35:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.834+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbacc1a4520 con 0x7fbacc1047e0 2024-09-21T02:35:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.835+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbacc10a930 con 0x7fbacc1047e0 2024-09-21T02:35:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.836+0000 7fbac37fe640 1 -- 172.21.15.90:0/443304159 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbabc042030 con 0x7fbacc1047e0 2024-09-21T02:35:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.837+0000 7fbac37fe640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbab80b6510 0x7fbab80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.837+0000 7fbac37fe640 1 -- 172.21.15.90:0/443304159 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3669+0+0 (secure 0 0 0) 0x7fbabc106ac0 con 0x7fbacc1047e0 2024-09-21T02:35:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.837+0000 7fbad2387640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbab80b6510 0x7fbab80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.838+0000 7fbad2387640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbab80b6510 0x7fbab80b8a20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009990 tx=0x7fbac8009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:12.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:12.840+0000 7fbac37fe640 1 -- 172.21.15.90:0/443304159 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbabc0ce570 con 0x7fbacc1047e0 2024-09-21T02:35:12.961 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:12 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:35:12.961 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:12 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:35:12.961 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:12 smithi084 ceph-mon[30747]: osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] boot 2024-09-21T02:35:12.961 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:12 smithi084 ceph-mon[30747]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:35:12.961 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:12 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:35:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:12 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:35:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:12 smithi172 ceph-mon[35067]: osd.3 [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] boot 2024-09-21T02:35:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:12 smithi172 ceph-mon[35067]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T02:35:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T02:35:13.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:13.031+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbacc063800 con 0x7fbab80b6510 2024-09-21T02:35:13.735 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi084 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:35:13.736 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:35:13.737 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:13.737 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:13 smithi090 ceph-mon[34571]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:35:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi084 2024-09-21T02:35:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:35:14.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:14.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:13 smithi172 ceph-mon[35067]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T02:35:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi084 2024-09-21T02:35:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T02:35:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:14.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:14.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:14.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:14.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:14.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:35:14.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:35:14.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:14.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:13 smithi084 ceph-mon[30747]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:14.696 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:14 smithi090 ceph-mon[34571]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T02:35:15.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:14 smithi172 ceph-mon[35067]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T02:35:15.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:14 smithi084 ceph-mon[30747]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T02:35:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:15 smithi172 ceph-mon[35067]: from='client.? 172.21.15.90:0/503935524' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"} : dispatch 2024-09-21T02:35:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:15 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"} : dispatch 2024-09-21T02:35:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:15 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"}]': finished 2024-09-21T02:35:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:15 smithi172 ceph-mon[35067]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:35:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:15 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:16.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:15 smithi172 ceph-mon[35067]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:15 smithi084 ceph-mon[30747]: from='client.? 172.21.15.90:0/503935524' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"} : dispatch 2024-09-21T02:35:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:15 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"} : dispatch 2024-09-21T02:35:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:15 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"}]': finished 2024-09-21T02:35:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:15 smithi084 ceph-mon[30747]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:35:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:15 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:15 smithi084 ceph-mon[30747]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:16.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:15 smithi090 ceph-mon[34571]: from='client.? 172.21.15.90:0/503935524' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"} : dispatch 2024-09-21T02:35:16.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:15 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"} : dispatch 2024-09-21T02:35:16.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:15 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d366acd-ad48-43e2-ad7e-eed923fbf8eb"}]': finished 2024-09-21T02:35:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:15 smithi090 ceph-mon[34571]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T02:35:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:15 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:15 smithi090 ceph-mon[34571]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:16 smithi172 ceph-mon[35067]: from='client.? 172.21.15.90:0/3181484358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:35:17.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:16 smithi084 ceph-mon[30747]: from='client.? 172.21.15.90:0/3181484358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:35:17.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:16 smithi090 ceph-mon[34571]: from='client.? 172.21.15.90:0/3181484358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:35:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:17 smithi172 ceph-mon[35067]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T02:35:18.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:17 smithi084 ceph-mon[30747]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T02:35:18.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:17 smithi090 ceph-mon[34571]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T02:35:20.970 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:20 smithi090 ceph-mon[34571]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T02:35:21.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:20 smithi172 ceph-mon[35067]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T02:35:21.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:20 smithi084 ceph-mon[30747]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T02:35:22.905 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:22 smithi090 ceph-mon[34571]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:35:23.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:22 smithi172 ceph-mon[35067]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:35:23.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:22 smithi084 ceph-mon[30747]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:35:24.824 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:24 smithi090 ceph-mon[34571]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:35:24.824 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:35:24.824 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:25.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:24 smithi172 ceph-mon[35067]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:35:25.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:35:25.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:25.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:24 smithi084 ceph-mon[30747]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:35:25.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T02:35:25.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:25.876 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:25 smithi090 ceph-mon[34571]: Deploying daemon osd.4 on smithi090 2024-09-21T02:35:26.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:25 smithi172 ceph-mon[35067]: Deploying daemon osd.4 on smithi090 2024-09-21T02:35:26.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:25 smithi084 ceph-mon[30747]: Deploying daemon osd.4 on smithi090 2024-09-21T02:35:26.959 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:26 smithi090 ceph-mon[34571]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T02:35:27.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:26 smithi172 ceph-mon[35067]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T02:35:27.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:26 smithi084 ceph-mon[30747]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T02:35:27.809 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:27 smithi090 ceph-mon[34571]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:35:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:27 smithi172 ceph-mon[35067]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:35:28.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:27 smithi084 ceph-mon[30747]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:35:30.990 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:30 smithi090 ceph-mon[34571]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:31.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:30 smithi172 ceph-mon[35067]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:31.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:30 smithi084 ceph-mon[30747]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:31.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:31 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:31.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:31 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:31.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:31 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:31 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:31 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:31 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:32.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:31 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:32.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:31 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:32.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:31 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:32 smithi172 ceph-mon[35067]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:32 smithi084 ceph-mon[30747]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:33.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:32 smithi090 ceph-mon[34571]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:34.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:34 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:34 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:34 smithi090 ceph-mon[34571]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:34.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:34 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:34.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:34 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:34.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:34 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:34 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:34 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:34 smithi172 ceph-mon[35067]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:34 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:34 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:34 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:34 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:34 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:34 smithi084 ceph-mon[30747]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:34 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:34 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:34 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:34.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.771+0000 7fbac37fe640 1 -- 172.21.15.90:0/443304159 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbacc063800 con 0x7fbab80b6510 2024-09-21T02:35:34.773 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 4 on host 'smithi090' 2024-09-21T02:35:34.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbab80b6510 msgr2=0x7fbab80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:34.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbab80b6510 0x7fbab80b8a20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009990 tx=0x7fbac8009110 comp rx=0 tx=0).stop 2024-09-21T02:35:34.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 msgr2=0x7fbacc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:34.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 0x7fbacc075710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006010 tx=0x7fbabc004430 comp rx=0 tx=0).stop 2024-09-21T02:35:34.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 shutdown_connections 2024-09-21T02:35:34.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbacc105180 0x7fbacc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbacc1047e0 0x7fbacc075710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbab80b6510 0x7fbab80b8a20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 --2- 172.21.15.90:0/443304159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbacc103750 0x7fbacc076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:34.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 >> 172.21.15.90:0/443304159 conn(0x7fbacc0ff0c0 msgr2=0x7fbacc107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:34.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 shutdown_connections 2024-09-21T02:35:34.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:35:34.774+0000 7fbad45eb640 1 -- 172.21.15.90:0/443304159 wait complete. 2024-09-21T02:35:35.416 DEBUG:teuthology.orchestra.run.smithi090:osd.4> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T02:35:35.418 INFO:tasks.cephadm:Deploying osd.5 on smithi172 with /dev/vg_nvme/lv_3... 2024-09-21T02:35:35.418 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T02:35:35.680 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:35:35.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:35.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:35.727 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:36 smithi172 ceph-mon[35067]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:36 smithi084 ceph-mon[30747]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:36 smithi090 ceph-mon[34571]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:36.767 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:35:36 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4[44833]: 2024-09-21T02:35:36.608+0000 7f6f0c47d640 -1 osd.4 0 log_to_monitors true 2024-09-21T02:35:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:37 smithi172 ceph-mon[35067]: from='osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:35:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:37 smithi172 ceph-mon[35067]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:35:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:37 smithi084 ceph-mon[30747]: from='osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:35:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:37 smithi084 ceph-mon[30747]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:35:37.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:37 smithi090 ceph-mon[34571]: from='osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:35:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:37 smithi090 ceph-mon[34571]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T02:35:38.071 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:35:38.098 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-09-21T02:35:38.340 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:38.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:38.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:38.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:38.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:38.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:38 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:38.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:38.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:38 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:38.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 -- 172.21.15.172:0/4160779619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 msgr2=0x7faecc10a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:38.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 --2- 172.21.15.172:0/4160779619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 0x7faecc10a1d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faec4009ca0 tx=0x7faec402a950 comp rx=0 tx=0).stop 2024-09-21T02:35:38.804 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 -- 172.21.15.172:0/4160779619 shutdown_connections 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 --2- 172.21.15.172:0/4160779619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 0x7faecc10a1d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 --2- 172.21.15.172:0/4160779619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faecc102e90 0x7faecc1032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 --2- 172.21.15.172:0/4160779619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faecc101e00 0x7faecc102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 -- 172.21.15.172:0/4160779619 >> 172.21.15.172:0/4160779619 conn(0x7faecc0fd770 msgr2=0x7faecc0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 -- 172.21.15.172:0/4160779619 shutdown_connections 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.788+0000 7faed25fd640 1 -- 172.21.15.172:0/4160779619 wait complete. 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.789+0000 7faed25fd640 1 Processor -- start 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.789+0000 7faed25fd640 1 -- start start 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.789+0000 7faed25fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faecc101e00 0x7faecc19a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.789+0000 7faed25fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faecc102e90 0x7faecc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.789+0000 7faed25fd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 0x7faecc19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.789+0000 7faed25fd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10e400 con 0x7faecc102e90 2024-09-21T02:35:38.805 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.789+0000 7faed25fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10e280 con 0x7faecc101e00 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.789+0000 7faed25fd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faecc10e580 con 0x7faecc103830 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 0x7faecc19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 0x7faecc19b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:42340/0 (socket says 172.21.15.172:42340) 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 -- 172.21.15.172:0/786230993 learned_addr learned my addr 172.21.15.172:0/786230993 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faecbfff640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faecc101e00 0x7faecc19a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 -- 172.21.15.172:0/786230993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faecc101e00 msgr2=0x7faecc19a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faecc101e00 0x7faecc19a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 -- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faecc102e90 msgr2=0x7faecc19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faecc102e90 0x7faecc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 -- 172.21.15.172:0/786230993 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faecc19ba70 con 0x7faecc103830 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed0b9a640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 0x7faecc19b250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faec4006010 tx=0x7faec402faa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:38.806 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faec9ffb640 1 -- 172.21.15.172:0/786230993 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4034040 con 0x7faecc103830 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc19bd00 con 0x7faecc103830 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faec9ffb640 1 -- 172.21.15.172:0/786230993 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faec4030910 con 0x7faecc103830 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faec9ffb640 1 -- 172.21.15.172:0/786230993 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4039430 con 0x7faecc103830 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.790+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc1a2290 con 0x7faecc103830 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.791+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc1a24f0 con 0x7faecc103830 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.793+0000 7faec9ffb640 1 -- 172.21.15.172:0/786230993 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7faec4037020 con 0x7faecc103830 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.793+0000 7faec9ffb640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faeb80b6510 0x7faeb80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.793+0000 7faec9ffb640 1 -- 172.21.15.172:0/786230993 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7faec4107220 con 0x7faecc103830 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.794+0000 7faecbfff640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faeb80b6510 0x7faeb80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.794+0000 7faecbfff640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faeb80b6510 0x7faeb80b8a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faebc0058c0 tx=0x7faebc00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:35:38.807 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.797+0000 7faec9ffb640 1 -- 172.21.15.172:0/786230993 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faec40cecd0 con 0x7faecc103830 2024-09-21T02:35:38.988 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:38.987+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7faecc0ff680 con 0x7faeb80b6510 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:39.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:35:39.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:39.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:39.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:35:39.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:38 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:39.517 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4[44833]: 2024-09-21T02:35:39.203+0000 7f6f083ff640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T02:35:39.517 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4[44833]: 2024-09-21T02:35:39.210+0000 7f6f001f5640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi090 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi090 to 8544M 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:39.658 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:39 smithi172 ceph-mon[35067]: from='osd.4 ' entity='osd.4' 2024-09-21T02:35:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi090 2024-09-21T02:35:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi090 to 8544M 2024-09-21T02:35:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:35:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T02:35:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:40.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:35:40.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:35:40.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:40.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:39 smithi084 ceph-mon[30747]: from='osd.4 ' entity='osd.4' 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi090 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi090 to 8544M 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:39 smithi090 ceph-mon[34571]: from='osd.4 ' entity='osd.4' 2024-09-21T02:35:40.713 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:40 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:35:40.714 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:40 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:35:40.714 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:40 smithi172 ceph-mon[35067]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:40.714 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:40 smithi172 ceph-mon[35067]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:40.714 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:40.714 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:40 smithi172 ceph-mon[35067]: osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] boot 2024-09-21T02:35:40.714 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:40 smithi172 ceph-mon[35067]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:35:40.714 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:40 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:35:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:40 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:35:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:40 smithi084 ceph-mon[30747]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:40 smithi084 ceph-mon[30747]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:40 smithi084 ceph-mon[30747]: osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] boot 2024-09-21T02:35:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:40 smithi084 ceph-mon[30747]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:35:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:41.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:40 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:35:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:40 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:35:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:40 smithi090 ceph-mon[34571]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:35:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:40 smithi090 ceph-mon[34571]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-21T02:35:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:40 smithi090 ceph-mon[34571]: osd.4 [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] boot 2024-09-21T02:35:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:40 smithi090 ceph-mon[34571]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T02:35:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T02:35:41.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:41 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/4267527575' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"} : dispatch 2024-09-21T02:35:41.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:41 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"} : dispatch 2024-09-21T02:35:41.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:41 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"}]': finished 2024-09-21T02:35:41.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:41 smithi172 ceph-mon[35067]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T02:35:41.793 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:35:42.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:41 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/4267527575' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"} : dispatch 2024-09-21T02:35:42.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:41 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"} : dispatch 2024-09-21T02:35:42.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:41 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"}]': finished 2024-09-21T02:35:42.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:41 smithi084 ceph-mon[30747]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T02:35:42.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:35:42.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:41 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/4267527575' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"} : dispatch 2024-09-21T02:35:42.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:41 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"} : dispatch 2024-09-21T02:35:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:41 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c12622ec-42b4-431d-be3a-09277322ecda"}]': finished 2024-09-21T02:35:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:41 smithi090 ceph-mon[34571]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T02:35:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:35:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:42 smithi172 ceph-mon[35067]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:42 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/3690001953' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:35:43.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:42 smithi084 ceph-mon[30747]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:43.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:42 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/3690001953' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:35:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:42 smithi090 ceph-mon[34571]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:42 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/3690001953' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:35:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:44 smithi172 ceph-mon[35067]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:44 smithi084 ceph-mon[30747]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:45.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:44 smithi090 ceph-mon[34571]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:46.674 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:46 smithi172 ceph-mon[35067]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:47.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:46 smithi084 ceph-mon[30747]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:47.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:46 smithi090 ceph-mon[34571]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:48.652 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:48 smithi172 ceph-mon[35067]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:49.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:48 smithi084 ceph-mon[30747]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:49.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:48 smithi090 ceph-mon[34571]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:50 smithi172 ceph-mon[35067]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:35:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:51.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:50 smithi084 ceph-mon[30747]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:51.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:35:51.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:51.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:50 smithi090 ceph-mon[34571]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T02:35:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:35:51.803 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:51 smithi172 ceph-mon[35067]: Deploying daemon osd.5 on smithi172 2024-09-21T02:35:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:51 smithi084 ceph-mon[30747]: Deploying daemon osd.5 on smithi172 2024-09-21T02:35:52.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:51 smithi090 ceph-mon[34571]: Deploying daemon osd.5 on smithi172 2024-09-21T02:35:52.639 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:52 smithi172 ceph-mon[35067]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:53.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:52 smithi084 ceph-mon[30747]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:53.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:52 smithi090 ceph-mon[34571]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:54 smithi172 ceph-mon[35067]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:55.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:54 smithi084 ceph-mon[30747]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:55.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:54 smithi090 ceph-mon[34571]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:56.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:56 smithi172 ceph-mon[35067]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:56.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:56 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:56.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:56 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:56.864 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:56 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:57.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:56 smithi084 ceph-mon[30747]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:57.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:57.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:57.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:57.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:56 smithi090 ceph-mon[34571]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:57.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:56 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:35:57.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:56 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:57.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:56 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:35:58.819 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:58 smithi090 ceph-mon[34571]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:59.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:58 smithi172 ceph-mon[35067]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:59.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:58 smithi084 ceph-mon[30747]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:35:59.841 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.839+0000 7faec9ffb640 1 -- 172.21.15.172:0/786230993 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faecc0ff680 con 0x7faeb80b6510 2024-09-21T02:35:59.841 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 5 on host 'smithi172' 2024-09-21T02:35:59.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faeb80b6510 msgr2=0x7faeb80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:59.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faeb80b6510 0x7faeb80b8a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faebc0058c0 tx=0x7faebc00a2d0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.843 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 msgr2=0x7faecc19b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 0x7faecc19b250 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faec4006010 tx=0x7faec402faa0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 shutdown_connections 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faeb80b6510 0x7faeb80b8a20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faecc103830 0x7faecc19b250 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faecc102e90 0x7faecc19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.841+0000 7faed25fd640 1 --2- 172.21.15.172:0/786230993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faecc101e00 0x7faecc19a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.842+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 >> 172.21.15.172:0/786230993 conn(0x7faecc0fd770 msgr2=0x7faecc0fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.842+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 shutdown_connections 2024-09-21T02:35:59.844 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:35:59.842+0000 7faed25fd640 1 -- 172.21.15.172:0/786230993 wait complete. 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.216 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:35:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.260 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.260 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.261 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:00.261 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:00.261 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.261 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:00.261 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:00.261 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.261 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:35:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:35:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:00.569 DEBUG:teuthology.orchestra.run.smithi172:osd.5> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T02:36:00.571 INFO:tasks.cephadm:Deploying osd.6 on smithi084 with /dev/vg_nvme/lv_2... 2024-09-21T02:36:00.571 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:36:00.942 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:36:02.709 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:02 smithi172 ceph-mon[35067]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:02.709 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:02 smithi172 ceph-mon[35067]: from='osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:36:02.709 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:02 smithi172 ceph-mon[35067]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:36:02.710 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:36:02 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:36:02.428+0000 7f2265bef640 -1 osd.5 0 log_to_monitors true 2024-09-21T02:36:02.835 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:02 smithi084 ceph-mon[30747]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:02.835 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:02 smithi084 ceph-mon[30747]: from='osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:36:02.836 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:02 smithi084 ceph-mon[30747]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:36:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:02 smithi090 ceph-mon[34571]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:02 smithi090 ceph-mon[34571]: from='osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:36:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:02 smithi090 ceph-mon[34571]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T02:36:03.630 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:03.631 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:03 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:03.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:36:03.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:36:03.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:03.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:36:03.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:36:03.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:03.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:03.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:03.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:03.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:03.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:03.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:03.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:03 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:04.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:04.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:04.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:03 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:36:04.600 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:36:04.284+0000 7f2261b71640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T02:36:04.600 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:36:04.290+0000 7f2259967640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:36:04.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-09-21T02:36:04.982 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:36:04.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:04 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi172 2024-09-21T02:36:04.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:04 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-21T02:36:04.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:04 smithi084 ceph-mon[30747]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:04.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:04 smithi084 ceph-mon[30747]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:36:04.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:04 smithi084 ceph-mon[30747]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:36:04.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:04.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:04.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:04 smithi084 ceph-mon[30747]: from='osd.5 ' entity='osd.5' 2024-09-21T02:36:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi172 2024-09-21T02:36:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-21T02:36:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-mon[35067]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-mon[35067]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:36:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-mon[35067]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:36:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:04 smithi172 ceph-mon[35067]: from='osd.5 ' entity='osd.5' 2024-09-21T02:36:05.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:04 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi172 2024-09-21T02:36:05.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:04 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-21T02:36:05.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:04 smithi090 ceph-mon[34571]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:04 smithi090 ceph-mon[34571]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:36:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:04 smithi090 ceph-mon[34571]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T02:36:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:04 smithi090 ceph-mon[34571]: from='osd.5 ' entity='osd.5' 2024-09-21T02:36:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 -- 172.21.15.84:0/182703230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a806c660 msgr2=0x7fd8a81063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 --2- 172.21.15.84:0/182703230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a806c660 0x7fd8a81063a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009ca0 tx=0x7fd89c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:36:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 -- 172.21.15.84:0/182703230 shutdown_connections 2024-09-21T02:36:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 --2- 172.21.15.84:0/182703230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a8109480 0x7fd8a810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 --2- 172.21.15.84:0/182703230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8a81068e0 0x7fd8a8108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 --2- 172.21.15.84:0/182703230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a806c660 0x7fd8a81063a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:05.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 -- 172.21.15.84:0/182703230 >> 172.21.15.84:0/182703230 conn(0x7fd8a80fdfe0 msgr2=0x7fd8a8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:05.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 -- 172.21.15.84:0/182703230 shutdown_connections 2024-09-21T02:36:05.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.645+0000 7fd8af600640 1 -- 172.21.15.84:0/182703230 wait complete. 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.646+0000 7fd8af600640 1 Processor -- start 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8af600640 1 -- start start 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8af600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a806c660 0x7fd8a819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8af600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8a81068e0 0x7fd8a819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8af600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a8109480 0x7fd8a819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8af600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a810f510 con 0x7fd8a8109480 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8af600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a810f390 con 0x7fd8a81068e0 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8af600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a810f690 con 0x7fd8a806c660 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8ad600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a8109480 0x7fd8a819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8acc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a806c660 0x7fd8a819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:05.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8a7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8a81068e0 0x7fd8a819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:05.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8ad600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a8109480 0x7fd8a819b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45302/0 (socket says 172.21.15.84:45302) 2024-09-21T02:36:05.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.647+0000 7fd8ad600640 1 -- 172.21.15.84:0/683919915 learned_addr learned my addr 172.21.15.84:0/683919915 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:36:05.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a7e00640 1 -- 172.21.15.84:0/683919915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a806c660 msgr2=0x7fd8a819a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:05.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a7e00640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a806c660 0x7fd8a819a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:05.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a7e00640 1 -- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a8109480 msgr2=0x7fd8a819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:05.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a7e00640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a8109480 0x7fd8a819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:05.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a7e00640 1 -- 172.21.15.84:0/683919915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a819bab0 con 0x7fd8a81068e0 2024-09-21T02:36:05.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a7e00640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8a81068e0 0x7fd8a819a6f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd89400e9f0 tx=0x7fd89400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:05.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a5600640 1 -- 172.21.15.84:0/683919915 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89400cd80 con 0x7fd8a81068e0 2024-09-21T02:36:05.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a5600640 1 -- 172.21.15.84:0/683919915 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd8940035f0 con 0x7fd8a81068e0 2024-09-21T02:36:05.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a819bda0 con 0x7fd8a81068e0 2024-09-21T02:36:05.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.648+0000 7fd8a5600640 1 -- 172.21.15.84:0/683919915 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894010690 con 0x7fd8a81068e0 2024-09-21T02:36:05.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.649+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a81a24a0 con 0x7fd8a81068e0 2024-09-21T02:36:05.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.650+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a80ffb00 con 0x7fd8a81068e0 2024-09-21T02:36:05.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.652+0000 7fd8a5600640 1 -- 172.21.15.84:0/683919915 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd8940037a0 con 0x7fd8a81068e0 2024-09-21T02:36:05.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.654+0000 7fd8a5600640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd8900b6510 0x7fd8900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:05.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.654+0000 7fd8a5600640 1 -- 172.21.15.84:0/683919915 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4533+0+0 (secure 0 0 0) 0x7fd8940e6820 con 0x7fd8a81068e0 2024-09-21T02:36:05.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.654+0000 7fd8acc00640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd8900b6510 0x7fd8900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:05.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.655+0000 7fd8acc00640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd8900b6510 0x7fd8900b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd89c006010 tx=0x7fd89c009480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:05.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.657+0000 7fd8a5600640 1 -- 172.21.15.84:0/683919915 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8940aded0 con 0x7fd8a81068e0 2024-09-21T02:36:05.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:05.853+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd8a8063800 con 0x7fd8900b6510 2024-09-21T02:36:05.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:05 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:36:05.854 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:05 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:36:05.855 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:05 smithi084 ceph-mon[30747]: osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] boot 2024-09-21T02:36:05.855 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:05 smithi084 ceph-mon[30747]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T02:36:05.855 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:05 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:05.855 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:05 smithi084 ceph-mon[30747]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:36:05.855 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:05 smithi084 ceph-mon[30747]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:05 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:36:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:05 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:36:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:05 smithi172 ceph-mon[35067]: osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] boot 2024-09-21T02:36:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:05 smithi172 ceph-mon[35067]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T02:36:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:05 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:06.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:05 smithi172 ceph-mon[35067]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:36:06.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:05 smithi172 ceph-mon[35067]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:05 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:36:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:05 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:36:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:05 smithi090 ceph-mon[34571]: osd.5 [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] boot 2024-09-21T02:36:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:05 smithi090 ceph-mon[34571]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T02:36:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:05 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T02:36:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:05 smithi090 ceph-mon[34571]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T02:36:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:05 smithi090 ceph-mon[34571]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-21T02:36:06.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:06 smithi084 ceph-mon[30747]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:06.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:06 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:36:06.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:06 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:36:06.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:06 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:06.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:06 smithi084 ceph-mon[30747]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:36:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:06 smithi172 ceph-mon[35067]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:06 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:36:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:06 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:36:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:06 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:06 smithi172 ceph-mon[35067]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:36:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:06 smithi090 ceph-mon[34571]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:06 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:36:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:06 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:36:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:06 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:06 smithi090 ceph-mon[34571]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T02:36:07.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:07 smithi084 ceph-mon[30747]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T02:36:08.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:07 smithi172 ceph-mon[35067]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T02:36:08.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:07 smithi090 ceph-mon[34571]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T02:36:09.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:09 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4880156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd5c4982-d301-4b87-a9cc-14740596822d"} : dispatch 2024-09-21T02:36:09.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:09 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4880156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd5c4982-d301-4b87-a9cc-14740596822d"}]': finished 2024-09-21T02:36:09.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:09 smithi172 ceph-mon[35067]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T02:36:09.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:09 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:09.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:09 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4880156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd5c4982-d301-4b87-a9cc-14740596822d"} : dispatch 2024-09-21T02:36:09.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:09 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4880156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd5c4982-d301-4b87-a9cc-14740596822d"}]': finished 2024-09-21T02:36:09.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:09 smithi084 ceph-mon[30747]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T02:36:09.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:09 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:09.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:09 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4880156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd5c4982-d301-4b87-a9cc-14740596822d"} : dispatch 2024-09-21T02:36:09.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:09 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4880156' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd5c4982-d301-4b87-a9cc-14740596822d"}]': finished 2024-09-21T02:36:09.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:09 smithi090 ceph-mon[34571]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T02:36:09.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:09 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:10.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:10 smithi172 ceph-mon[35067]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T02:36:10.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:10 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3251783330' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:36:10.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:10 smithi084 ceph-mon[30747]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T02:36:10.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:10 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3251783330' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:36:10.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:10 smithi090 ceph-mon[34571]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-21T02:36:10.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:10 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3251783330' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:36:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:12 smithi172 ceph-mon[35067]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T02:36:13.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:12 smithi084 ceph-mon[30747]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T02:36:13.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:12 smithi090 ceph-mon[34571]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-21T02:36:14.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:14 smithi084 ceph-mon[30747]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:36:15.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:14 smithi172 ceph-mon[35067]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:36:15.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:14 smithi090 ceph-mon[34571]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T02:36:16.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:16 smithi084 ceph-mon[30747]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:36:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:16 smithi172 ceph-mon[35067]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:36:17.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:16 smithi090 ceph-mon[34571]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-21T02:36:19.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:18 smithi172 ceph-mon[35067]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:19.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:18 smithi084 ceph-mon[30747]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:19.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:18 smithi090 ceph-mon[34571]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:19.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:19 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:36:19.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:19 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:19 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:36:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:19 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:20.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:19 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T02:36:20.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:19 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:20.689 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:20 smithi084 ceph-mon[30747]: Deploying daemon osd.6 on smithi084 2024-09-21T02:36:20.689 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:20 smithi084 ceph-mon[30747]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:21.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:20 smithi172 ceph-mon[35067]: Deploying daemon osd.6 on smithi084 2024-09-21T02:36:21.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:20 smithi172 ceph-mon[35067]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:21.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:20 smithi090 ceph-mon[34571]: Deploying daemon osd.6 on smithi084 2024-09-21T02:36:21.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:20 smithi090 ceph-mon[34571]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:21.972 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:21 smithi084 ceph-mon[30747]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:21 smithi172 ceph-mon[35067]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:22.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:21 smithi090 ceph-mon[34571]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:24.980 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:24 smithi172 ceph-mon[35067]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:25.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:24 smithi084 ceph-mon[30747]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:25.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:24 smithi090 ceph-mon[34571]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:26.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:26 smithi084 ceph-mon[30747]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:27.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:26 smithi172 ceph-mon[35067]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:27.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:26 smithi090 ceph-mon[34571]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:27.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:27.929 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:27.930 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:28.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:28.918 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:28 smithi090 ceph-mon[34571]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:28.934 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:28 smithi084 ceph-mon[30747]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:29.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:28 smithi172 ceph-mon[35067]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:29.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:29 smithi084 ceph-mon[30747]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:29 smithi172 ceph-mon[35067]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:30.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:29 smithi090 ceph-mon[34571]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:31 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:31 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:31 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:31 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:31.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:31 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:31.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:31 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:31.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:31 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:31.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:31 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:31.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:31 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:31.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:31 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:31.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:31 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:31.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:31 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:31.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:31 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:31.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:31 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:31.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:31 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:32.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.241+0000 7fd8a5600640 1 -- 172.21.15.84:0/683919915 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd8a8063800 con 0x7fd8900b6510 2024-09-21T02:36:32.243 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 6 on host 'smithi084' 2024-09-21T02:36:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.244+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd8900b6510 msgr2=0x7fd8900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.244+0000 7fd8af600640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd8900b6510 0x7fd8900b8a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd89c006010 tx=0x7fd89c009480 comp rx=0 tx=0).stop 2024-09-21T02:36:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.244+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8a81068e0 msgr2=0x7fd8a819a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.244+0000 7fd8af600640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8a81068e0 0x7fd8a819a6f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd89400e9f0 tx=0x7fd89400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:36:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.245+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 shutdown_connections 2024-09-21T02:36:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.245+0000 7fd8af600640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd8a8109480 0x7fd8a819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.245+0000 7fd8af600640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8a81068e0 0x7fd8a819a6f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:32.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.245+0000 7fd8af600640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd8900b6510 0x7fd8900b8a20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.245+0000 7fd8af600640 1 --2- 172.21.15.84:0/683919915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a806c660 0x7fd8a819a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.245+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 >> 172.21.15.84:0/683919915 conn(0x7fd8a80fdfe0 msgr2=0x7fd8a8104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.245+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 shutdown_connections 2024-09-21T02:36:32.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:36:32.245+0000 7fd8af600640 1 -- 172.21.15.84:0/683919915 wait complete. 2024-09-21T02:36:32.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:32 smithi084 ceph-mon[30747]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:32.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:32.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:32.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:32.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:32 smithi172 ceph-mon[35067]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:32.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:32.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:32.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:32.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:32 smithi090 ceph-mon[34571]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:32.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:32.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:32.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:33.011 DEBUG:teuthology.orchestra.run.smithi084:osd.6> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T02:36:33.014 INFO:tasks.cephadm:Deploying osd.7 on smithi090 with /dev/vg_nvme/lv_2... 2024-09-21T02:36:33.014 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:36:33.269 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:36:33.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:33 smithi084 ceph-mon[30747]: from='osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:36:33.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:33 smithi084 ceph-mon[30747]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:36:33.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:36:33 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:36:33.387+0000 7f30e4e1d640 -1 osd.6 0 log_to_monitors true 2024-09-21T02:36:33.644 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:33 smithi090 ceph-mon[34571]: from='osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:36:33.644 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:33 smithi090 ceph-mon[34571]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:36:33.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:33 smithi172 ceph-mon[35067]: from='osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:36:33.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:33 smithi172 ceph-mon[35067]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T02:36:34.732 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:34 smithi090 ceph-mon[34571]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:36:34.732 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:34 smithi090 ceph-mon[34571]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:36:34.732 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:34 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:34.732 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:34 smithi090 ceph-mon[34571]: from='osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:36:34.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:34 smithi090 ceph-mon[34571]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:36:34.733 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:34 smithi090 ceph-mon[34571]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:34 smithi172 ceph-mon[35067]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:36:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:34 smithi172 ceph-mon[35067]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:36:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:34 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:34 smithi172 ceph-mon[35067]: from='osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:36:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:34 smithi172 ceph-mon[35067]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:36:34.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:34 smithi172 ceph-mon[35067]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:34 smithi084 ceph-mon[30747]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T02:36:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:34 smithi084 ceph-mon[30747]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T02:36:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:34 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:34 smithi084 ceph-mon[30747]: from='osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:36:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:34 smithi084 ceph-mon[30747]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:36:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:34 smithi084 ceph-mon[30747]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:35.460 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:36:35 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:36:35.223+0000 7f30e0400640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T02:36:35.460 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:36:35 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:36:35.249+0000 7f30d5a00640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:36:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:35 smithi172 ceph-mon[35067]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:36:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:35 smithi172 ceph-mon[35067]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:36:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:35 smithi172 ceph-mon[35067]: from='osd.6 ' entity='osd.6' 2024-09-21T02:36:35.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:35 smithi084 ceph-mon[30747]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:36:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:35 smithi084 ceph-mon[30747]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:36:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:35 smithi084 ceph-mon[30747]: from='osd.6 ' entity='osd.6' 2024-09-21T02:36:35.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:35 smithi090 ceph-mon[34571]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:36:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:35 smithi090 ceph-mon[34571]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T02:36:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:35 smithi090 ceph-mon[34571]: from='osd.6 ' entity='osd.6' 2024-09-21T02:36:35.813 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:36:35.839 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi090:vg_nvme/lv_2 2024-09-21T02:36:36.081 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:36:36.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 -- 172.21.15.90:0/259842344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb41036d0 msgr2=0x7f2eb4103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:36.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/259842344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb41036d0 0x7f2eb4103ae0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009ca0 tx=0x7f2ea802a950 comp rx=0 tx=0).stop 2024-09-21T02:36:36.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 -- 172.21.15.90:0/259842344 shutdown_connections 2024-09-21T02:36:36.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/259842344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb4104070 0x7f2eb410aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:36.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/259842344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb41036d0 0x7f2eb4103ae0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/259842344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb4102640 0x7f2eb4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 -- 172.21.15.90:0/259842344 >> 172.21.15.90:0/259842344 conn(0x7f2eb40fdfb0 msgr2=0x7f2eb4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 -- 172.21.15.90:0/259842344 shutdown_connections 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.567+0000 7f2ebaed1640 1 -- 172.21.15.90:0/259842344 wait complete. 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2ebaed1640 1 Processor -- start 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2ebaed1640 1 -- start start 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2ebaed1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb4102640 0x7f2eb406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2ebaed1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb41036d0 0x7f2eb419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2ebaed1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb4104070 0x7f2eb41a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2ebaed1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb410e3c0 con 0x7f2eb4104070 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2ebaed1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb410e240 con 0x7f2eb4102640 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2ebaed1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb410e540 con 0x7f2eb41036d0 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb8c6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb4102640 0x7f2eb406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:36.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb8c6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb4102640 0x7f2eb406b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38626/0 (socket says 172.21.15.90:38626) 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb8c6d640 1 -- 172.21.15.90:0/961879777 learned_addr learned my addr 172.21.15.90:0/961879777 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb3fff640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb41036d0 0x7f2eb419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb946e640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb4104070 0x7f2eb41a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb8c6d640 1 -- 172.21.15.90:0/961879777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb41036d0 msgr2=0x7f2eb419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb8c6d640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb41036d0 0x7f2eb419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb8c6d640 1 -- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb4104070 msgr2=0x7f2eb41a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb8c6d640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb4104070 0x7f2eb41a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.568+0000 7f2eb8c6d640 1 -- 172.21.15.90:0/961879777 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb41a1b90 con 0x7f2eb4102640 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.569+0000 7f2eb8c6d640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb4102640 0x7f2eb406b6a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400d770 tx=0x7f2ea400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.569+0000 7f2eb1ffb640 1 -- 172.21.15.90:0/961879777 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4017070 con 0x7f2eb4102640 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.569+0000 7f2eb1ffb640 1 -- 172.21.15.90:0/961879777 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ea40054f0 con 0x7f2eb4102640 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.569+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb41a1e80 con 0x7f2eb4102640 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.569+0000 7f2eb1ffb640 1 -- 172.21.15.90:0/961879777 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4004de0 con 0x7f2eb4102640 2024-09-21T02:36:36.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.569+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb41a22d0 con 0x7f2eb4102640 2024-09-21T02:36:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.570+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb4109820 con 0x7f2eb4102640 2024-09-21T02:36:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.572+0000 7f2eb1ffb640 1 -- 172.21.15.90:0/961879777 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2ea4004f80 con 0x7f2eb4102640 2024-09-21T02:36:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.572+0000 7f2eb1ffb640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:36:36.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.572+0000 7f2eb1ffb640 1 -- 172.21.15.90:0/961879777 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4965+0+0 (secure 0 0 0) 0x7f2ea40e6110 con 0x7f2eb4102640 2024-09-21T02:36:36.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.573+0000 7f2eb3fff640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:36:36.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.573+0000 7f2eb3fff640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2ea802f980 tx=0x7f2ea8009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:36:36.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.577+0000 7f2eb1ffb640 1 -- 172.21.15.90:0/961879777 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ea40ad6b0 con 0x7f2eb4102640 2024-09-21T02:36:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:36 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:36:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:36 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:36:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:36 smithi172 ceph-mon[35067]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:36 smithi172 ceph-mon[35067]: osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] boot 2024-09-21T02:36:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:36 smithi172 ceph-mon[35067]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T02:36:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:36 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:36:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:36 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:36:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:36 smithi084 ceph-mon[30747]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:36 smithi084 ceph-mon[30747]: osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] boot 2024-09-21T02:36:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:36 smithi084 ceph-mon[30747]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T02:36:36.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:36.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:36.764+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2eb4063800 con 0x7f2e9c0b6510 2024-09-21T02:36:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:36 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:36:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:36 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:36:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:36 smithi090 ceph-mon[34571]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-21T02:36:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:36 smithi090 ceph-mon[34571]: osd.6 [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] boot 2024-09-21T02:36:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:36 smithi090 ceph-mon[34571]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T02:36:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T02:36:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:36:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:36:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:37.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:37.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:37 smithi172 ceph-mon[35067]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:37 smithi084 ceph-mon[30747]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:37 smithi090 ceph-mon[34571]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T02:36:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:38 smithi172 ceph-mon[35067]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:38 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi084 2024-09-21T02:36:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:38 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T02:36:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:38 smithi172 ceph-mon[35067]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:38.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:38 smithi084 ceph-mon[30747]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:38.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:38 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi084 2024-09-21T02:36:38.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:38 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T02:36:38.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:38 smithi084 ceph-mon[30747]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:38.765 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:38 smithi090 ceph-mon[34571]: from='client.24452 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:36:38.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:38 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi084 2024-09-21T02:36:38.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:38 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T02:36:38.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:38 smithi090 ceph-mon[34571]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:39.647 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:39 smithi090 ceph-mon[34571]: from='client.? 172.21.15.90:0/1151228830' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"} : dispatch 2024-09-21T02:36:39.647 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:39 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"} : dispatch 2024-09-21T02:36:39.647 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:39 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"}]': finished 2024-09-21T02:36:39.648 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:39 smithi090 ceph-mon[34571]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T02:36:39.648 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:36:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:39 smithi172 ceph-mon[35067]: from='client.? 172.21.15.90:0/1151228830' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"} : dispatch 2024-09-21T02:36:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:39 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"} : dispatch 2024-09-21T02:36:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:39 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"}]': finished 2024-09-21T02:36:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:39 smithi172 ceph-mon[35067]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T02:36:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:36:39.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:39 smithi084 ceph-mon[30747]: from='client.? 172.21.15.90:0/1151228830' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"} : dispatch 2024-09-21T02:36:39.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:39 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"} : dispatch 2024-09-21T02:36:39.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:39 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fe3f253-331b-4188-b422-bae618bdd56f"}]': finished 2024-09-21T02:36:39.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:39 smithi084 ceph-mon[30747]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T02:36:39.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:36:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:40 smithi172 ceph-mon[35067]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:40 smithi172 ceph-mon[35067]: from='client.? 172.21.15.90:0/1128602062' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:36:40.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:40 smithi084 ceph-mon[30747]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:40.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:40 smithi084 ceph-mon[30747]: from='client.? 172.21.15.90:0/1128602062' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:36:40.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:40 smithi090 ceph-mon[34571]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:40.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:40 smithi090 ceph-mon[34571]: from='client.? 172.21.15.90:0/1128602062' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:36:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:42 smithi172 ceph-mon[35067]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:43.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:42 smithi084 ceph-mon[30747]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:43.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:42 smithi090 ceph-mon[34571]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:44.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:44 smithi090 ceph-mon[34571]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:44 smithi172 ceph-mon[35067]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:44 smithi084 ceph-mon[30747]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:46 smithi090 ceph-mon[34571]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:46 smithi172 ceph-mon[35067]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:47.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:46 smithi084 ceph-mon[30747]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:47.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:47 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:36:47.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:47 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:47 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:36:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:47 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:48.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:47 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T02:36:48.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:47 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:48.952 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:48 smithi090 ceph-mon[34571]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:48.953 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:48 smithi090 ceph-mon[34571]: Deploying daemon osd.7 on smithi090 2024-09-21T02:36:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:48 smithi172 ceph-mon[35067]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:48 smithi172 ceph-mon[35067]: Deploying daemon osd.7 on smithi090 2024-09-21T02:36:49.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:48 smithi084 ceph-mon[30747]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:49.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:48 smithi084 ceph-mon[30747]: Deploying daemon osd.7 on smithi090 2024-09-21T02:36:49.845 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:49 smithi090 ceph-mon[34571]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:50.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:49 smithi172 ceph-mon[35067]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:49 smithi084 ceph-mon[30747]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:52.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:52 smithi090 ceph-mon[34571]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:53.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:52 smithi172 ceph-mon[35067]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:53.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:52 smithi084 ceph-mon[30747]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:54.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:54 smithi090 ceph-mon[34571]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:54.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:54.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:54.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:54 smithi172 ceph-mon[35067]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:55.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:54 smithi084 ceph-mon[30747]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:55.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:55.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:55.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:56.911 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:56 smithi090 ceph-mon[34571]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:56.911 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:56 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:56.911 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:56 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:57.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:56 smithi172 ceph-mon[35067]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:57.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:56 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:57.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:56 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:57.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:56 smithi084 ceph-mon[30747]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:57.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:57.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:56 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:57.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.567+0000 7f2eb1ffb640 1 -- 172.21.15.90:0/961879777 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2eb4063800 con 0x7f2e9c0b6510 2024-09-21T02:36:57.569 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 7 on host 'smithi090' 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2e9c0b6510 msgr2=0x7f2e9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2ea802f980 tx=0x7f2ea8009360 comp rx=0 tx=0).stop 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb4102640 msgr2=0x7f2eb406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb4102640 0x7f2eb406b6a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400d770 tx=0x7f2ea400dc30 comp rx=0 tx=0).stop 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 shutdown_connections 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2e9c0b6510 0x7f2e9c0b8a20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb41036d0 0x7f2eb419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb4104070 0x7f2eb41a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 --2- 172.21.15.90:0/961879777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2eb4102640 0x7f2eb406b6a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 >> 172.21.15.90:0/961879777 conn(0x7f2eb40fdfb0 msgr2=0x7f2eb41069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:36:57.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 shutdown_connections 2024-09-21T02:36:57.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:36:57.570+0000 7f2ebaed1640 1 -- 172.21.15.90:0/961879777 wait complete. 2024-09-21T02:36:57.903 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:57 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:57.903 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:57 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:57.903 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:57 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:57.903 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:57 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:57.903 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:57 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:57.903 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:57 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:57 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:57 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:57 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:57 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:57 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:57 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:58.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:57 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:36:58.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:57 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:36:58.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:57 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:58.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:57 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:36:58.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:57 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:58.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:57 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:36:58.234 DEBUG:teuthology.orchestra.run.smithi090:osd.7> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T02:36:58.237 INFO:tasks.cephadm:Deploying osd.8 on smithi172 with /dev/vg_nvme/lv_2... 2024-09-21T02:36:58.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T02:36:58.492 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:36:58.777 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:58 smithi090 ceph-mon[34571]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:58.863 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:58 smithi172 ceph-mon[35067]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:59.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:58 smithi084 ceph-mon[30747]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:59.689 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:36:59 smithi090 ceph-mon[34571]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:36:59.954 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:36:59 smithi172 ceph-mon[35067]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:37:00.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:36:59 smithi084 ceph-mon[30747]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:37:00.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:37:00 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:37:00.106+0000 7f0dcec4f640 -1 osd.7 0 log_to_monitors true 2024-09-21T02:37:00.846 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:00 smithi172 ceph-mon[35067]: from='osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:37:00.847 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:00 smithi172 ceph-mon[35067]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:37:00.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:00 smithi084 ceph-mon[30747]: from='osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:37:00.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:00 smithi084 ceph-mon[30747]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:37:00.942 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:00 smithi090 ceph-mon[34571]: from='osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:37:00.943 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:00 smithi090 ceph-mon[34571]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T02:37:01.112 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:37:01.138 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-09-21T02:37:01.387 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi090 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:01.816 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi090 to 5696M 2024-09-21T02:37:01.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:01.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:01.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:01.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:01.817 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:01 smithi172 ceph-mon[35067]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.907+0000 7f442fd52640 1 -- 172.21.15.172:0/4179493204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44281051a0 msgr2=0x7f442810bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.907+0000 7f442fd52640 1 --2- 172.21.15.172:0/4179493204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44281051a0 0x7f442810bb40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4420009ca0 tx=0x7f442002a950 comp rx=0 tx=0).stop 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.907+0000 7f442fd52640 1 -- 172.21.15.172:0/4179493204 shutdown_connections 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.907+0000 7f442fd52640 1 --2- 172.21.15.172:0/4179493204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44281051a0 0x7f442810bb40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.907+0000 7f442fd52640 1 --2- 172.21.15.172:0/4179493204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4428104800 0x7f4428104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.907+0000 7f442fd52640 1 --2- 172.21.15.172:0/4179493204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4428103770 0x7f4428103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.907+0000 7f442fd52640 1 -- 172.21.15.172:0/4179493204 >> 172.21.15.172:0/4179493204 conn(0x7f44280ff0c0 msgr2=0x7f4428101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 -- 172.21.15.172:0/4179493204 shutdown_connections 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 -- 172.21.15.172:0/4179493204 wait complete. 2024-09-21T02:37:01.909 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 Processor -- start 2024-09-21T02:37:01.910 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 -- start start 2024-09-21T02:37:01.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4428103770 0x7f442819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:01.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4428104800 0x7f442819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:01.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44281051a0 0x7f442819b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:01.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f442810f4f0 con 0x7f4428104800 2024-09-21T02:37:01.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f442810f370 con 0x7f44281051a0 2024-09-21T02:37:01.911 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.908+0000 7f442fd52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f442810f670 con 0x7f4428103770 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4428103770 0x7f442819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4428103770 0x7f442819a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:48418/0 (socket says 172.21.15.172:48418) 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 -- 172.21.15.172:0/3765732346 learned_addr learned my addr 172.21.15.172:0/3765732346 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442e2ef640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44281051a0 0x7f442819b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442d2ed640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4428104800 0x7f442819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 -- 172.21.15.172:0/3765732346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44281051a0 msgr2=0x7f442819b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44281051a0 0x7f442819b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 -- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4428104800 msgr2=0x7f442819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4428104800 0x7f442819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 -- 172.21.15.172:0/3765732346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442819ba60 con 0x7f4428103770 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442d2ed640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4428104800 0x7f442819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:37:01.912 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442daee640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4428103770 0x7f442819a030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f442400e9f0 tx=0x7f442400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:01.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f441affd640 1 -- 172.21.15.172:0/3765732346 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442400cd80 con 0x7f4428103770 2024-09-21T02:37:01.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442819bd50 con 0x7f4428103770 2024-09-21T02:37:01.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f441affd640 1 -- 172.21.15.172:0/3765732346 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44240054f0 con 0x7f4428103770 2024-09-21T02:37:01.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f441affd640 1 -- 172.21.15.172:0/3765732346 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424010690 con 0x7f4428103770 2024-09-21T02:37:01.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.909+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44281a2450 con 0x7f4428103770 2024-09-21T02:37:01.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.911+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442810a950 con 0x7f4428103770 2024-09-21T02:37:01.913 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.912+0000 7f441affd640 1 -- 172.21.15.172:0/3765732346 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f44240046c0 con 0x7f4428103770 2024-09-21T02:37:01.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.913+0000 7f441affd640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44140b6510 0x7f44140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:01.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.913+0000 7f441affd640 1 -- 172.21.15.172:0/3765732346 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f44240e6a80 con 0x7f4428103770 2024-09-21T02:37:01.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.913+0000 7f442d2ed640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44140b6510 0x7f44140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:01.914 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.913+0000 7f442d2ed640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44140b6510 0x7f44140b8a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f441c0058c0 tx=0x7f441c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:01.918 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:01.917+0000 7f441affd640 1 -- 172.21.15.172:0/3765732346 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44240adf90 con 0x7f4428103770 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi090 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:02.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:02.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:02.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi090 to 5696M 2024-09-21T02:37:02.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:02.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:02.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:02.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:02.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:01 smithi084 ceph-mon[30747]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:37:02.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi090 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi090 to 5696M 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:02.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:02.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:02.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:01 smithi090 ceph-mon[34571]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-21T02:37:02.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:02.103+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4428063800 con 0x7f44140b6510 2024-09-21T02:37:02.629 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:37:02.343+0000 7f0dcabd1640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T02:37:02.629 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:37:02.354+0000 7f0dc29c7640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:37:02.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:37:02.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:37:02.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:02.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:02.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:02.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:37:02.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:37:02.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:02.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='osd.7 ' entity='osd.7' 2024-09-21T02:37:02.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] boot 2024-09-21T02:37:02.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T02:37:02.744 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:02 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:02.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='osd.7 ' entity='osd.7' 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] boot 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T02:37:02.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:02 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='osd.7 ' entity='osd.7' 2024-09-21T02:37:03.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: osd.7 [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] boot 2024-09-21T02:37:03.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T02:37:03.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:02 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T02:37:03.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:03 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:37:03.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:03 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:37:03.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:03 smithi172 ceph-mon[35067]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:03.790 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:03 smithi172 ceph-mon[35067]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:37:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:03 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:37:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:03 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:37:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:03 smithi084 ceph-mon[30747]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:03 smithi084 ceph-mon[30747]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:37:04.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:03 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:37:04.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:03 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:37:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:03 smithi090 ceph-mon[34571]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:03 smithi090 ceph-mon[34571]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T02:37:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:05 smithi172 ceph-mon[35067]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T02:37:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:05 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/2312976291' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"} : dispatch 2024-09-21T02:37:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:05 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"} : dispatch 2024-09-21T02:37:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:05 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"}]': finished 2024-09-21T02:37:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:05 smithi172 ceph-mon[35067]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T02:37:06.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:05 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:06.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:05 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/1481973367' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:37:06.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:05 smithi172 ceph-mon[35067]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:05 smithi084 ceph-mon[30747]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T02:37:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:05 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/2312976291' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"} : dispatch 2024-09-21T02:37:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:05 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"} : dispatch 2024-09-21T02:37:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:05 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"}]': finished 2024-09-21T02:37:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:05 smithi084 ceph-mon[30747]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T02:37:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:05 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:05 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/1481973367' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:37:06.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:05 smithi084 ceph-mon[30747]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:05 smithi090 ceph-mon[34571]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T02:37:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:05 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/2312976291' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"} : dispatch 2024-09-21T02:37:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:05 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"} : dispatch 2024-09-21T02:37:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:05 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a9eb9c5-681c-4d53-bb24-a231ce58658e"}]': finished 2024-09-21T02:37:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:05 smithi090 ceph-mon[34571]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T02:37:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:05 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:06.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:05 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/1481973367' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:37:06.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:05 smithi090 ceph-mon[34571]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:09.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:08 smithi172 ceph-mon[35067]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:09.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:08 smithi084 ceph-mon[30747]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:09.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:08 smithi090 ceph-mon[34571]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:10.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:10 smithi090 ceph-mon[34571]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:37:10.846 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:10 smithi172 ceph-mon[35067]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:37:11.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:10 smithi084 ceph-mon[30747]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:37:12.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:12 smithi084 ceph-mon[30747]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T02:37:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:12 smithi172 ceph-mon[35067]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T02:37:13.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:12 smithi090 ceph-mon[34571]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T02:37:13.693 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:37:13.693 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:13 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:13.694 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:13 smithi172 ceph-mon[35067]: Deploying daemon osd.8 on smithi172 2024-09-21T02:37:13.694 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:13 smithi172 ceph-mon[35067]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T02:37:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:37:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:13 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:13 smithi084 ceph-mon[30747]: Deploying daemon osd.8 on smithi172 2024-09-21T02:37:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:13 smithi084 ceph-mon[30747]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T02:37:14.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T02:37:14.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:13 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:14.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:13 smithi090 ceph-mon[34571]: Deploying daemon osd.8 on smithi172 2024-09-21T02:37:14.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:13 smithi090 ceph-mon[34571]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T02:37:16.860 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:16 smithi172 ceph-mon[35067]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T02:37:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:16 smithi084 ceph-mon[30747]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T02:37:17.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:16 smithi090 ceph-mon[34571]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T02:37:18.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:18 smithi172 ceph-mon[35067]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:37:19.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:18 smithi084 ceph-mon[30747]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:37:19.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:18 smithi090 ceph-mon[34571]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:37:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:19 smithi172 ceph-mon[35067]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:37:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:19 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:19 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:19 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:20.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:19 smithi084 ceph-mon[30747]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:37:20.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:19 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:20.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:19 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:20.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:19 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:20.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:19 smithi090 ceph-mon[34571]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:37:20.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:19 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:20.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:19 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:20.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:19 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:22.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:22 smithi172 ceph-mon[35067]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:23.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:22 smithi084 ceph-mon[30747]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:23.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:22 smithi090 ceph-mon[34571]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:23.722 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:23 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:23.722 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:23 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:23.722 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:23 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:23.723 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:23 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:23.723 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:23 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:23.723 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:23 smithi172 ceph-mon[35067]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:23.767 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.766+0000 7f441affd640 1 -- 172.21.15.172:0/3765732346 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4428063800 con 0x7f44140b6510 2024-09-21T02:37:23.767 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 8 on host 'smithi172' 2024-09-21T02:37:23.769 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.767+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44140b6510 msgr2=0x7f44140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.767+0000 7f442fd52640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44140b6510 0x7f44140b8a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f441c0058c0 tx=0x7f441c005850 comp rx=0 tx=0).stop 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4428103770 msgr2=0x7f442819a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4428103770 0x7f442819a030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f442400e9f0 tx=0x7f442400edf0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 shutdown_connections 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44281051a0 0x7f442819b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4428104800 0x7f442819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44140b6510 0x7f44140b8a20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 --2- 172.21.15.172:0/3765732346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4428103770 0x7f442819a030 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 >> 172.21.15.172:0/3765732346 conn(0x7f44280ff0c0 msgr2=0x7f4428107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 shutdown_connections 2024-09-21T02:37:23.770 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:37:23.768+0000 7f442fd52640 1 -- 172.21.15.172:0/3765732346 wait complete. 2024-09-21T02:37:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:23 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:23 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:23 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:23 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:23 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:23 smithi084 ceph-mon[30747]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:23 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:23 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:23 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:23 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:23 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:23 smithi090 ceph-mon[34571]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:24.428 DEBUG:teuthology.orchestra.run.smithi172:osd.8> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T02:37:24.431 INFO:tasks.cephadm:Deploying osd.9 on smithi084 with /dev/vg_nvme/lv_1... 2024-09-21T02:37:24.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:37:24.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:24.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.805 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:37:24.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:24.939 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:24.940 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:25.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:25.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:25.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:25.862 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:25 smithi172 ceph-mon[35067]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:25.979 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:25 smithi084 ceph-mon[30747]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:26.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:25 smithi090 ceph-mon[34571]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:26.113 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:37:25 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:37:25.947+0000 7f422a2ca640 -1 osd.8 0 log_to_monitors true 2024-09-21T02:37:27.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:26 smithi172 ceph-mon[35067]: from='osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:37:27.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:26 smithi172 ceph-mon[35067]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:37:27.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:26 smithi084 ceph-mon[30747]: from='osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:37:27.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:26 smithi084 ceph-mon[30747]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:37:27.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:26 smithi090 ceph-mon[34571]: from='osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:37:27.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:26 smithi090 ceph-mon[34571]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T02:37:27.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:37:27.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:37:27.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:27.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi172 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:27.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:27 smithi172 ceph-mon[35067]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:27.954 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi172 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:27.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-21T02:37:27.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:27.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:27.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:27.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:27.956 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:27 smithi084 ceph-mon[30747]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi172 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:37:28.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-21T02:37:28.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:28.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:28.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:28.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:28.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:27 smithi090 ceph-mon[34571]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:28.063 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:37:28.096 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_1 2024-09-21T02:37:28.471 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:37:28.708 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:37:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:37:28.411+0000 7f422624c640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T02:37:28.708 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:37:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:37:28.420+0000 7f421e042640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:37:28.967 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:28 smithi084 ceph-mon[30747]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:37:28.967 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:28 smithi084 ceph-mon[30747]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T02:37:28.967 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:28.968 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:28.968 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:28 smithi084 ceph-mon[30747]: from='osd.8 ' entity='osd.8' 2024-09-21T02:37:29.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:28 smithi172 ceph-mon[35067]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:37:29.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:28 smithi172 ceph-mon[35067]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T02:37:29.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:29.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:29.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:28 smithi172 ceph-mon[35067]: from='osd.8 ' entity='osd.8' 2024-09-21T02:37:29.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:28 smithi090 ceph-mon[34571]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:37:29.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:28 smithi090 ceph-mon[34571]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T02:37:29.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:29.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:29.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:28 smithi090 ceph-mon[34571]: from='osd.8 ' entity='osd.8' 2024-09-21T02:37:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 -- 172.21.15.84:0/867230955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c105790 msgr2=0x7fa23c105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 --2- 172.21.15.84:0/867230955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c105790 0x7fa23c105c00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa230009900 tx=0x7fa23002a480 comp rx=0 tx=0).stop 2024-09-21T02:37:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 -- 172.21.15.84:0/867230955 shutdown_connections 2024-09-21T02:37:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 --2- 172.21.15.84:0/867230955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c106820 0x7fa23c106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 --2- 172.21.15.84:0/867230955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa23c1071c0 0x7fa23c10db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 --2- 172.21.15.84:0/867230955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c105790 0x7fa23c105c00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 -- 172.21.15.84:0/867230955 >> 172.21.15.84:0/867230955 conn(0x7fa23c101100 msgr2=0x7fa23c1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:29.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 -- 172.21.15.84:0/867230955 shutdown_connections 2024-09-21T02:37:29.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.143+0000 7fa242e00640 1 -- 172.21.15.84:0/867230955 wait complete. 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.144+0000 7fa242e00640 1 Processor -- start 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.144+0000 7fa242e00640 1 -- start start 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.144+0000 7fa242e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa23c105790 0x7fa23c19c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa242e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c106820 0x7fa23c19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa242e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c1071c0 0x7fa23c19d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa242e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c111510 con 0x7fa23c1071c0 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa242e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c111390 con 0x7fa23c105790 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa242e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c111690 con 0x7fa23c106820 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa23c105790 0x7fa23c19c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa23c105790 0x7fa23c19c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:38122/0 (socket says 172.21.15.84:38122) 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241a00640 1 -- 172.21.15.84:0/3418379189 learned_addr learned my addr 172.21.15.84:0/3418379189 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa242400640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c1071c0 0x7fa23c19d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:29.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241000640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c106820 0x7fa23c19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241a00640 1 -- 172.21.15.84:0/3418379189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c106820 msgr2=0x7fa23c19c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241a00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c106820 0x7fa23c19c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241a00640 1 -- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c1071c0 msgr2=0x7fa23c19d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241a00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c1071c0 0x7fa23c19d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa241a00640 1 -- 172.21.15.84:0/3418379189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c19db30 con 0x7fa23c105790 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.145+0000 7fa242400640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c1071c0 0x7fa23c19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.146+0000 7fa241a00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa23c105790 0x7fa23c19c170 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa230006010 tx=0x7fa2300042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.146+0000 7fa23a000640 1 -- 172.21.15.84:0/3418379189 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23003f030 con 0x7fa23c105790 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.146+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23c19ddc0 con 0x7fa23c105790 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.146+0000 7fa23a000640 1 -- 172.21.15.84:0/3418379189 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa230003cd0 con 0x7fa23c105790 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.146+0000 7fa23a000640 1 -- 172.21.15.84:0/3418379189 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230035070 con 0x7fa23c105790 2024-09-21T02:37:29.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.146+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa23c1a4520 con 0x7fa23c105790 2024-09-21T02:37:29.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.147+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23c105c00 con 0x7fa23c105790 2024-09-21T02:37:29.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.150+0000 7fa23a000640 1 -- 172.21.15.84:0/3418379189 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa230042030 con 0x7fa23c105790 2024-09-21T02:37:29.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.151+0000 7fa23a000640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2240b6510 0x7fa2240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:37:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.152+0000 7fa23a000640 1 -- 172.21.15.84:0/3418379189 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5862+0+0 (secure 0 0 0) 0x7fa230107260 con 0x7fa23c105790 2024-09-21T02:37:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.152+0000 7fa241000640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2240b6510 0x7fa2240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:37:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.152+0000 7fa241000640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2240b6510 0x7fa2240b8a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa228009bd0 tx=0x7fa228005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:37:29.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.154+0000 7fa23a000640 1 -- 172.21.15.84:0/3418379189 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2300d27c0 con 0x7fa23c105790 2024-09-21T02:37:29.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:29.350+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa23c063800 con 0x7fa2240b6510 2024-09-21T02:37:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:37:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:37:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] boot 2024-09-21T02:37:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T02:37:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:30.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:30.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:37:30.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:37:30.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:30.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:29 smithi172 ceph-mon[35067]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] boot 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:29 smithi084 ceph-mon[30747]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: osd.8 [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] boot 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: from='client.24497 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:29 smithi090 ceph-mon[34571]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T02:37:31.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:30 smithi172 ceph-mon[35067]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:37:31.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:30 smithi084 ceph-mon[30747]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:37:31.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:30 smithi090 ceph-mon[34571]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T02:37:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:31 smithi172 ceph-mon[35067]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T02:37:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:31 smithi172 ceph-mon[35067]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:32.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:31 smithi084 ceph-mon[30747]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T02:37:32.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:31 smithi084 ceph-mon[30747]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:32.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:31 smithi090 ceph-mon[34571]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T02:37:32.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:31 smithi090 ceph-mon[34571]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:32 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2944236141' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"} : dispatch 2024-09-21T02:37:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:32 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"} : dispatch 2024-09-21T02:37:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:32 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"}]': finished 2024-09-21T02:37:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:32 smithi172 ceph-mon[35067]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T02:37:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:33.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:32 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2944236141' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"} : dispatch 2024-09-21T02:37:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:32 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"} : dispatch 2024-09-21T02:37:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:32 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"}]': finished 2024-09-21T02:37:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:32 smithi084 ceph-mon[30747]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T02:37:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:33.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:32 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2944236141' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"} : dispatch 2024-09-21T02:37:33.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:32 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"} : dispatch 2024-09-21T02:37:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:32 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8"}]': finished 2024-09-21T02:37:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:32 smithi090 ceph-mon[34571]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T02:37:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:34.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:33 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3003925374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:37:34.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:33 smithi172 ceph-mon[35067]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T02:37:34.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:33 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3003925374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:37:34.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:33 smithi084 ceph-mon[30747]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T02:37:34.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:33 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3003925374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:37:34.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:33 smithi090 ceph-mon[34571]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 804 GiB / 805 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T02:37:37.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:36 smithi172 ceph-mon[35067]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:37:37.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:36 smithi084 ceph-mon[30747]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:37:37.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:36 smithi090 ceph-mon[34571]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T02:37:39.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:38 smithi172 ceph-mon[35067]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T02:37:39.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:38 smithi084 ceph-mon[30747]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T02:37:39.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:38 smithi090 ceph-mon[34571]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-21T02:37:40.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:39 smithi172 ceph-mon[35067]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T02:37:40.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:39 smithi084 ceph-mon[30747]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T02:37:40.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:39 smithi090 ceph-mon[34571]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T02:37:42.841 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:42 smithi084 ceph-mon[30747]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:37:42.842 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:37:42.842 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:42 smithi172 ceph-mon[35067]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:37:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:37:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:43.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:42 smithi090 ceph-mon[34571]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:37:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T02:37:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:43.905 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:43 smithi084 ceph-mon[30747]: Deploying daemon osd.9 on smithi084 2024-09-21T02:37:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:43 smithi172 ceph-mon[35067]: Deploying daemon osd.9 on smithi084 2024-09-21T02:37:44.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:43 smithi090 ceph-mon[34571]: Deploying daemon osd.9 on smithi084 2024-09-21T02:37:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:44 smithi172 ceph-mon[35067]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:45.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:44 smithi084 ceph-mon[30747]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:45.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:44 smithi090 ceph-mon[34571]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:45.682 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:45 smithi084 ceph-mon[30747]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:45 smithi172 ceph-mon[35067]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:46.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:45 smithi090 ceph-mon[34571]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:48 smithi172 ceph-mon[35067]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:49.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:48 smithi084 ceph-mon[30747]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:49.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:48 smithi090 ceph-mon[34571]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:50 smithi172 ceph-mon[35067]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:51.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:50 smithi084 ceph-mon[30747]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:51.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:51.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:51.010 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:51.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:50 smithi090 ceph-mon[34571]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:51.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:51 smithi172 ceph-mon[35067]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:52.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:51 smithi084 ceph-mon[30747]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:52.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:51 smithi090 ceph-mon[34571]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:54.717 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:54 smithi084 ceph-mon[30747]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:54.718 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:54.718 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:54.718 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:54.718 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:54.718 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:54 smithi172 ceph-mon[35067]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:55.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:54 smithi090 ceph-mon[34571]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:55.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:55.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:55.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:37:55.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:37:55.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:55.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.224+0000 7fa23a000640 1 -- 172.21.15.84:0/3418379189 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa23c063800 con 0x7fa2240b6510 2024-09-21T02:37:55.227 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 9 on host 'smithi084' 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.227+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2240b6510 msgr2=0x7fa2240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.227+0000 7fa242e00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2240b6510 0x7fa2240b8a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa228009bd0 tx=0x7fa228005f90 comp rx=0 tx=0).stop 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.227+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa23c105790 msgr2=0x7fa23c19c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.227+0000 7fa242e00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa23c105790 0x7fa23c19c170 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa230006010 tx=0x7fa2300042f0 comp rx=0 tx=0).stop 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.228+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 shutdown_connections 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.228+0000 7fa242e00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2240b6510 0x7fa2240b8a20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.228+0000 7fa242e00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa23c106820 0x7fa23c19c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.228+0000 7fa242e00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa23c1071c0 0x7fa23c19d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:55.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.228+0000 7fa242e00640 1 --2- 172.21.15.84:0/3418379189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa23c105790 0x7fa23c19c170 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:37:55.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.228+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 >> 172.21.15.84:0/3418379189 conn(0x7fa23c101100 msgr2=0x7fa23c109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:37:55.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.228+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 shutdown_connections 2024-09-21T02:37:55.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:37:55.228+0000 7fa242e00640 1 -- 172.21.15.84:0/3418379189 wait complete. 2024-09-21T02:37:55.984 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:55 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:55.984 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:55 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:55.984 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:55 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:56.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:55 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:56.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:55 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:56.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:55 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:56.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:55 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:37:56.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:55 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:56.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:55 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:37:56.159 DEBUG:teuthology.orchestra.run.smithi084:osd.9> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T02:37:56.164 INFO:tasks.cephadm:Deploying osd.10 on smithi090 with /dev/vg_nvme/lv_1... 2024-09-21T02:37:56.164 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:37:56.424 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:37:56.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:56 smithi084 ceph-mon[30747]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:56.795 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:56 smithi090 ceph-mon[34571]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:56.931 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:56 smithi172 ceph-mon[35067]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:57.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:37:56 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:37:56.729+0000 7f9521e1d640 -1 osd.9 0 log_to_monitors true 2024-09-21T02:37:57.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:57 smithi084 ceph-mon[30747]: from='osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:37:57.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:57 smithi084 ceph-mon[30747]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:37:57.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:57 smithi084 ceph-mon[30747]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:57.834 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:57 smithi090 ceph-mon[34571]: from='osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:37:57.835 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:57 smithi090 ceph-mon[34571]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:37:57.835 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:57 smithi090 ceph-mon[34571]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:57 smithi172 ceph-mon[35067]: from='osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:37:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:57 smithi172 ceph-mon[35067]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T02:37:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:57 smithi172 ceph-mon[35067]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:58.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:58 smithi090 ceph-mon[34571]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:37:58.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:58 smithi090 ceph-mon[34571]: from='osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:37:58.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:58 smithi090 ceph-mon[34571]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:37:58.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:58.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:58 smithi090 ceph-mon[34571]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:37:59.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:58 smithi172 ceph-mon[35067]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:37:59.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:58 smithi172 ceph-mon[35067]: from='osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:37:59.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:58 smithi172 ceph-mon[35067]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:37:59.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:59.287 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:58 smithi172 ceph-mon[35067]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:37:59.288 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:58 smithi084 ceph-mon[30747]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T02:37:59.288 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:58 smithi084 ceph-mon[30747]: from='osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:37:59.288 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:58 smithi084 ceph-mon[30747]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T02:37:59.288 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:59.288 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:58 smithi084 ceph-mon[30747]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T02:37:59.289 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:37:58 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:37:58.626+0000 7f951ca00640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T02:37:59.289 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:37:58 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:37:58.648+0000 7f9517a00640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:37:59.290 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-09-21T02:37:59.290 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi090:vg_nvme/lv_1 2024-09-21T02:37:59.539 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:37:59.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:59 smithi084 ceph-mon[30747]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:37:59.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:59 smithi084 ceph-mon[30747]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T02:37:59.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:59.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:59 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:59.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:37:59 smithi084 ceph-mon[30747]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:37:59.946 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:59 smithi090 ceph-mon[34571]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:37:59.946 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:59 smithi090 ceph-mon[34571]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T02:37:59.946 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:59.946 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:59 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:37:59.946 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:37:59 smithi090 ceph-mon[34571]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:38:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:59 smithi172 ceph-mon[35067]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T02:38:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:59 smithi172 ceph-mon[35067]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T02:38:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:38:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:59 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:38:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:37:59 smithi172 ceph-mon[35067]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 285 MiB used, 804 GiB / 805 GiB avail 2024-09-21T02:38:00.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 -- 172.21.15.90:0/1688747783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac103750 msgr2=0x7fe7ac103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:00.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/1688747783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac103750 0x7fe7ac103bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009900 tx=0x7fe79c02a480 comp rx=0 tx=0).stop 2024-09-21T02:38:00.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 -- 172.21.15.90:0/1688747783 shutdown_connections 2024-09-21T02:38:00.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/1688747783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac105180 0x7fe7ac10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:00.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/1688747783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac1047e0 0x7fe7ac104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:00.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/1688747783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac103750 0x7fe7ac103bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 -- 172.21.15.90:0/1688747783 >> 172.21.15.90:0/1688747783 conn(0x7fe7ac0ff0c0 msgr2=0x7fe7ac101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 -- 172.21.15.90:0/1688747783 shutdown_connections 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.039+0000 7fe7b27dc640 1 -- 172.21.15.90:0/1688747783 wait complete. 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.040+0000 7fe7b27dc640 1 Processor -- start 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.040+0000 7fe7b27dc640 1 -- start start 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.040+0000 7fe7b27dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac103750 0x7fe7ac19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.040+0000 7fe7b27dc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac1047e0 0x7fe7ac19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.040+0000 7fe7b27dc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac105180 0x7fe7ac19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.040+0000 7fe7b27dc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac10f550 con 0x7fe7ac1047e0 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.040+0000 7fe7b27dc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac10f3d0 con 0x7fe7ac105180 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.040+0000 7fe7b27dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac10f6d0 con 0x7fe7ac103750 2024-09-21T02:38:00.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac105180 0x7fe7ac19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac105180 0x7fe7ac19b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51294/0 (socket says 172.21.15.90:51294) 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 -- 172.21.15.90:0/362178297 learned_addr learned my addr 172.21.15.90:0/362178297 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7abfff640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac103750 0x7fe7ac19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7ab7fe640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac1047e0 0x7fe7ac19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 -- 172.21.15.90:0/362178297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac103750 msgr2=0x7fe7ac19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac103750 0x7fe7ac19a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 -- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac1047e0 msgr2=0x7fe7ac19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac1047e0 0x7fe7ac19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 -- 172.21.15.90:0/362178297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac19bb10 con 0x7fe7ac105180 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b0d79640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac105180 0x7fe7ac19b2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400eaa0 tx=0x7fe7a400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7a97fa640 1 -- 172.21.15.90:0/362178297 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4004d20 con 0x7fe7ac105180 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7a97fa640 1 -- 172.21.15.90:0/362178297 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7a4005020 con 0x7fe7ac105180 2024-09-21T02:38:00.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac19be00 con 0x7fe7ac105180 2024-09-21T02:38:00.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7a97fa640 1 -- 172.21.15.90:0/362178297 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40116d0 con 0x7fe7ac105180 2024-09-21T02:38:00.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.041+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac1a2500 con 0x7fe7ac105180 2024-09-21T02:38:00.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.042+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac10a930 con 0x7fe7ac105180 2024-09-21T02:38:00.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.045+0000 7fe7a97fa640 1 -- 172.21.15.90:0/362178297 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe7a40051d0 con 0x7fe7ac105180 2024-09-21T02:38:00.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.045+0000 7fe7a97fa640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe7940b6510 0x7fe7940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:00.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.046+0000 7fe7a97fa640 1 -- 172.21.15.90:0/362178297 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6261+0+0 (secure 0 0 0) 0x7fe7a40e7020 con 0x7fe7ac105180 2024-09-21T02:38:00.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.046+0000 7fe7abfff640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe7940b6510 0x7fe7940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:00.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.047+0000 7fe7abfff640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe7940b6510 0x7fe7940b8a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe79c000c00 tx=0x7fe79c031470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:00.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.049+0000 7fe7a97fa640 1 -- 172.21.15.90:0/362178297 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7a4016030 con 0x7fe7ac105180 2024-09-21T02:38:00.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:00.236+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe7ac063800 con 0x7fe7940b6510 2024-09-21T02:38:00.883 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] boot 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi084 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:00.884 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='client.24524 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:38:00.885 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:00 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:01.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:38:01.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] boot 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi084 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T02:38:01.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:01.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:01.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:01.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:01.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='client.24524 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:01.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:38:01.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:38:01.008 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:00 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: osd.9 [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] boot 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi084 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='client.24524 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi090:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:38:01.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:00 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:02.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:01 smithi172 ceph-mon[35067]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T02:38:02.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:01 smithi172 ceph-mon[35067]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:02.008 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:01 smithi090 ceph-mon[34571]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T02:38:02.008 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:01 smithi090 ceph-mon[34571]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:02.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:01 smithi084 ceph-mon[30747]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T02:38:02.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:01 smithi084 ceph-mon[30747]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:03.112 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:02 smithi090 ceph-mon[34571]: from='client.? 172.21.15.90:0/2307970530' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"} : dispatch 2024-09-21T02:38:03.112 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:02 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"} : dispatch 2024-09-21T02:38:03.112 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:02 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"}]': finished 2024-09-21T02:38:03.112 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:02 smithi090 ceph-mon[34571]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T02:38:03.112 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:02 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:02 smithi172 ceph-mon[35067]: from='client.? 172.21.15.90:0/2307970530' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"} : dispatch 2024-09-21T02:38:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:02 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"} : dispatch 2024-09-21T02:38:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:02 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"}]': finished 2024-09-21T02:38:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:02 smithi172 ceph-mon[35067]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T02:38:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:02 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:03.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:02 smithi084 ceph-mon[30747]: from='client.? 172.21.15.90:0/2307970530' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"} : dispatch 2024-09-21T02:38:03.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:02 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"} : dispatch 2024-09-21T02:38:03.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:02 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b971755-045e-4107-aeb2-22aa69cfdea3"}]': finished 2024-09-21T02:38:03.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:02 smithi084 ceph-mon[30747]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T02:38:03.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:02 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:04.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:03 smithi172 ceph-mon[35067]: from='client.? 172.21.15.90:0/2872202201' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:38:04.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:03 smithi172 ceph-mon[35067]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:04.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:03 smithi084 ceph-mon[30747]: from='client.? 172.21.15.90:0/2872202201' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:38:04.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:03 smithi084 ceph-mon[30747]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:04.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:03 smithi090 ceph-mon[34571]: from='client.? 172.21.15.90:0/2872202201' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:38:04.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:03 smithi090 ceph-mon[34571]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:06.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:06 smithi172 ceph-mon[35067]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:07.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:06 smithi084 ceph-mon[30747]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:07.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:06 smithi090 ceph-mon[34571]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:08.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:07 smithi172 ceph-mon[35067]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:08.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:07 smithi084 ceph-mon[30747]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:08.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:07 smithi090 ceph-mon[34571]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:10.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:10 smithi090 ceph-mon[34571]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:10 smithi172 ceph-mon[35067]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:11.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:10 smithi084 ceph-mon[30747]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:11.890 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:11 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:38:11.891 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:11 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:11 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:38:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:11 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:11 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T02:38:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:11 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:12.981 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:12 smithi090 ceph-mon[34571]: Deploying daemon osd.10 on smithi090 2024-09-21T02:38:12.981 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:12 smithi090 ceph-mon[34571]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:12 smithi172 ceph-mon[35067]: Deploying daemon osd.10 on smithi090 2024-09-21T02:38:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:12 smithi172 ceph-mon[35067]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:13.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:12 smithi084 ceph-mon[30747]: Deploying daemon osd.10 on smithi090 2024-09-21T02:38:13.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:12 smithi084 ceph-mon[30747]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:13.899 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:13 smithi090 ceph-mon[34571]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:13 smithi172 ceph-mon[35067]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:14.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:13 smithi084 ceph-mon[30747]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:16.924 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:16 smithi090 ceph-mon[34571]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:16 smithi172 ceph-mon[35067]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:17.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:16 smithi084 ceph-mon[30747]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:17.857 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:17 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:17.857 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:17 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:17.857 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:17 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:17 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:17 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:17 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:18.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:17 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:17 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:17 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:18.974 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:18 smithi090 ceph-mon[34571]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:19.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:18 smithi172 ceph-mon[35067]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:19.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:18 smithi084 ceph-mon[30747]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:19.990 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:19 smithi090 ceph-mon[34571]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:19 smithi172 ceph-mon[35067]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:20.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:19 smithi084 ceph-mon[30747]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:21.057 INFO:teuthology.orchestra.run.smithi090.stdout:Created osd(s) 10 on host 'smithi090' 2024-09-21T02:38:21.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.056+0000 7fe7a97fa640 1 -- 172.21.15.90:0/362178297 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe7ac063800 con 0x7fe7940b6510 2024-09-21T02:38:21.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe7940b6510 msgr2=0x7fe7940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe7940b6510 0x7fe7940b8a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe79c000c00 tx=0x7fe79c031470 comp rx=0 tx=0).stop 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac105180 msgr2=0x7fe7ac19b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac105180 0x7fe7ac19b2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400eaa0 tx=0x7fe7a400eea0 comp rx=0 tx=0).stop 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 shutdown_connections 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7ac105180 0x7fe7ac19b2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7ac1047e0 0x7fe7ac19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe7940b6510 0x7fe7940b8a20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 --2- 172.21.15.90:0/362178297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7ac103750 0x7fe7ac19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.058+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 >> 172.21.15.90:0/362178297 conn(0x7fe7ac0ff0c0 msgr2=0x7fe7ac107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.059+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 shutdown_connections 2024-09-21T02:38:21.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-09-21T02:38:21.059+0000 7fe7b27dc640 1 -- 172.21.15.90:0/362178297 wait complete. 2024-09-21T02:38:21.711 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:21 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.712 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:21 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.712 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:21 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:21.712 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:21 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:21.712 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:21 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.712 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:21 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:21.712 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:21 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.712 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:21 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.745 DEBUG:teuthology.orchestra.run.smithi090:osd.10> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T02:38:21.747 INFO:tasks.cephadm:Deploying osd.11 on smithi172 with /dev/vg_nvme/lv_1... 2024-09-21T02:38:21.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T02:38:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:21 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:21 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:21 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:21 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:21.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:21 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:21.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:21 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:21 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:21.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:21 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:21.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:21 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:22.005 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:38:22.384 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:22 smithi172 ceph-mon[35067]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:22.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:22 smithi084 ceph-mon[30747]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:22.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:22 smithi090 ceph-mon[34571]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:23.412 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:23 smithi172 ceph-mon[35067]: from='osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:38:23.413 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:23 smithi172 ceph-mon[35067]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:38:23.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:23 smithi090 ceph-mon[34571]: from='osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:38:23.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:23 smithi090 ceph-mon[34571]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:38:23.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:38:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:38:23.250+0000 7fd4e6b60640 -1 osd.10 0 log_to_monitors true 2024-09-21T02:38:23.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:23 smithi084 ceph-mon[30747]: from='osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:38:23.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:23 smithi084 ceph-mon[30747]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T02:38:24.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:24 smithi090 ceph-mon[34571]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:38:24.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:24 smithi090 ceph-mon[34571]: from='osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:38:24.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:24 smithi090 ceph-mon[34571]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:38:24.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:24.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:24 smithi090 ceph-mon[34571]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:38:24.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:24 smithi090 ceph-mon[34571]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:24.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:38:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:38:24.356+0000 7fd4e2ae2640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T02:38:24.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:38:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:38:24.369+0000 7fd4de8e0640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:38:24.741 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:24 smithi172 ceph-mon[35067]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:38:24.741 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:24 smithi172 ceph-mon[35067]: from='osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:38:24.741 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:24 smithi172 ceph-mon[35067]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:38:24.741 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:24.741 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:24 smithi172 ceph-mon[35067]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:38:24.741 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:24 smithi172 ceph-mon[35067]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:24.743 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T02:38:24.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:24 smithi084 ceph-mon[30747]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T02:38:24.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:24 smithi084 ceph-mon[30747]: from='osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:38:24.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:24 smithi084 ceph-mon[30747]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T02:38:24.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:24.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:24 smithi084 ceph-mon[30747]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]} : dispatch 2024-09-21T02:38:24.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:24 smithi084 ceph-mon[30747]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:24.768 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-09-21T02:38:25.050 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:38:25.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:38:25.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T02:38:25.452 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:25.453 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 -- 172.21.15.172:0/1264098707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 msgr2=0x7f5a74102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:25.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 --2- 172.21.15.172:0/1264098707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 0x7f5a74102af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009900 tx=0x7f5a6802a480 comp rx=0 tx=0).stop 2024-09-21T02:38:25.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 -- 172.21.15.172:0/1264098707 shutdown_connections 2024-09-21T02:38:25.555 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 --2- 172.21.15.172:0/1264098707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a741040b0 0x7f5a7410aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:25.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 --2- 172.21.15.172:0/1264098707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a74103710 0x7f5a74103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:25.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 --2- 172.21.15.172:0/1264098707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 0x7f5a74102af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:25.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 -- 172.21.15.172:0/1264098707 >> 172.21.15.172:0/1264098707 conn(0x7f5a740fdff0 msgr2=0x7f5a741004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:25.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 -- 172.21.15.172:0/1264098707 shutdown_connections 2024-09-21T02:38:25.556 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.546+0000 7f5a7b250640 1 -- 172.21.15.172:0/1264098707 wait complete. 2024-09-21T02:38:25.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a7b250640 1 Processor -- start 2024-09-21T02:38:25.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a7b250640 1 -- start start 2024-09-21T02:38:25.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a7b250640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 0x7f5a74198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:25.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a7b250640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74103710 0x7f5a74199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:25.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a7b250640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a741040b0 0x7f5a7419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:25.557 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a7b250640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7410e460 con 0x7f5a741040b0 2024-09-21T02:38:25.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a7b250640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7410e2e0 con 0x7f5a74103710 2024-09-21T02:38:25.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a7b250640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7410e5e0 con 0x7f5a74102680 2024-09-21T02:38:25.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a78fec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 0x7f5a74198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:25.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a78fec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 0x7f5a74198ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:36284/0 (socket says 172.21.15.172:36284) 2024-09-21T02:38:25.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a78fec640 1 -- 172.21.15.172:0/596676747 learned_addr learned my addr 172.21.15.172:0/596676747 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T02:38:25.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a73fff640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74103710 0x7f5a74199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:25.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a78fec640 1 -- 172.21.15.172:0/596676747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74103710 msgr2=0x7f5a74199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:25.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a78fec640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74103710 0x7f5a74199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:25.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a78fec640 1 -- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a741040b0 msgr2=0x7f5a7419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:25.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a797ed640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a741040b0 0x7f5a7419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:25.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a78fec640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a741040b0 0x7f5a7419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:25.559 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a78fec640 1 -- 172.21.15.172:0/596676747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7419aa20 con 0x7f5a74102680 2024-09-21T02:38:25.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.547+0000 7f5a797ed640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a741040b0 0x7f5a7419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:38:25.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.548+0000 7f5a78fec640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 0x7f5a74198ff0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006010 tx=0x7f5a68004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:25.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.548+0000 7f5a71ffb640 1 -- 172.21.15.172:0/596676747 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6803f030 con 0x7f5a74102680 2024-09-21T02:38:25.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.548+0000 7f5a71ffb640 1 -- 172.21.15.172:0/596676747 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a68003cd0 con 0x7f5a74102680 2024-09-21T02:38:25.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.548+0000 7f5a71ffb640 1 -- 172.21.15.172:0/596676747 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68035070 con 0x7f5a74102680 2024-09-21T02:38:25.560 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.548+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7419acb0 con 0x7f5a74102680 2024-09-21T02:38:25.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.548+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a741a1410 con 0x7f5a74102680 2024-09-21T02:38:25.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.549+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a74109860 con 0x7f5a74102680 2024-09-21T02:38:25.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.550+0000 7f5a71ffb640 1 -- 172.21.15.172:0/596676747 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f5a68042030 con 0x7f5a74102680 2024-09-21T02:38:25.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.551+0000 7f5a71ffb640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5a640b6590 0x7f5a640b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:25.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.552+0000 7f5a71ffb640 1 -- 172.21.15.172:0/596676747 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6727+0+0 (secure 0 0 0) 0x7f5a681074c0 con 0x7f5a74102680 2024-09-21T02:38:25.561 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.552+0000 7f5a73fff640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5a640b6590 0x7f5a640b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:25.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.553+0000 7f5a73fff640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5a640b6590 0x7f5a640b8aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a600058c0 tx=0x7f5a6000a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:25.562 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.556+0000 7f5a71ffb640 1 -- 172.21.15.172:0/596676747 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a680ce380 con 0x7f5a74102680 2024-09-21T02:38:25.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:25.746+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5a74063800 con 0x7f5a640b6590 2024-09-21T02:38:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:38:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T02:38:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:25.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:25.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi090", "root=default"]}]': finished 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:25.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:25.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:26.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:38:26.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:38:26.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi090 2024-09-21T02:38:26.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi090 to 4272M 2024-09-21T02:38:26.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] boot 2024-09-21T02:38:26.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T02:38:26.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:26.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:26.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:38:26.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:38:26.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:26 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi090 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi090 to 4272M 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] boot 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:26.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:38:26.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:38:26.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:26 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:26.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:38:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:38:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi090 2024-09-21T02:38:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi090 to 4272M 2024-09-21T02:38:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: osd.10 [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] boot 2024-09-21T02:38:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T02:38:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T02:38:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-09-21T02:38:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T02:38:26.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T02:38:26.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:26 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:27.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:27 smithi172 ceph-mon[35067]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:27.475 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:27 smithi172 ceph-mon[35067]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:38:27.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:27 smithi084 ceph-mon[30747]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:27.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:27 smithi084 ceph-mon[30747]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:38:27.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:27 smithi090 ceph-mon[34571]: from='client.24565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:27.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:27 smithi090 ceph-mon[34571]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T02:38:28.668 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:28 smithi090 ceph-mon[34571]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T02:38:28.669 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:28 smithi090 ceph-mon[34571]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:28.669 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:28 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/2652131932' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"} : dispatch 2024-09-21T02:38:28.669 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:28 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"} : dispatch 2024-09-21T02:38:28.669 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:28 smithi090 ceph-mon[34571]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"}]': finished 2024-09-21T02:38:28.669 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:28 smithi090 ceph-mon[34571]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T02:38:28.669 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:28.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:28 smithi172 ceph-mon[35067]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T02:38:28.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:28 smithi172 ceph-mon[35067]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:28.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:28 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/2652131932' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"} : dispatch 2024-09-21T02:38:28.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:28 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"} : dispatch 2024-09-21T02:38:28.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:28 smithi172 ceph-mon[35067]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"}]': finished 2024-09-21T02:38:28.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:28 smithi172 ceph-mon[35067]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T02:38:28.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:28.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:28 smithi084 ceph-mon[30747]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T02:38:28.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:28 smithi084 ceph-mon[30747]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:28.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:28 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/2652131932' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"} : dispatch 2024-09-21T02:38:28.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:28 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"} : dispatch 2024-09-21T02:38:28.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:28 smithi084 ceph-mon[30747]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "326bf4e4-01ff-42e4-8092-7c2d418273d7"}]': finished 2024-09-21T02:38:28.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:28 smithi084 ceph-mon[30747]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T02:38:28.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:29.684 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:29 smithi090 ceph-mon[34571]: from='client.? 172.21.15.172:0/915352506' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:38:29.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:29 smithi172 ceph-mon[35067]: from='client.? 172.21.15.172:0/915352506' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:38:29.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:29 smithi084 ceph-mon[30747]: from='client.? 172.21.15.172:0/915352506' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T02:38:30.664 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:30 smithi084 ceph-mon[30747]: pgmap v260: 1 pgs: 1 activating+degraded; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:38:30.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:30 smithi172 ceph-mon[35067]: pgmap v260: 1 pgs: 1 activating+degraded; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:38:30.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:30 smithi090 ceph-mon[34571]: pgmap v260: 1 pgs: 1 activating+degraded; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:38:31.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:31 smithi172 ceph-mon[35067]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-21T02:38:31.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:31 smithi084 ceph-mon[30747]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-21T02:38:31.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:31 smithi090 ceph-mon[34571]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-21T02:38:32.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:32 smithi172 ceph-mon[35067]: pgmap v261: 1 pgs: 1 activating+degraded; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:38:32.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:32 smithi084 ceph-mon[30747]: pgmap v261: 1 pgs: 1 activating+degraded; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:38:32.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:32 smithi090 ceph-mon[34571]: pgmap v261: 1 pgs: 1 activating+degraded; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-21T02:38:33.930 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:33 smithi172 ceph-mon[35067]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T02:38:33.930 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:33 smithi172 ceph-mon[35067]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-21T02:38:33.930 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:33 smithi172 ceph-mon[35067]: Cluster is now healthy 2024-09-21T02:38:34.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:33 smithi084 ceph-mon[30747]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T02:38:34.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:33 smithi084 ceph-mon[30747]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-21T02:38:34.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:33 smithi084 ceph-mon[30747]: Cluster is now healthy 2024-09-21T02:38:34.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:33 smithi090 ceph-mon[34571]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T02:38:34.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:33 smithi090 ceph-mon[34571]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-21T02:38:34.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:33 smithi090 ceph-mon[34571]: Cluster is now healthy 2024-09-21T02:38:35.891 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:35 smithi172 ceph-mon[35067]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T02:38:36.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:35 smithi084 ceph-mon[30747]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T02:38:36.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:35 smithi090 ceph-mon[34571]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T02:38:37.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:38:37.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:37.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:38:37.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:37.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T02:38:37.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:38.087 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:37 smithi172 ceph-mon[35067]: Deploying daemon osd.11 on smithi172 2024-09-21T02:38:38.087 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:37 smithi172 ceph-mon[35067]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:38:38.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:37 smithi084 ceph-mon[30747]: Deploying daemon osd.11 on smithi172 2024-09-21T02:38:38.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:37 smithi084 ceph-mon[30747]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:38:38.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:37 smithi090 ceph-mon[34571]: Deploying daemon osd.11 on smithi172 2024-09-21T02:38:38.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:37 smithi090 ceph-mon[34571]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T02:38:40.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:39 smithi172 ceph-mon[35067]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T02:38:40.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:39 smithi084 ceph-mon[30747]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T02:38:40.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:39 smithi090 ceph-mon[34571]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T02:38:42.005 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:41 smithi172 ceph-mon[35067]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:38:42.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:41 smithi084 ceph-mon[30747]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:38:42.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:41 smithi090 ceph-mon[34571]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:38:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:43.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:43.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:43.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:43.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:43 smithi172 ceph-mon[35067]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:38:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:43 smithi084 ceph-mon[30747]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:38:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:43 smithi090 ceph-mon[34571]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T02:38:46.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.374+0000 7f5a71ffb640 1 -- 172.21.15.172:0/596676747 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5a74063800 con 0x7f5a640b6590 2024-09-21T02:38:46.375 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 11 on host 'smithi172' 2024-09-21T02:38:46.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5a640b6590 msgr2=0x7f5a640b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:46.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5a640b6590 0x7f5a640b8aa0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a600058c0 tx=0x7f5a6000a4c0 comp rx=0 tx=0).stop 2024-09-21T02:38:46.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 msgr2=0x7f5a74198ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 0x7f5a74198ff0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006010 tx=0x7f5a68004430 comp rx=0 tx=0).stop 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 shutdown_connections 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a741040b0 0x7f5a7419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a74103710 0x7f5a74199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5a640b6590 0x7f5a640b8aa0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 --2- 172.21.15.172:0/596676747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a74102680 0x7f5a74198ff0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.376+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 >> 172.21.15.172:0/596676747 conn(0x7f5a740fdff0 msgr2=0x7f5a74106a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.377+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 shutdown_connections 2024-09-21T02:38:46.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:46.377+0000 7f5a7b250640 1 -- 172.21.15.172:0/596676747 wait complete. 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.743 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:47.080 DEBUG:teuthology.orchestra.run.smithi172:osd.11> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T02:38:47.083 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T02:38:47.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T02:38:47.459 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:47.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:47 smithi084 ceph-mon[30747]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:47.934 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:47 smithi172 ceph-mon[35067]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:48.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:47 smithi090 ceph-mon[34571]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:48.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 -- 172.21.15.84:0/1605914437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 msgr2=0x7ff098079fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:48.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 --2- 172.21.15.84:0/1605914437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 0x7ff098079fb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff090009ca0 tx=0x7ff09002a950 comp rx=0 tx=0).stop 2024-09-21T02:38:48.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 -- 172.21.15.84:0/1605914437 shutdown_connections 2024-09-21T02:38:48.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 --2- 172.21.15.84:0/1605914437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 0x7ff098079fb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 --2- 172.21.15.84:0/1605914437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff098078ca0 0x7ff0980790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 --2- 172.21.15.84:0/1605914437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098077c10 0x7ff098078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 -- 172.21.15.84:0/1605914437 >> 172.21.15.84:0/1605914437 conn(0x7ff0981012f0 msgr2=0x7ff0981037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:48.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 -- 172.21.15.84:0/1605914437 shutdown_connections 2024-09-21T02:38:48.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.078+0000 7ff09d000640 1 -- 172.21.15.84:0/1605914437 wait complete. 2024-09-21T02:38:48.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.079+0000 7ff09d000640 1 Processor -- start 2024-09-21T02:38:48.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.079+0000 7ff09d000640 1 -- start start 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.079+0000 7ff09d000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff098077c10 0x7ff0981a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.079+0000 7ff09d000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098078ca0 0x7ff0981a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.079+0000 7ff09d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 0x7ff0981a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.079+0000 7ff09d000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff098115b10 con 0x7ff098079640 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.079+0000 7ff09d000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff098115990 con 0x7ff098077c10 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.079+0000 7ff09d000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff098115c90 con 0x7ff098078ca0 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff096800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 0x7ff0981a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff096800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 0x7ff0981a1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50514/0 (socket says 172.21.15.84:50514) 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff096800640 1 -- 172.21.15.84:0/3569263322 learned_addr learned my addr 172.21.15.84:0/3569263322 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff095400640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098078ca0 0x7ff0981a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff095e00640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff098077c10 0x7ff0981a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:48.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff096800640 1 -- 172.21.15.84:0/3569263322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098078ca0 msgr2=0x7ff0981a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:48.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff096800640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098078ca0 0x7ff0981a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff096800640 1 -- 172.21.15.84:0/3569263322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff098077c10 msgr2=0x7ff0981a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:48.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff096800640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff098077c10 0x7ff0981a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.080+0000 7ff096800640 1 -- 172.21.15.84:0/3569263322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0981a2040 con 0x7ff098079640 2024-09-21T02:38:48.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.081+0000 7ff096800640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 0x7ff0981a1820 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff090006010 tx=0x7ff09002faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:48.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.081+0000 7ff08ea00640 1 -- 172.21.15.84:0/3569263322 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090034040 con 0x7ff098079640 2024-09-21T02:38:48.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.081+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0981a22d0 con 0x7ff098079640 2024-09-21T02:38:48.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.081+0000 7ff08ea00640 1 -- 172.21.15.84:0/3569263322 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff090030910 con 0x7ff098079640 2024-09-21T02:38:48.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.081+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0981a8a30 con 0x7ff098079640 2024-09-21T02:38:48.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.081+0000 7ff08ea00640 1 -- 172.21.15.84:0/3569263322 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090004840 con 0x7ff098079640 2024-09-21T02:38:48.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.082+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0980790b0 con 0x7ff098079640 2024-09-21T02:38:48.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.084+0000 7ff08ea00640 1 -- 172.21.15.84:0/3569263322 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff090037020 con 0x7ff098079640 2024-09-21T02:38:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.086+0000 7ff08ea00640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff07c0b6510 0x7ff07c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.086+0000 7ff08ea00640 1 -- 172.21.15.84:0/3569263322 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6809+0+0 (secure 0 0 0) 0x7ff090107d60 con 0x7ff098079640 2024-09-21T02:38:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.086+0000 7ff095e00640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff07c0b6510 0x7ff07c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.087+0000 7ff095e00640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff07c0b6510 0x7ff07c0b8a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff088009bd0 tx=0x7ff088005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:48.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.088+0000 7ff08ea00640 1 -- 172.21.15.84:0/3569263322 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0900cebc0 con 0x7ff098079640 2024-09-21T02:38:48.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.275+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff098063fc0 con 0x7ff098079640 2024-09-21T02:38:48.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.275+0000 7ff08ea00640 1 -- 172.21.15.84:0/3569263322 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7ff0900d2fa0 con 0x7ff098079640 2024-09-21T02:38:48.277 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:38:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff07c0b6510 msgr2=0x7ff07c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff07c0b6510 0x7ff07c0b8a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff088009bd0 tx=0x7ff088005f90 comp rx=0 tx=0).stop 2024-09-21T02:38:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 msgr2=0x7ff0981a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 0x7ff0981a1820 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff090006010 tx=0x7ff09002faa0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 shutdown_connections 2024-09-21T02:38:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff07c0b6510 0x7ff07c0b8a20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff098078ca0 0x7ff0981a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff098079640 0x7ff0981a1820 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 --2- 172.21.15.84:0/3569263322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff098077c10 0x7ff0981a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 >> 172.21.15.84:0/3569263322 conn(0x7ff0981012f0 msgr2=0x7ff098103700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 shutdown_connections 2024-09-21T02:38:48.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:48.278+0000 7ff09d000640 1 -- 172.21.15.84:0/3569263322 wait complete. 2024-09-21T02:38:48.748 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:48 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3569263322' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:38:48.748 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:48 smithi172 ceph-mon[35067]: from='osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:38:48.748 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:48 smithi172 ceph-mon[35067]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:38:48.749 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:38:48 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:38:48.479+0000 7f33809c7640 -1 osd.11 0 log_to_monitors true 2024-09-21T02:38:49.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:48 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3569263322' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:38:49.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:48 smithi084 ceph-mon[30747]: from='osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:38:49.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:48 smithi084 ceph-mon[30747]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:38:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:48 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3569263322' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:38:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:48 smithi090 ceph-mon[34571]: from='osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:38:49.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:48 smithi090 ceph-mon[34571]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T02:38:49.119 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726886305,"num_in_osds":12,"osd_in_since":1726886308,"num_remapped_pgs":0} 2024-09-21T02:38:49.989 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:38:49.676+0000 7f337c949640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T02:38:49.989 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:38:49.696+0000 7f3378747640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T02:38:49.989 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:38:49.989 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:38:49.989 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: from='osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:38:49.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:49.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:38:49.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:49.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:38:49.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T02:38:49.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:49 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:38:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:38:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: from='osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:38:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:38:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:38:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T02:38:50.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:49 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:50.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T02:38:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T02:38:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: from='osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:38:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T02:38:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T02:38:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T02:38:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:49 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:50.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T02:38:50.500 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: Detected new or changed devices on smithi172 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:50.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-21T02:38:50.970 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:50.970 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:50.970 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:50.970 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: Detected new or changed devices on smithi172 2024-09-21T02:38:51.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:51.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: Detected new or changed devices on smithi172 2024-09-21T02:38:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:51.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:51.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:51.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T02:38:51.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-21T02:38:51.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:51.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:51.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:51.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 -- 172.21.15.84:0/230137389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45c8104600 msgr2=0x7f45c8104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:51.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 --2- 172.21.15.84:0/230137389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45c8104600 0x7f45c8104a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009900 tx=0x7f45b402a480 comp rx=0 tx=0).stop 2024-09-21T02:38:51.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 -- 172.21.15.84:0/230137389 shutdown_connections 2024-09-21T02:38:51.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 --2- 172.21.15.84:0/230137389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45c8104fa0 0x7f45c810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 --2- 172.21.15.84:0/230137389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45c8104600 0x7f45c8104a10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 --2- 172.21.15.84:0/230137389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c8103570 0x7f45c81039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 -- 172.21.15.84:0/230137389 >> 172.21.15.84:0/230137389 conn(0x7f45c80feec0 msgr2=0x7f45c8101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:51.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 -- 172.21.15.84:0/230137389 shutdown_connections 2024-09-21T02:38:51.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.142+0000 7f45cec00640 1 -- 172.21.15.84:0/230137389 wait complete. 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.143+0000 7f45cec00640 1 Processor -- start 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cec00640 1 -- start start 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c8103570 0x7f45c8076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45c8104600 0x7f45c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cec00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45c8104fa0 0x7f45c8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f45c810f340 con 0x7f45c8104600 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45c810f1c0 con 0x7f45c8103570 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cec00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45c810f4c0 con 0x7f45c8104fa0 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cd800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c8103570 0x7f45c8076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.144+0000 7f45cd800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c8103570 0x7f45c8076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:45032/0 (socket says 172.21.15.84:45032) 2024-09-21T02:38:51.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.145+0000 7f45cd800640 1 -- 172.21.15.84:0/400381330 learned_addr learned my addr 172.21.15.84:0/400381330 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:38:51.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.145+0000 7f45ce200640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45c8104fa0 0x7f45c8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.145+0000 7f45cd800640 1 -- 172.21.15.84:0/400381330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45c8104fa0 msgr2=0x7f45c8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.145+0000 7f45cd800640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45c8104fa0 0x7f45c8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.145+0000 7f45cd800640 1 -- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45c8104600 msgr2=0x7f45c8075710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.145+0000 7f45cd800640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45c8104600 0x7f45c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.145+0000 7f45cd800640 1 -- 172.21.15.84:0/400381330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c819dd10 con 0x7f45c8103570 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.146+0000 7f45cd800640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c8103570 0x7f45c8076e40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00ea60 tx=0x7f45bc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.146+0000 7f45c6000640 1 -- 172.21.15.84:0/400381330 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00cde0 con 0x7f45c8103570 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.146+0000 7f45c6000640 1 -- 172.21.15.84:0/400381330 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f45bc0035f0 con 0x7f45c8103570 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.146+0000 7f45c6000640 1 -- 172.21.15.84:0/400381330 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc010690 con 0x7f45c8103570 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.146+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c8076250 con 0x7f45c8103570 2024-09-21T02:38:51.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.146+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c81a8930 con 0x7f45c8103570 2024-09-21T02:38:51.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.147+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c81039e0 con 0x7f45c8103570 2024-09-21T02:38:51.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.150+0000 7f45c6000640 1 -- 172.21.15.84:0/400381330 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f45bc0037a0 con 0x7f45c8103570 2024-09-21T02:38:51.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.151+0000 7f45c6000640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45b00b6510 0x7f45b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:51.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.151+0000 7f45c6000640 1 -- 172.21.15.84:0/400381330 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f45bc0e73f0 con 0x7f45c8103570 2024-09-21T02:38:51.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.151+0000 7f45cce00640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45b00b6510 0x7f45b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:51.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.152+0000 7f45cce00640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45b00b6510 0x7f45b00b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009230 tx=0x7f45b4031470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:51.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.153+0000 7f45c6000640 1 -- 172.21.15.84:0/400381330 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45bc0ae080 con 0x7f45c8103570 2024-09-21T02:38:51.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.343+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f45c8063fc0 con 0x7f45c8103570 2024-09-21T02:38:51.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.344+0000 7f45c6000640 1 -- 172.21.15.84:0/400381330 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f45bc0b2460 con 0x7f45c8103570 2024-09-21T02:38:51.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.346+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45b00b6510 msgr2=0x7f45b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.346+0000 7f45cec00640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45b00b6510 0x7f45b00b8a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009230 tx=0x7f45b4031470 comp rx=0 tx=0).stop 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.346+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c8103570 msgr2=0x7f45c8076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.346+0000 7f45cec00640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c8103570 0x7f45c8076e40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00ea60 tx=0x7f45bc00ef20 comp rx=0 tx=0).stop 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.347+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 shutdown_connections 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.347+0000 7f45cec00640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45b00b6510 0x7f45b00b8a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.347+0000 7f45cec00640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45c8104fa0 0x7f45c8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.347+0000 7f45cec00640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45c8104600 0x7f45c8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.347+0000 7f45cec00640 1 --2- 172.21.15.84:0/400381330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c8103570 0x7f45c8076e40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.347+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 >> 172.21.15.84:0/400381330 conn(0x7f45c80feec0 msgr2=0x7f45c8107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.347+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 shutdown_connections 2024-09-21T02:38:51.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:51.347+0000 7f45cec00640 1 -- 172.21.15.84:0/400381330 wait complete. 2024-09-21T02:38:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:51 smithi172 ceph-mon[35067]: purged_snaps scrub starts 2024-09-21T02:38:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:51 smithi172 ceph-mon[35067]: purged_snaps scrub ok 2024-09-21T02:38:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:51 smithi172 ceph-mon[35067]: osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] boot 2024-09-21T02:38:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:51 smithi172 ceph-mon[35067]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T02:38:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:51 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/400381330' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:38:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:51 smithi172 ceph-mon[35067]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:51 smithi084 ceph-mon[30747]: purged_snaps scrub starts 2024-09-21T02:38:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:51 smithi084 ceph-mon[30747]: purged_snaps scrub ok 2024-09-21T02:38:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:51 smithi084 ceph-mon[30747]: osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] boot 2024-09-21T02:38:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:51 smithi084 ceph-mon[30747]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T02:38:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:51 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/400381330' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:38:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:51 smithi084 ceph-mon[30747]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:52.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:51 smithi090 ceph-mon[34571]: purged_snaps scrub starts 2024-09-21T02:38:52.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:51 smithi090 ceph-mon[34571]: purged_snaps scrub ok 2024-09-21T02:38:52.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:52.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:51 smithi090 ceph-mon[34571]: osd.11 [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] boot 2024-09-21T02:38:52.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:51 smithi090 ceph-mon[34571]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T02:38:52.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T02:38:52.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:51 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/400381330' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T02:38:52.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:51 smithi090 ceph-mon[34571]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T02:38:52.203 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1726886330,"num_in_osds":12,"osd_in_since":1726886308,"num_remapped_pgs":0} 2024-09-21T02:38:52.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:38:52.569 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:53.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:52 smithi172 ceph-mon[35067]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:38:53.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:52 smithi084 ceph-mon[30747]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:38:53.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:52 smithi090 ceph-mon[34571]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T02:38:53.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 -- 172.21.15.84:0/4273589625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e0103b60 msgr2=0x7f79e0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 --2- 172.21.15.84:0/4273589625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e0103b60 0x7f79e0103f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009900 tx=0x7f79d402a410 comp rx=0 tx=0).stop 2024-09-21T02:38:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 -- 172.21.15.84:0/4273589625 shutdown_connections 2024-09-21T02:38:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 --2- 172.21.15.84:0/4273589625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0109df0 0x7f79e0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 --2- 172.21.15.84:0/4273589625 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79e01094a0 0x7f79e01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 --2- 172.21.15.84:0/4273589625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e0103b60 0x7f79e0103f70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 -- 172.21.15.84:0/4273589625 >> 172.21.15.84:0/4273589625 conn(0x7f79e007b850 msgr2=0x7f79e007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 -- 172.21.15.84:0/4273589625 shutdown_connections 2024-09-21T02:38:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.203+0000 7f79e8800640 1 -- 172.21.15.84:0/4273589625 wait complete. 2024-09-21T02:38:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e8800640 1 Processor -- start 2024-09-21T02:38:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e8800640 1 -- start start 2024-09-21T02:38:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e8800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0103b60 0x7f79e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e8800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e01094a0 0x7f79e0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e8800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79e0109df0 0x7f79e0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e8800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0113c40 con 0x7f79e01094a0 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e8800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0113ac0 con 0x7f79e0109df0 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e8800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79e0113dc0 con 0x7f79e0103b60 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e01094a0 0x7f79e0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.205+0000 7f79e5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e01094a0 0x7f79e0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46018/0 (socket says 172.21.15.84:46018) 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e5400640 1 -- 172.21.15.84:0/2610948597 learned_addr learned my addr 172.21.15.84:0/2610948597 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e5e00640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0103b60 0x7f79e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e6800640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79e0109df0 0x7f79e0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e5400640 1 -- 172.21.15.84:0/2610948597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0103b60 msgr2=0x7f79e0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:53.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e5400640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0103b60 0x7f79e0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e5400640 1 -- 172.21.15.84:0/2610948597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79e0109df0 msgr2=0x7f79e0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:53.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e5400640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79e0109df0 0x7f79e0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e5400640 1 -- 172.21.15.84:0/2610948597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e01a8810 con 0x7f79e01094a0 2024-09-21T02:38:53.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79e5400640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e01094a0 0x7f79e0075c50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79d000e9f0 tx=0x7f79d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.206+0000 7f79daa00640 1 -- 172.21.15.84:0/2610948597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d000ccc0 con 0x7f79e01094a0 2024-09-21T02:38:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.207+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e01a8b00 con 0x7f79e01094a0 2024-09-21T02:38:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.207+0000 7f79daa00640 1 -- 172.21.15.84:0/2610948597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79d0010900 con 0x7f79e01094a0 2024-09-21T02:38:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.207+0000 7f79daa00640 1 -- 172.21.15.84:0/2610948597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0018900 con 0x7f79e01094a0 2024-09-21T02:38:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.207+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e01a9040 con 0x7f79e01094a0 2024-09-21T02:38:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.208+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e0103f70 con 0x7f79e01094a0 2024-09-21T02:38:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.210+0000 7f79daa00640 1 -- 172.21.15.84:0/2610948597 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f79d0010ab0 con 0x7f79e01094a0 2024-09-21T02:38:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.212+0000 7f79daa00640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79c80b6590 0x7f79c80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.212+0000 7f79daa00640 1 -- 172.21.15.84:0/2610948597 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f79d00e76b0 con 0x7f79e01094a0 2024-09-21T02:38:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.212+0000 7f79e5e00640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79c80b6590 0x7f79c80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.213+0000 7f79e5e00640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79c80b6590 0x7f79c80b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79e0077160 tx=0x7f79d4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.214+0000 7f79daa00640 1 -- 172.21.15.84:0/2610948597 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79d00b2720 con 0x7f79e01094a0 2024-09-21T02:38:53.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.401+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79e002e640 con 0x7f79e01094a0 2024-09-21T02:38:53.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.403+0000 7f79daa00640 1 -- 172.21.15.84:0/2610948597 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18456 (secure 0 0 0) 0x7f79d00b7660 con 0x7f79e01094a0 2024-09-21T02:38:53.404 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:38:53.404 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:38:51.686203+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:38:53.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79c80b6590 msgr2=0x7f79c80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:53.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79c80b6590 0x7f79c80b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79e0077160 tx=0x7f79d4000bc0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e01094a0 msgr2=0x7f79e0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:53.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e01094a0 0x7f79e0075c50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79d000e9f0 tx=0x7f79d000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 shutdown_connections 2024-09-21T02:38:53.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79e0109df0 0x7f79e0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79e01094a0 0x7f79e0075c50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79c80b6590 0x7f79c80b8aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 --2- 172.21.15.84:0/2610948597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79e0103b60 0x7f79e0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:53.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 >> 172.21.15.84:0/2610948597 conn(0x7f79e007b850 msgr2=0x7f79e0107450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:53.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 shutdown_connections 2024-09-21T02:38:53.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:53.406+0000 7f79e8800640 1 -- 172.21.15.84:0/2610948597 wait complete. 2024-09-21T02:38:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:53 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2610948597' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:38:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:53 smithi172 ceph-mon[35067]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:54.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:53 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2610948597' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:38:54.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:53 smithi084 ceph-mon[30747]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:54.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:53 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2610948597' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:38:54.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:53 smithi090 ceph-mon[34571]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:54.117 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T02:34:41.799617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T02:38:54.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T02:38:54.483 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 -- 172.21.15.84:0/1573524831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 msgr2=0x7efff8110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 --2- 172.21.15.84:0/1573524831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 0x7efff8110470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efff0009ca0 tx=0x7efff002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 -- 172.21.15.84:0/1573524831 shutdown_connections 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 --2- 172.21.15.84:0/1573524831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81092f0 0x7efff8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 --2- 172.21.15.84:0/1573524831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 0x7efff8110470 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 --2- 172.21.15.84:0/1573524831 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff81039b0 0x7efff8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 -- 172.21.15.84:0/1573524831 >> 172.21.15.84:0/1573524831 conn(0x7efff80ff440 msgr2=0x7efff8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 -- 172.21.15.84:0/1573524831 shutdown_connections 2024-09-21T02:38:55.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.122+0000 7efff7e00640 1 -- 172.21.15.84:0/1573524831 wait complete. 2024-09-21T02:38:55.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.123+0000 7efff7e00640 1 Processor -- start 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7e00640 1 -- start start 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff81039b0 0x7efff819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81092f0 0x7efff819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 0x7efff81a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efff8113a40 con 0x7efff8109c40 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efff81138c0 con 0x7efff81039b0 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efff8113bc0 con 0x7efff81092f0 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 0x7efff81a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 0x7efff81a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46036/0 (socket says 172.21.15.84:46036) 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff7400640 1 -- 172.21.15.84:0/1380454556 learned_addr learned my addr 172.21.15.84:0/1380454556 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7effefe00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81092f0 0x7efff819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:55.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.124+0000 7efff6a00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff81039b0 0x7efff819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:55.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.125+0000 7efff7400640 1 -- 172.21.15.84:0/1380454556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81092f0 msgr2=0x7efff819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.125+0000 7efff7400640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81092f0 0x7efff819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.125+0000 7efff7400640 1 -- 172.21.15.84:0/1380454556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff81039b0 msgr2=0x7efff819c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.125+0000 7efff7400640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff81039b0 0x7efff819c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.125+0000 7efff7400640 1 -- 172.21.15.84:0/1380454556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff81a2540 con 0x7efff8109c40 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.125+0000 7efff6a00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff81039b0 0x7efff819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.125+0000 7efff7400640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 0x7efff81a1e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efff0033040 tx=0x7efff0003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.126+0000 7effef400640 1 -- 172.21.15.84:0/1380454556 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0031650 con 0x7efff8109c40 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.126+0000 7effef400640 1 -- 172.21.15.84:0/1380454556 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efff00317f0 con 0x7efff8109c40 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.126+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff81a27d0 con 0x7efff8109c40 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.126+0000 7effef400640 1 -- 172.21.15.84:0/1380454556 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff002fa80 con 0x7efff8109c40 2024-09-21T02:38:55.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.126+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff81a8f90 con 0x7efff8109c40 2024-09-21T02:38:55.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.127+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff8104c30 con 0x7efff8109c40 2024-09-21T02:38:55.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.129+0000 7effef400640 1 -- 172.21.15.84:0/1380454556 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7efff002fc20 con 0x7efff8109c40 2024-09-21T02:38:55.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.131+0000 7effef400640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7effdc0b6510 0x7effdc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:55.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.131+0000 7effef400640 1 -- 172.21.15.84:0/1380454556 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7efff0108270 con 0x7efff8109c40 2024-09-21T02:38:55.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.131+0000 7efff6a00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7effdc0b6510 0x7effdc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:55.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.132+0000 7efff6a00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7effdc0b6510 0x7effdc0b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7effe8009fc0 tx=0x7effe8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:55.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.133+0000 7effef400640 1 -- 172.21.15.84:0/1380454556 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efff00cef00 con 0x7efff8109c40 2024-09-21T02:38:55.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.320+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efff81a9200 con 0x7efff8109c40 2024-09-21T02:38:55.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.320+0000 7effef400640 1 -- 172.21.15.84:0/1380454556 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7efff00098b0 con 0x7efff8109c40 2024-09-21T02:38:55.321 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-09-21T02:38:55.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7effdc0b6510 msgr2=0x7effdc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:55.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7effdc0b6510 0x7effdc0b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7effe8009fc0 tx=0x7effe8005f90 comp rx=0 tx=0).stop 2024-09-21T02:38:55.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 msgr2=0x7efff81a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:55.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 0x7efff81a1e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efff0033040 tx=0x7efff0003c90 comp rx=0 tx=0).stop 2024-09-21T02:38:55.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 shutdown_connections 2024-09-21T02:38:55.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7effdc0b6510 0x7effdc0b8a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff81092f0 0x7efff819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efff8109c40 0x7efff81a1e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 --2- 172.21.15.84:0/1380454556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff81039b0 0x7efff819c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:55.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 >> 172.21.15.84:0/1380454556 conn(0x7efff80ff440 msgr2=0x7efff8108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:55.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 shutdown_connections 2024-09-21T02:38:55.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:55.323+0000 7efff7e00640 1 -- 172.21.15.84:0/1380454556 wait complete. 2024-09-21T02:38:55.693 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:55 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1380454556' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:38:55.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:55 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1380454556' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:38:55.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:55 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1380454556' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:38:56.169 INFO:tasks.cephadm:Adding mds.a on smithi084 2024-09-21T02:38:56.169 INFO:tasks.cephadm:Adding mds.d on smithi084 2024-09-21T02:38:56.169 INFO:tasks.cephadm:Adding mds.g on smithi084 2024-09-21T02:38:56.169 INFO:tasks.cephadm:Adding mds.j on smithi084 2024-09-21T02:38:56.169 INFO:tasks.cephadm:Adding mds.b on smithi090 2024-09-21T02:38:56.169 INFO:tasks.cephadm:Adding mds.e on smithi090 2024-09-21T02:38:56.170 INFO:tasks.cephadm:Adding mds.h on smithi090 2024-09-21T02:38:56.170 INFO:tasks.cephadm:Adding mds.k on smithi090 2024-09-21T02:38:56.170 INFO:tasks.cephadm:Adding mds.c on smithi172 2024-09-21T02:38:56.170 INFO:tasks.cephadm:Adding mds.f on smithi172 2024-09-21T02:38:56.170 INFO:tasks.cephadm:Adding mds.i on smithi172 2024-09-21T02:38:56.170 INFO:tasks.cephadm:Adding mds.l on smithi172 2024-09-21T02:38:56.170 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l' 2024-09-21T02:38:56.434 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:38:56.723 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:56 smithi172 ceph-mon[35067]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:56.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:56 smithi084 ceph-mon[30747]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:56.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:56 smithi090 ceph-mon[34571]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:56.961 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.953+0000 7fed10392640 1 -- 172.21.15.172:0/2136303249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed08102640 msgr2=0x7fed08102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.953+0000 7fed10392640 1 --2- 172.21.15.172:0/2136303249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed08102640 0x7fed08102ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009900 tx=0x7fecf802a480 comp rx=0 tx=0).stop 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.953+0000 7fed10392640 1 -- 172.21.15.172:0/2136303249 shutdown_connections 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.953+0000 7fed10392640 1 --2- 172.21.15.172:0/2136303249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed08104070 0x7fed0810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.953+0000 7fed10392640 1 --2- 172.21.15.172:0/2136303249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed081036d0 0x7fed08103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.953+0000 7fed10392640 1 --2- 172.21.15.172:0/2136303249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed08102640 0x7fed08102ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.953+0000 7fed10392640 1 -- 172.21.15.172:0/2136303249 >> 172.21.15.172:0/2136303249 conn(0x7fed080fdfb0 msgr2=0x7fed08100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 -- 172.21.15.172:0/2136303249 shutdown_connections 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 -- 172.21.15.172:0/2136303249 wait complete. 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 Processor -- start 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 -- start start 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed08102640 0x7fed08106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:56.962 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed081036d0 0x7fed08104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed08104070 0x7fed08105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fed0810e440 con 0x7fed08104070 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fed0810e2c0 con 0x7fed08102640 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.954+0000 7fed10392640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed0810e5c0 con 0x7fed081036d0 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed081036d0 0x7fed08104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed081036d0 0x7fed08104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:49664/0 (socket says 172.21.15.172:49664) 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 -- 172.21.15.172:0/1074010977 learned_addr learned my addr 172.21.15.172:0/1074010977 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0e12e640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed08102640 0x7fed08106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 -- 172.21.15.172:0/1074010977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed08102640 msgr2=0x7fed08106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed08102640 0x7fed08106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 -- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed08104070 msgr2=0x7fed08105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed08104070 0x7fed08105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:56.963 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 -- 172.21.15.172:0/1074010977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed08105740 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed0d92d640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed081036d0 0x7fed08104b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed0400e9f0 tx=0x7fed0400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fecff7fe640 1 -- 172.21.15.172:0/1074010977 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0400cd80 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed081a41a0 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fecff7fe640 1 -- 172.21.15.172:0/1074010977 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fed040054f0 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fecff7fe640 1 -- 172.21.15.172:0/1074010977 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04010690 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.955+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed081a4680 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.956+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed081a49a0 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.959+0000 7fecff7fe640 1 -- 172.21.15.172:0/1074010977 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fed040046c0 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.960+0000 7fecff7fe640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fecf40b6590 0x7fecf40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.960+0000 7fecff7fe640 1 -- 172.21.15.172:0/1074010977 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fed040e75f0 con 0x7fed081036d0 2024-09-21T02:38:56.964 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.961+0000 7fed0e12e640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fecf40b6590 0x7fecf40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:56.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.961+0000 7fed0e12e640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fecf40b6590 0x7fecf40b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fecf80314b0 tx=0x7fecf8031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:56.965 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:56.964+0000 7fecff7fe640 1 -- 172.21.15.172:0/1074010977 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fed04056710 con 0x7fed081036d0 2024-09-21T02:38:57.169 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.168+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}) -- 0x7fed080fff40 con 0x7fecf40b6590 2024-09-21T02:38:57.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.178+0000 7fecff7fe640 1 -- 172.21.15.172:0/1074010977 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fed080fff40 con 0x7fecf40b6590 2024-09-21T02:38:57.179 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mds.all update... 2024-09-21T02:38:57.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fecf40b6590 msgr2=0x7fecf40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fecf40b6590 0x7fecf40b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fecf80314b0 tx=0x7fecf8031510 comp rx=0 tx=0).stop 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed081036d0 msgr2=0x7fed08104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed081036d0 0x7fed08104b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed0400e9f0 tx=0x7fed0400edf0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 shutdown_connections 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fecf40b6590 0x7fecf40b8aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed081036d0 0x7fed08104b00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed08104070 0x7fed08105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 --2- 172.21.15.172:0/1074010977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed08102640 0x7fed08106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 >> 172.21.15.172:0/1074010977 conn(0x7fed080fdfb0 msgr2=0x7fed080ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 shutdown_connections 2024-09-21T02:38:57.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T02:38:57.181+0000 7fed10392640 1 -- 172.21.15.172:0/1074010977 wait complete. 2024-09-21T02:38:57.911 DEBUG:teuthology.orchestra.run.smithi084:mds.a> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T02:38:57.916 DEBUG:teuthology.orchestra.run.smithi084:mds.d> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T02:38:57.960 DEBUG:teuthology.orchestra.run.smithi084:mds.g> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T02:38:58.007 DEBUG:teuthology.orchestra.run.smithi084:mds.j> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T02:38:58.051 DEBUG:teuthology.orchestra.run.smithi090:mds.b> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T02:38:58.054 DEBUG:teuthology.orchestra.run.smithi090:mds.e> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T02:38:58.097 DEBUG:teuthology.orchestra.run.smithi090:mds.h> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T02:38:58.141 DEBUG:teuthology.orchestra.run.smithi090:mds.k> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T02:38:58.184 DEBUG:teuthology.orchestra.run.smithi172:mds.c> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T02:38:58.186 DEBUG:teuthology.orchestra.run.smithi172:mds.f> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T02:38:58.229 DEBUG:teuthology.orchestra.run.smithi172:mds.i> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='client.24613 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:38:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:58 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:58.272 DEBUG:teuthology.orchestra.run.smithi172:mds.l> sudo journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T02:38:58.315 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T02:38:58.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:38:58.443 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='client.24613 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:58.443 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-21T02:38:58.443 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:58.443 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:58.444 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:58.444 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:58.444 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:58.444 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:58.444 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:38:58.444 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:38:58.444 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:58 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='client.24613 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:38:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:58 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:38:58.680 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:38:59.184 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:38:59 smithi172 ceph-mon[35067]: Deploying daemon mds.l on smithi172 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 -- 172.21.15.84:0/3114169368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 msgr2=0x7f00c4103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 --2- 172.21.15.84:0/3114169368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 0x7f00c4103f90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009900 tx=0x7f00b402a410 comp rx=0 tx=0).stop 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 -- 172.21.15.84:0/3114169368 shutdown_connections 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 --2- 172.21.15.84:0/3114169368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c4109e10 0x7f00c4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 --2- 172.21.15.84:0/3114169368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00c41094c0 0x7f00c41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 --2- 172.21.15.84:0/3114169368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 0x7f00c4103f90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 -- 172.21.15.84:0/3114169368 >> 172.21.15.84:0/3114169368 conn(0x7f00c40ff5d0 msgr2=0x7f00c4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 -- 172.21.15.84:0/3114169368 shutdown_connections 2024-09-21T02:38:59.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.287+0000 7f00c9600640 1 -- 172.21.15.84:0/3114169368 wait complete. 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.288+0000 7f00c9600640 1 Processor -- start 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.288+0000 7f00c9600640 1 -- start start 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 0x7f00c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c9600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00c41094c0 0x7f00c4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c9600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c4109e10 0x7f00c4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c9600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4113c10 con 0x7f00c4103b80 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c9600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4113a90 con 0x7f00c41094c0 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c9600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4113d90 con 0x7f00c4109e10 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 0x7f00c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:59.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 0x7f00c4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46050/0 (socket says 172.21.15.84:46050) 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c2a00640 1 -- 172.21.15.84:0/260897321 learned_addr learned my addr 172.21.15.84:0/260897321 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00c3400640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c4109e10 0x7f00c4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.289+0000 7f00ba000640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00c41094c0 0x7f00c4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00c2a00640 1 -- 172.21.15.84:0/260897321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c4109e10 msgr2=0x7f00c4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00c2a00640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c4109e10 0x7f00c4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00c2a00640 1 -- 172.21.15.84:0/260897321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00c41094c0 msgr2=0x7f00c4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00c2a00640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00c41094c0 0x7f00c4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00c2a00640 1 -- 172.21.15.84:0/260897321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c41a8820 con 0x7f00c4103b80 2024-09-21T02:38:59.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00ba000640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00c41094c0 0x7f00c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:38:59.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00c2a00640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 0x7f00c4075710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f00b4005ab0 tx=0x7f00b40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:59.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00bbe00640 1 -- 172.21.15.84:0/260897321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b403f030 con 0x7f00c4103b80 2024-09-21T02:38:59.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00bbe00640 1 -- 172.21.15.84:0/260897321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00b4003ac0 con 0x7f00c4103b80 2024-09-21T02:38:59.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c41a8ab0 con 0x7f00c4103b80 2024-09-21T02:38:59.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.290+0000 7f00bbe00640 1 -- 172.21.15.84:0/260897321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4035070 con 0x7f00c4103b80 2024-09-21T02:38:59.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.291+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c41a8f90 con 0x7f00c4103b80 2024-09-21T02:38:59.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.292+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c4103f90 con 0x7f00c4103b80 2024-09-21T02:38:59.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.294+0000 7f00bbe00640 1 -- 172.21.15.84:0/260897321 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f00b4042030 con 0x7f00c4103b80 2024-09-21T02:38:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.295+0000 7f00bbe00640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f00a80b6510 0x7f00a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:38:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.295+0000 7f00bbe00640 1 -- 172.21.15.84:0/260897321 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f00b4107670 con 0x7f00c4103b80 2024-09-21T02:38:59.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.295+0000 7f00ba000640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f00a80b6510 0x7f00a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:38:59.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.296+0000 7f00ba000640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f00a80b6510 0x7f00a80b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f00c4108e00 tx=0x7f00ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:38:59.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.300+0000 7f00bbe00640 1 -- 172.21.15.84:0/260897321 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00b40ce300 con 0x7f00c4103b80 2024-09-21T02:38:59.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:38:59 smithi084 ceph-mon[30747]: Deploying daemon mds.l on smithi172 2024-09-21T02:38:59.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:38:59 smithi090 ceph-mon[34571]: Deploying daemon mds.l on smithi172 2024-09-21T02:38:59.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.527+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00c402e640 con 0x7f00c4103b80 2024-09-21T02:38:59.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.527+0000 7f00bbe00640 1 -- 172.21.15.84:0/260897321 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f00b40d26e0 con 0x7f00c4103b80 2024-09-21T02:38:59.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:38:59.528 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":1,"btime":"2024-09-21T02:30:39:705299+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T02:38:59.529 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 1 2024-09-21T02:38:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f00a80b6510 msgr2=0x7f00a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f00a80b6510 0x7f00a80b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f00c4108e00 tx=0x7f00ac005f90 comp rx=0 tx=0).stop 2024-09-21T02:38:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 msgr2=0x7f00c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:38:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 0x7f00c4075710 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f00b4005ab0 tx=0x7f00b40040c0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 shutdown_connections 2024-09-21T02:38:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f00a80b6510 0x7f00a80b8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c4109e10 0x7f00c4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f00c41094c0 0x7f00c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 --2- 172.21.15.84:0/260897321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c4103b80 0x7f00c4075710 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:38:59.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 >> 172.21.15.84:0/260897321 conn(0x7f00c40ff5d0 msgr2=0x7f00c41019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:38:59.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 shutdown_connections 2024-09-21T02:38:59.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:38:59.530+0000 7f00c9600640 1 -- 172.21.15.84:0/260897321 wait complete. 2024-09-21T02:38:59.924 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:38:59 smithi172 systemd[1]: Starting Ceph mds.l for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:00.190 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:38:59 smithi172 podman[63893]: 2024-09-21 02:38:59.825955751 +0000 UTC m=+0.015652355 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:00.191 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:38:59 smithi172 podman[63893]: 2024-09-21 02:38:59.950502101 +0000 UTC m=+0.140198700 container create ae375eb4cf9c4de2743f13e00fc05fd91d2d9d28ea3454dd7143196b13273560 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T02:39:00.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:00 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/260897321' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:00.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:00 smithi172 ceph-mon[35067]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:00.506 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:39:00 smithi172 podman[63893]: 2024-09-21 02:39:00.220384614 +0000 UTC m=+0.410081207 container init ae375eb4cf9c4de2743f13e00fc05fd91d2d9d28ea3454dd7143196b13273560 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T02:39:00.506 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:39:00 smithi172 podman[63893]: 2024-09-21 02:39:00.223482014 +0000 UTC m=+0.413178617 container start ae375eb4cf9c4de2743f13e00fc05fd91d2d9d28ea3454dd7143196b13273560 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T02:39:00.506 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:39:00 smithi172 ceph-mds[63912]: -- 172.21.15.172:0/3526578372 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a3e0f3b860 con 0x55a3e50e3a80 2024-09-21T02:39:00.507 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:39:00 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l[63908]: starting mds.l at 2024-09-21T02:39:00.507 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:39:00 smithi172 bash[63893]: ae375eb4cf9c4de2743f13e00fc05fd91d2d9d28ea3454dd7143196b13273560 2024-09-21T02:39:00.507 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:39:00 smithi172 systemd[1]: Started Ceph mds.l for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:00.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:00 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/260897321' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:00.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:00 smithi084 ceph-mon[30747]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:00.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:00 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/260897321' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:00.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:00 smithi090 ceph-mon[34571]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6832/1475355449,v1:172.21.15.172:6833/1475355449] up:boot 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: fsmap 1 up:standby 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:01.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:01.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:01 smithi084 ceph-mon[30747]: Deploying daemon mds.k on smithi090 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6832/1475355449,v1:172.21.15.172:6833/1475355449] up:boot 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: fsmap 1 up:standby 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:01.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:01.518 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:01 smithi090 ceph-mon[34571]: Deploying daemon mds.k on smithi090 2024-09-21T02:39:01.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6832/1475355449,v1:172.21.15.172:6833/1475355449] up:boot 2024-09-21T02:39:01.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: fsmap 1 up:standby 2024-09-21T02:39:01.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T02:39:01.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:01.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:01.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:01.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:01.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:01 smithi172 ceph-mon[35067]: Deploying daemon mds.k on smithi090 2024-09-21T02:39:02.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:02.611 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:02.685 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:02 smithi090 ceph-mon[34571]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:02.685 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:02 smithi090 systemd[1]: Starting Ceph mds.k for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:02.750 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:02 smithi084 ceph-mon[30747]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:02.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:02 smithi172 ceph-mon[35067]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:02.950 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:02 smithi090 podman[62167]: 2024-09-21 02:39:02.586645862 +0000 UTC m=+0.015422377 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:02.950 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:02 smithi090 podman[62167]: 2024-09-21 02:39:02.713270242 +0000 UTC m=+0.142046814 container create 31e7134a9ca9fd90c0c785966fcfa7d4fd87e28e3e470407ec7a454335fc2f51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:39:02.950 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:02 smithi090 podman[62167]: 2024-09-21 02:39:02.949655743 +0000 UTC m=+0.378432253 container init 31e7134a9ca9fd90c0c785966fcfa7d4fd87e28e3e470407ec7a454335fc2f51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T02:39:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.251+0000 7fc5cce00640 1 -- 172.21.15.84:0/1277233144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 msgr2=0x7fc5c8109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.251+0000 7fc5cce00640 1 --2- 172.21.15.84:0/1277233144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 0x7fc5c8109700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009900 tx=0x7fc5b402a410 comp rx=0 tx=0).stop 2024-09-21T02:39:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.251+0000 7fc5cce00640 1 -- 172.21.15.84:0/1277233144 shutdown_connections 2024-09-21T02:39:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.251+0000 7fc5cce00640 1 --2- 172.21.15.84:0/1277233144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c8109c40 0x7fc5c8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.251+0000 7fc5cce00640 1 --2- 172.21.15.84:0/1277233144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 0x7fc5c8109700 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.251+0000 7fc5cce00640 1 --2- 172.21.15.84:0/1277233144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81039b0 0x7fc5c8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.251+0000 7fc5cce00640 1 -- 172.21.15.84:0/1277233144 >> 172.21.15.84:0/1277233144 conn(0x7fc5c80ff440 msgr2=0x7fc5c8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.251+0000 7fc5cce00640 1 -- 172.21.15.84:0/1277233144 shutdown_connections 2024-09-21T02:39:03.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.252+0000 7fc5cce00640 1 -- 172.21.15.84:0/1277233144 wait complete. 2024-09-21T02:39:03.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5cce00640 1 Processor -- start 2024-09-21T02:39:03.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5cce00640 1 -- start start 2024-09-21T02:39:03.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5cce00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81039b0 0x7fc5c819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:03.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5cce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 0x7fc5c819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:03.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5cce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c8109c40 0x7fc5c81a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:03.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5cce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8113a70 con 0x7fc5c81092f0 2024-09-21T02:39:03.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5cce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81138f0 con 0x7fc5c8109c40 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5cce00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8113bf0 con 0x7fc5c81039b0 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81039b0 0x7fc5c819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5c6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 0x7fc5c819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81039b0 0x7fc5c819c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:58408/0 (socket says 172.21.15.84:58408) 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.253+0000 7fc5c7400640 1 -- 172.21.15.84:0/2272071 learned_addr learned my addr 172.21.15.84:0/2272071 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.254+0000 7fc5c7e00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c8109c40 0x7fc5c81a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.254+0000 7fc5c7400640 1 -- 172.21.15.84:0/2272071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c8109c40 msgr2=0x7fc5c81a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.254+0000 7fc5c7400640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c8109c40 0x7fc5c81a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.254+0000 7fc5c7400640 1 -- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 msgr2=0x7fc5c819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.254+0000 7fc5c7400640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 0x7fc5c819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.254+0000 7fc5c7400640 1 -- 172.21.15.84:0/2272071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c81a2590 con 0x7fc5c81039b0 2024-09-21T02:39:03.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.254+0000 7fc5c6a00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 0x7fc5c819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:03.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.254+0000 7fc5c7400640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81039b0 0x7fc5c819c620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800e9f0 tx=0x7fc5b800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:03.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.255+0000 7fc5bfe00640 1 -- 172.21.15.84:0/2272071 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800cd80 con 0x7fc5c81039b0 2024-09-21T02:39:03.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.255+0000 7fc5bfe00640 1 -- 172.21.15.84:0/2272071 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc5b8010900 con 0x7fc5c81039b0 2024-09-21T02:39:03.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.255+0000 7fc5bfe00640 1 -- 172.21.15.84:0/2272071 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8018920 con 0x7fc5c81039b0 2024-09-21T02:39:03.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.255+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c81a2880 con 0x7fc5c81039b0 2024-09-21T02:39:03.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.255+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c81a8fe0 con 0x7fc5c81039b0 2024-09-21T02:39:03.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.256+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c8103dc0 con 0x7fc5c81039b0 2024-09-21T02:39:03.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.258+0000 7fc5bfe00640 1 -- 172.21.15.84:0/2272071 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fc5b8010ab0 con 0x7fc5c81039b0 2024-09-21T02:39:03.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.260+0000 7fc5bfe00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc5ac0b6510 0x7fc5ac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:03.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.260+0000 7fc5bfe00640 1 -- 172.21.15.84:0/2272071 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fc5b80e7480 con 0x7fc5c81039b0 2024-09-21T02:39:03.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.260+0000 7fc5c6a00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc5ac0b6510 0x7fc5ac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:03.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.261+0000 7fc5c6a00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc5ac0b6510 0x7fc5ac0b8a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5b402aa00 tx=0x7fc5b4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:03.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.262+0000 7fc5bfe00640 1 -- 172.21.15.84:0/2272071 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5b80b24f0 con 0x7fc5c81039b0 2024-09-21T02:39:03.266 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:02 smithi090 podman[62167]: 2024-09-21 02:39:02.952823022 +0000 UTC m=+0.381599543 container start 31e7134a9ca9fd90c0c785966fcfa7d4fd87e28e3e470407ec7a454335fc2f51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T02:39:03.267 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:02 smithi090 ceph-mds[62186]: -- 172.21.15.90:0/2738188405 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562880e93860 con 0x56288503b600 2024-09-21T02:39:03.267 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k[62182]: starting mds.k at 2024-09-21T02:39:03.267 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:03 smithi090 bash[62167]: 31e7134a9ca9fd90c0c785966fcfa7d4fd87e28e3e470407ec7a454335fc2f51 2024-09-21T02:39:03.267 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:39:03 smithi090 systemd[1]: Started Ceph mds.k for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:03.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.501+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5c81a9350 con 0x7fc5c81039b0 2024-09-21T02:39:03.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.501+0000 7fc5bfe00640 1 -- 172.21.15.84:0/2272071 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7fc5b80b7430 con 0x7fc5c81039b0 2024-09-21T02:39:03.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:03.504 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"btime":"2024-09-21T02:39:03:273076+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T02:39:03.504 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2024-09-21T02:39:03.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.505+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc5ac0b6510 msgr2=0x7fc5ac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:03.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.505+0000 7fc5cce00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc5ac0b6510 0x7fc5ac0b8a20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5b402aa00 tx=0x7fc5b4000bc0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.505+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81039b0 msgr2=0x7fc5c819c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:03.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.505+0000 7fc5cce00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81039b0 0x7fc5c819c620 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800e9f0 tx=0x7fc5b800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.506+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 shutdown_connections 2024-09-21T02:39:03.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.506+0000 7fc5cce00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c8109c40 0x7fc5c81a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.506+0000 7fc5cce00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c81092f0 0x7fc5c819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.506+0000 7fc5cce00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc5ac0b6510 0x7fc5ac0b8a20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.506+0000 7fc5cce00640 1 --2- 172.21.15.84:0/2272071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81039b0 0x7fc5c819c620 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:03.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.506+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 >> 172.21.15.84:0/2272071 conn(0x7fc5c80ff440 msgr2=0x7fc5c8108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:03.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.506+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 shutdown_connections 2024-09-21T02:39:03.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:03.506+0000 7fc5cce00640 1 -- 172.21.15.84:0/2272071 wait complete. 2024-09-21T02:39:04.367 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: Deploying daemon mds.j on smithi084 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.90:6832/1029758123,v1:172.21.15.90:6833/1029758123] up:boot 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: fsmap 2 up:standby 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2272071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:04.368 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:04 smithi090 ceph-mon[34571]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: Deploying daemon mds.j on smithi084 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.90:6832/1029758123,v1:172.21.15.90:6833/1029758123] up:boot 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: fsmap 2 up:standby 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2272071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:04.370 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:04 smithi084 ceph-mon[30747]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:04.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: Deploying daemon mds.j on smithi084 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.90:6832/1029758123,v1:172.21.15.90:6833/1029758123] up:boot 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: fsmap 2 up:standby 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2272071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:04.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:04 smithi172 ceph-mon[35067]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:05.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:05 smithi084 ceph-mon[30747]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:05 smithi172 ceph-mon[35067]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:06.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:05 smithi090 ceph-mon[34571]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:06.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:06.763 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:39:06 smithi084 podman[69995]: 2024-09-21 02:39:06.505154859 +0000 UTC m=+0.160816265 container create 4404949de54209ca24bbdb56b7e41250b26bec3b1cde06da7a9af2e599189982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T02:39:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:07.193 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:39:06 smithi084 podman[69995]: 2024-09-21 02:39:06.788698576 +0000 UTC m=+0.444359996 container init 4404949de54209ca24bbdb56b7e41250b26bec3b1cde06da7a9af2e599189982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T02:39:07.193 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:39:06 smithi084 podman[69995]: 2024-09-21 02:39:06.79494647 +0000 UTC m=+0.450607871 container start 4404949de54209ca24bbdb56b7e41250b26bec3b1cde06da7a9af2e599189982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T02:39:07.193 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:39:06 smithi084 bash[69995]: 4404949de54209ca24bbdb56b7e41250b26bec3b1cde06da7a9af2e599189982 2024-09-21T02:39:07.193 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:39:06 smithi084 systemd[1]: Started Ceph mds.j for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:07.193 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:39:06 smithi084 ceph-mds[70041]: -- 172.21.15.84:0/454925872 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55859c717860 con 0x5585a08bf180 2024-09-21T02:39:07.193 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:39:06 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j[70030]: starting mds.j at 2024-09-21T02:39:07.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 -- 172.21.15.84:0/1567458510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d1c103b60 msgr2=0x7f5d1c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:07.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 --2- 172.21.15.84:0/1567458510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d1c103b60 0x7f5d1c103f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009900 tx=0x7f5d0c02a410 comp rx=0 tx=0).stop 2024-09-21T02:39:07.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 -- 172.21.15.84:0/1567458510 shutdown_connections 2024-09-21T02:39:07.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 --2- 172.21.15.84:0/1567458510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d1c1094a0 0x7f5d1c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 --2- 172.21.15.84:0/1567458510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d1c109df0 0x7f5d1c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 --2- 172.21.15.84:0/1567458510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d1c103b60 0x7f5d1c103f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 -- 172.21.15.84:0/1567458510 >> 172.21.15.84:0/1567458510 conn(0x7f5d1c07b850 msgr2=0x7f5d1c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:07.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 -- 172.21.15.84:0/1567458510 shutdown_connections 2024-09-21T02:39:07.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.685+0000 7f5d20e00640 1 -- 172.21.15.84:0/1567458510 wait complete. 2024-09-21T02:39:07.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d20e00640 1 Processor -- start 2024-09-21T02:39:07.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d20e00640 1 -- start start 2024-09-21T02:39:07.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d20e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d1c103b60 0x7f5d1c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:07.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d20e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d1c1094a0 0x7f5d1c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:07.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d20e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d1c109df0 0x7f5d1c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:07.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d20e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c113bf0 con 0x7f5d1c109df0 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d20e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c113a70 con 0x7f5d1c1094a0 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d20e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c113d70 con 0x7f5d1c103b60 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.687+0000 7f5d19e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d1c103b60 0x7f5d1c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d1c103b60 0x7f5d1c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:58432/0 (socket says 172.21.15.84:58432) 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19e00640 1 -- 172.21.15.84:0/2023498214 learned_addr learned my addr 172.21.15.84:0/2023498214 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19400640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d1c1094a0 0x7f5d1c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d1a800640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d1c109df0 0x7f5d1c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19e00640 1 -- 172.21.15.84:0/2023498214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d1c1094a0 msgr2=0x7f5d1c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d1c1094a0 0x7f5d1c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19e00640 1 -- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d1c109df0 msgr2=0x7f5d1c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d1c109df0 0x7f5d1c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19e00640 1 -- 172.21.15.84:0/2023498214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c1a88c0 con 0x7f5d1c103b60 2024-09-21T02:39:07.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.688+0000 7f5d19e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d1c103b60 0x7f5d1c075710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c005ab0 tx=0x7f5d0c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:07.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.689+0000 7f5d12a00640 1 -- 172.21.15.84:0/2023498214 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c03f030 con 0x7f5d1c103b60 2024-09-21T02:39:07.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.689+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1c1a8b50 con 0x7f5d1c103b60 2024-09-21T02:39:07.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.689+0000 7f5d12a00640 1 -- 172.21.15.84:0/2023498214 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d0c003cd0 con 0x7f5d1c103b60 2024-09-21T02:39:07.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.689+0000 7f5d12a00640 1 -- 172.21.15.84:0/2023498214 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c035070 con 0x7f5d1c103b60 2024-09-21T02:39:07.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.689+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d1c1a9080 con 0x7f5d1c103b60 2024-09-21T02:39:07.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.690+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d1c103f70 con 0x7f5d1c103b60 2024-09-21T02:39:07.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.692+0000 7f5d12a00640 1 -- 172.21.15.84:0/2023498214 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f5d0c042030 con 0x7f5d1c103b60 2024-09-21T02:39:07.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.694+0000 7f5d12a00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5d000b6510 0x7f5d000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:07.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.694+0000 7f5d12a00640 1 -- 172.21.15.84:0/2023498214 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f5d0c107920 con 0x7f5d1c103b60 2024-09-21T02:39:07.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.694+0000 7f5d19400640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5d000b6510 0x7f5d000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:07.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.695+0000 7f5d19400640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5d000b6510 0x7f5d000b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c1091a0 tx=0x7f5d08005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:07.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.696+0000 7f5d12a00640 1 -- 172.21.15.84:0/2023498214 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d0c0d2990 con 0x7f5d1c103b60 2024-09-21T02:39:07.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.934+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d1c076a10 con 0x7f5d1c103b60 2024-09-21T02:39:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.935+0000 7f5d12a00640 1 -- 172.21.15.84:0/2023498214 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f5d1c076a10 con 0x7f5d1c103b60 2024-09-21T02:39:07.936 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:07.936 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":4,"btime":"2024-09-21T02:39:06:958079+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-21T02:39:07.936 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 4 2024-09-21T02:39:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5d000b6510 msgr2=0x7f5d000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5d000b6510 0x7f5d000b8a20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c1091a0 tx=0x7f5d08005f90 comp rx=0 tx=0).stop 2024-09-21T02:39:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d1c103b60 msgr2=0x7f5d1c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d1c103b60 0x7f5d1c075710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c005ab0 tx=0x7f5d0c0042f0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 shutdown_connections 2024-09-21T02:39:07.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d1c109df0 0x7f5d1c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d1c1094a0 0x7f5d1c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5d000b6510 0x7f5d000b8a20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 --2- 172.21.15.84:0/2023498214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d1c103b60 0x7f5d1c075710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 >> 172.21.15.84:0/2023498214 conn(0x7f5d1c07b850 msgr2=0x7f5d1c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 shutdown_connections 2024-09-21T02:39:07.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:07.938+0000 7f5d20e00640 1 -- 172.21.15.84:0/2023498214 wait complete. 2024-09-21T02:39:08.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.84:6834/3765261714,v1:172.21.15.84:6835/3765261714] up:boot 2024-09-21T02:39:08.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: fsmap 3 up:standby 2024-09-21T02:39:08.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:39:08.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:08.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:08.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:08.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: Deploying daemon mds.d on smithi084 2024-09-21T02:39:08.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:08.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:07 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2023498214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.84:6834/3765261714,v1:172.21.15.84:6835/3765261714] up:boot 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: fsmap 3 up:standby 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: Deploying daemon mds.d on smithi084 2024-09-21T02:39:08.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:08.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:07 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2023498214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.84:6834/3765261714,v1:172.21.15.84:6835/3765261714] up:boot 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: fsmap 3 up:standby 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: Deploying daemon mds.d on smithi084 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:08.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:07 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2023498214' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:09 smithi172 ceph-mon[35067]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:10.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:09 smithi084 ceph-mon[30747]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:10.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:09 smithi090 ceph-mon[34571]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:10.639 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:10 smithi084 systemd[1]: Starting Ceph mds.d for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:10.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:10.902 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:10 smithi084 podman[70356]: 2024-09-21 02:39:10.542322826 +0000 UTC m=+0.027081455 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:10.902 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:10 smithi084 podman[70356]: 2024-09-21 02:39:10.655931397 +0000 UTC m=+0.140690027 container create a441ab471a1376af9f74c8c2ce1ea2b412a1538c0db7a7dbc5ec317a6bde0860 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:39:10.902 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:10 smithi084 podman[70356]: 2024-09-21 02:39:10.901485481 +0000 UTC m=+0.386244125 container init a441ab471a1376af9f74c8c2ce1ea2b412a1538c0db7a7dbc5ec317a6bde0860 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T02:39:11.150 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:11.263 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:10 smithi084 podman[70356]: 2024-09-21 02:39:10.912203296 +0000 UTC m=+0.396961927 container start a441ab471a1376af9f74c8c2ce1ea2b412a1538c0db7a7dbc5ec317a6bde0860 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T02:39:11.263 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:11 smithi084 ceph-mds[70392]: -- 172.21.15.84:0/2836281713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad6d73f860 con 0x55ad718e7600 2024-09-21T02:39:11.263 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:11 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d[70386]: starting mds.d at 2024-09-21T02:39:11.263 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:11 smithi084 bash[70356]: a441ab471a1376af9f74c8c2ce1ea2b412a1538c0db7a7dbc5ec317a6bde0860 2024-09-21T02:39:11.263 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:39:11 smithi084 systemd[1]: Started Ceph mds.d for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:11.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.761+0000 7fa3f2c00640 1 -- 172.21.15.84:0/338457731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 msgr2=0x7fa3ec110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.761+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/338457731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 0x7fa3ec110640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009ca0 tx=0x7fa3e402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:39:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.761+0000 7fa3f2c00640 1 -- 172.21.15.84:0/338457731 shutdown_connections 2024-09-21T02:39:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.761+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/338457731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3ec1094c0 0x7fa3ec1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.762+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/338457731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 0x7fa3ec110640 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.762+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/338457731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec103b80 0x7fa3ec103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.762+0000 7fa3f2c00640 1 -- 172.21.15.84:0/338457731 >> 172.21.15.84:0/338457731 conn(0x7fa3ec0ff590 msgr2=0x7fa3ec1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.762+0000 7fa3f2c00640 1 -- 172.21.15.84:0/338457731 shutdown_connections 2024-09-21T02:39:11.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.762+0000 7fa3f2c00640 1 -- 172.21.15.84:0/338457731 wait complete. 2024-09-21T02:39:11.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.763+0000 7fa3f2c00640 1 Processor -- start 2024-09-21T02:39:11.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.763+0000 7fa3f2c00640 1 -- start start 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.763+0000 7fa3f2c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3ec103b80 0x7fa3ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.763+0000 7fa3f2c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec1094c0 0x7fa3ec075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.763+0000 7fa3f2c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 0x7fa3ec076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.763+0000 7fa3f2c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec113c60 con 0x7fa3ec109e10 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.763+0000 7fa3f2c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec113ae0 con 0x7fa3ec1094c0 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.763+0000 7fa3f2c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ec113de0 con 0x7fa3ec103b80 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3f0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 0x7fa3ec076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3f0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 0x7fa3ec076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49544/0 (socket says 172.21.15.84:49544) 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3f0c00640 1 -- 172.21.15.84:0/3568741852 learned_addr learned my addr 172.21.15.84:0/3568741852 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3ebe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3ec103b80 0x7fa3ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3eb400640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec1094c0 0x7fa3ec075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:11.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3f0c00640 1 -- 172.21.15.84:0/3568741852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3ec103b80 msgr2=0x7fa3ec075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:11.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3f0c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3ec103b80 0x7fa3ec075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:11.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3f0c00640 1 -- 172.21.15.84:0/3568741852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec1094c0 msgr2=0x7fa3ec075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:11.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3f0c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec1094c0 0x7fa3ec075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:11.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.764+0000 7fa3f0c00640 1 -- 172.21.15.84:0/3568741852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ec1a8850 con 0x7fa3ec109e10 2024-09-21T02:39:11.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.765+0000 7fa3f0c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 0x7fa3ec076190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4033040 tx=0x7fa3e4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:11.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.765+0000 7fa3e8c00640 1 -- 172.21.15.84:0/3568741852 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4031650 con 0x7fa3ec109e10 2024-09-21T02:39:11.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.765+0000 7fa3e8c00640 1 -- 172.21.15.84:0/3568741852 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3e40317f0 con 0x7fa3ec109e10 2024-09-21T02:39:11.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.765+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ec1a8ae0 con 0x7fa3ec109e10 2024-09-21T02:39:11.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.765+0000 7fa3e8c00640 1 -- 172.21.15.84:0/3568741852 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e402fa40 con 0x7fa3ec109e10 2024-09-21T02:39:11.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.765+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ec1a9020 con 0x7fa3ec109e10 2024-09-21T02:39:11.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.766+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ec103f90 con 0x7fa3ec109e10 2024-09-21T02:39:11.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.768+0000 7fa3e8c00640 1 -- 172.21.15.84:0/3568741852 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa3e402fbe0 con 0x7fa3ec109e10 2024-09-21T02:39:11.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.771+0000 7fa3e8c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3d00b6510 0x7fa3d00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:11.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.771+0000 7fa3e8c00640 1 -- 172.21.15.84:0/3568741852 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fa3e4108200 con 0x7fa3ec109e10 2024-09-21T02:39:11.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.771+0000 7fa3ebe00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3d00b6510 0x7fa3d00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:11.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.772+0000 7fa3ebe00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3d00b6510 0x7fa3d00b8a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec077160 tx=0x7fa3dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:11.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:11.774+0000 7fa3e8c00640 1 -- 172.21.15.84:0/3568741852 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3e40cee90 con 0x7fa3ec109e10 2024-09-21T02:39:12.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.002+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3ec02e640 con 0x7fa3ec109e10 2024-09-21T02:39:12.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.002+0000 7fa3e8c00640 1 -- 172.21.15.84:0/3568741852 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fa3e40d3270 con 0x7fa3ec109e10 2024-09-21T02:39:12.004 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:12.004 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"btime":"2024-09-21T02:39:11:078800+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-21T02:39:12.004 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 5 2024-09-21T02:39:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3d00b6510 msgr2=0x7fa3d00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3d00b6510 0x7fa3d00b8a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec077160 tx=0x7fa3dc00b410 comp rx=0 tx=0).stop 2024-09-21T02:39:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 msgr2=0x7fa3ec076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 0x7fa3ec076190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4033040 tx=0x7fa3e4003ce0 comp rx=0 tx=0).stop 2024-09-21T02:39:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 shutdown_connections 2024-09-21T02:39:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3ec109e10 0x7fa3ec076190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3ec1094c0 0x7fa3ec075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa3d00b6510 0x7fa3d00b8a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 --2- 172.21.15.84:0/3568741852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3ec103b80 0x7fa3ec075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 >> 172.21.15.84:0/3568741852 conn(0x7fa3ec0ff590 msgr2=0x7fa3ec106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 shutdown_connections 2024-09-21T02:39:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:12.005+0000 7fa3f2c00640 1 -- 172.21.15.84:0/3568741852 wait complete. 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.84:6836/688117760,v1:172.21.15.84:6837/688117760] up:boot 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: fsmap 4 up:standby 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: Deploying daemon mds.e on smithi090 2024-09-21T02:39:12.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:12.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:12 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3568741852' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:12.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.84:6836/688117760,v1:172.21.15.84:6837/688117760] up:boot 2024-09-21T02:39:12.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: fsmap 4 up:standby 2024-09-21T02:39:12.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:39:12.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:12.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:12.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:12.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: Deploying daemon mds.e on smithi090 2024-09-21T02:39:12.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:12.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:12 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3568741852' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:12.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.84:6836/688117760,v1:172.21.15.84:6837/688117760] up:boot 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: fsmap 4 up:standby 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: Deploying daemon mds.e on smithi090 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:12.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:12 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3568741852' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:13.267 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 systemd[1]: Starting Ceph mds.e for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:13.647 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 podman[62449]: 2024-09-21 02:39:13.278698496 +0000 UTC m=+0.015977189 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:13.647 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 podman[62449]: 2024-09-21 02:39:13.393147321 +0000 UTC m=+0.130426000 container create ce4ceace76bc0743a51506f59fbf880e333be550037744fb927f8d7988c0c45b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T02:39:13.647 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 podman[62449]: 2024-09-21 02:39:13.646688346 +0000 UTC m=+0.383967025 container init ce4ceace76bc0743a51506f59fbf880e333be550037744fb927f8d7988c0c45b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T02:39:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:13 smithi172 ceph-mon[35067]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:13 smithi084 ceph-mon[30747]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:14.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:13 smithi090 ceph-mon[34571]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:14.017 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 podman[62449]: 2024-09-21 02:39:13.649775729 +0000 UTC m=+0.387054409 container start ce4ceace76bc0743a51506f59fbf880e333be550037744fb927f8d7988c0c45b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T02:39:14.017 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 ceph-mds[62468]: -- 172.21.15.90:0/1161905493 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555872cbd860 con 0x555876e65600 2024-09-21T02:39:14.017 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e[62464]: starting mds.e at 2024-09-21T02:39:14.017 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 bash[62449]: ce4ceace76bc0743a51506f59fbf880e333be550037744fb927f8d7988c0c45b 2024-09-21T02:39:14.017 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:39:13 smithi090 systemd[1]: Started Ceph mds.e for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:14.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:15.114 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:15.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: Deploying daemon mds.f on smithi172 2024-09-21T02:39:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.90:6834/1905318969,v1:172.21.15.90:6835/1905318969] up:boot 2024-09-21T02:39:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: fsmap 5 up:standby 2024-09-21T02:39:15.254 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:14 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: Deploying daemon mds.f on smithi172 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.90:6834/1905318969,v1:172.21.15.90:6835/1905318969] up:boot 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: fsmap 5 up:standby 2024-09-21T02:39:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:14 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: Deploying daemon mds.f on smithi172 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.90:6834/1905318969,v1:172.21.15.90:6835/1905318969] up:boot 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: fsmap 5 up:standby 2024-09-21T02:39:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:14 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:39:15.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.733+0000 7fcd80400640 1 -- 172.21.15.84:0/1401289069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 msgr2=0x7fcd781061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:15.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.733+0000 7fcd80400640 1 --2- 172.21.15.84:0/1401289069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 0x7fcd781061a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009860 tx=0x7fcd6c02a340 comp rx=0 tx=0).stop 2024-09-21T02:39:15.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.734+0000 7fcd80400640 1 -- 172.21.15.84:0/1401289069 shutdown_connections 2024-09-21T02:39:15.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.734+0000 7fcd80400640 1 --2- 172.21.15.84:0/1401289069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd7810c020 0x7fcd78112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.734+0000 7fcd80400640 1 --2- 172.21.15.84:0/1401289069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7810b6d0 0x7fcd7810bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.734+0000 7fcd80400640 1 --2- 172.21.15.84:0/1401289069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 0x7fcd781061a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.734+0000 7fcd80400640 1 -- 172.21.15.84:0/1401289069 >> 172.21.15.84:0/1401289069 conn(0x7fcd781017c0 msgr2=0x7fcd78103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:15.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.734+0000 7fcd80400640 1 -- 172.21.15.84:0/1401289069 shutdown_connections 2024-09-21T02:39:15.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.734+0000 7fcd80400640 1 -- 172.21.15.84:0/1401289069 wait complete. 2024-09-21T02:39:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.735+0000 7fcd80400640 1 Processor -- start 2024-09-21T02:39:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.735+0000 7fcd80400640 1 -- start start 2024-09-21T02:39:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.735+0000 7fcd80400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 0x7fcd7819c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.735+0000 7fcd80400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7810b6d0 0x7fcd7819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.735+0000 7fcd80400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd7810c020 0x7fcd781a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:15.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.735+0000 7fcd80400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78115e00 con 0x7fcd7810b6d0 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.735+0000 7fcd80400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78115c80 con 0x7fcd7810c020 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.735+0000 7fcd80400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78115f80 con 0x7fcd78105d90 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 0x7fcd7819c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7810b6d0 0x7fcd7819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 0x7fcd7819c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:50482/0 (socket says 172.21.15.84:50482) 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 -- 172.21.15.84:0/2059248925 learned_addr learned my addr 172.21.15.84:0/2059248925 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7e400640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd7810c020 0x7fcd781a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 -- 172.21.15.84:0/2059248925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd7810c020 msgr2=0x7fcd781a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd7810c020 0x7fcd781a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 -- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7810b6d0 msgr2=0x7fcd7819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7810b6d0 0x7fcd7819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 -- 172.21.15.84:0/2059248925 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd781a2760 con 0x7fcd78105d90 2024-09-21T02:39:15.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7d000640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7810b6d0 0x7fcd7819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.736+0000 7fcd7da00640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 0x7fcd7819c7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c035040 tx=0x7fcd6c033d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.737+0000 7fcd76000640 1 -- 172.21.15.84:0/2059248925 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c03f020 con 0x7fcd78105d90 2024-09-21T02:39:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.737+0000 7fcd76000640 1 -- 172.21.15.84:0/2059248925 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcd6c030810 con 0x7fcd78105d90 2024-09-21T02:39:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.737+0000 7fcd76000640 1 -- 172.21.15.84:0/2059248925 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c037040 con 0x7fcd78105d90 2024-09-21T02:39:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.737+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd781a29f0 con 0x7fcd78105d90 2024-09-21T02:39:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.737+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd781a91b0 con 0x7fcd78105d90 2024-09-21T02:39:15.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.738+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd781061a0 con 0x7fcd78105d90 2024-09-21T02:39:15.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.740+0000 7fcd76000640 1 -- 172.21.15.84:0/2059248925 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fcd6c042020 con 0x7fcd78105d90 2024-09-21T02:39:15.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.741+0000 7fcd76000640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd600b6590 0x7fcd600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:15.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.742+0000 7fcd76000640 1 -- 172.21.15.84:0/2059248925 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fcd6c106be0 con 0x7fcd78105d90 2024-09-21T02:39:15.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.742+0000 7fcd7d000640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd600b6590 0x7fcd600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:15.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.742+0000 7fcd7d000640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd600b6590 0x7fcd600b8aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcd640096c0 tx=0x7fcd64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:15.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.744+0000 7fcd76000640 1 -- 172.21.15.84:0/2059248925 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd6c049020 con 0x7fcd78105d90 2024-09-21T02:39:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.969+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd7819d920 con 0x7fcd78105d90 2024-09-21T02:39:15.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.969+0000 7fcd76000640 1 -- 172.21.15.84:0/2059248925 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7fcd6c0cd970 con 0x7fcd78105d90 2024-09-21T02:39:15.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:15.971 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"btime":"2024-09-21T02:39:14:670755+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24647,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T02:39:15.971 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 6 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd600b6590 msgr2=0x7fcd600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd600b6590 0x7fcd600b8aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcd640096c0 tx=0x7fcd64009260 comp rx=0 tx=0).stop 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 msgr2=0x7fcd7819c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 0x7fcd7819c7f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c035040 tx=0x7fcd6c033d80 comp rx=0 tx=0).stop 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 shutdown_connections 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd7810c020 0x7fcd781a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7810b6d0 0x7fcd7819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcd600b6590 0x7fcd600b8aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 --2- 172.21.15.84:0/2059248925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78105d90 0x7fcd7819c7f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:15.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.972+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 >> 172.21.15.84:0/2059248925 conn(0x7fcd781017c0 msgr2=0x7fcd7810aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.973+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 shutdown_connections 2024-09-21T02:39:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:15.973+0000 7fcd80400640 1 -- 172.21.15.84:0/2059248925 wait complete. 2024-09-21T02:39:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:15 smithi172 ceph-mon[35067]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:16.006 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:15 smithi172 systemd[1]: Starting Ceph mds.f for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:16.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:15 smithi084 ceph-mon[30747]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:16.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:15 smithi090 ceph-mon[34571]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:16.309 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:16 smithi172 podman[64157]: 2024-09-21 02:39:15.937265302 +0000 UTC m=+0.016251933 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:16.310 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:16 smithi172 podman[64157]: 2024-09-21 02:39:16.056356468 +0000 UTC m=+0.135343089 container create 44166c6d902acbe5db93b7655e0f6be1f6d929e575181f433085db88eabd4562 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T02:39:16.310 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:16 smithi172 podman[64157]: 2024-09-21 02:39:16.30918007 +0000 UTC m=+0.388166692 container init 44166c6d902acbe5db93b7655e0f6be1f6d929e575181f433085db88eabd4562 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T02:39:16.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:16 smithi172 podman[64157]: 2024-09-21 02:39:16.312364327 +0000 UTC m=+0.391350958 container start 44166c6d902acbe5db93b7655e0f6be1f6d929e575181f433085db88eabd4562 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T02:39:16.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mds[64176]: -- 172.21.15.172:0/3430724491 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5582f9605860 con 0x5582fd7ad180 2024-09-21T02:39:16.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f[64172]: starting mds.f at 2024-09-21T02:39:16.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:16 smithi172 bash[64157]: 44166c6d902acbe5db93b7655e0f6be1f6d929e575181f433085db88eabd4562 2024-09-21T02:39:16.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:39:16 smithi172 systemd[1]: Started Ceph mds.f for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:16 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2059248925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:16 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:17.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:16 smithi084 ceph-mon[30747]: Deploying daemon mds.c on smithi172 2024-09-21T02:39:17.096 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2059248925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:17.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:17.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:17.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:17.097 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:16 smithi172 ceph-mon[35067]: Deploying daemon mds.c on smithi172 2024-09-21T02:39:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:16 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2059248925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:16 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:16 smithi090 ceph-mon[34571]: Deploying daemon mds.c on smithi172 2024-09-21T02:39:18.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:17 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6834/2876777250,v1:172.21.15.172:6835/2876777250] up:boot 2024-09-21T02:39:18.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:17 smithi172 ceph-mon[35067]: fsmap 6 up:standby 2024-09-21T02:39:18.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:17 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:39:18.111 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:17 smithi172 ceph-mon[35067]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:18.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:17 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6834/2876777250,v1:172.21.15.172:6835/2876777250] up:boot 2024-09-21T02:39:18.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:17 smithi084 ceph-mon[30747]: fsmap 6 up:standby 2024-09-21T02:39:18.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:17 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:39:18.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:17 smithi084 ceph-mon[30747]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:18.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:17 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6834/2876777250,v1:172.21.15.172:6835/2876777250] up:boot 2024-09-21T02:39:18.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:17 smithi090 ceph-mon[34571]: fsmap 6 up:standby 2024-09-21T02:39:18.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:17 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:39:18.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:17 smithi090 ceph-mon[34571]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:18.688 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:18.757 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:39:18 smithi172 podman[64426]: 2024-09-21 02:39:18.704277542 +0000 UTC m=+0.117079252 container create 54c03c993353a35e4bec16b41ffc1787177da2c3a2660feec012846e785be78c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T02:39:19.064 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:19.256 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:39:18 smithi172 podman[64426]: 2024-09-21 02:39:18.982417613 +0000 UTC m=+0.395219323 container init 54c03c993353a35e4bec16b41ffc1787177da2c3a2660feec012846e785be78c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T02:39:19.257 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:39:18 smithi172 podman[64426]: 2024-09-21 02:39:18.985330739 +0000 UTC m=+0.398132454 container start 54c03c993353a35e4bec16b41ffc1787177da2c3a2660feec012846e785be78c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:39:19.257 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:39:19 smithi172 ceph-mds[64445]: -- 172.21.15.172:0/3971944949 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563bb422b860 con 0x563bb83d3180 2024-09-21T02:39:19.257 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:39:19 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c[64441]: starting mds.c at 2024-09-21T02:39:19.257 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:39:19 smithi172 bash[64426]: 54c03c993353a35e4bec16b41ffc1787177da2c3a2660feec012846e785be78c 2024-09-21T02:39:19.257 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:39:19 smithi172 systemd[1]: Started Ceph mds.c for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:19.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 -- 172.21.15.84:0/199908130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa580103b60 msgr2=0x7fa580103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 --2- 172.21.15.84:0/199908130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa580103b60 0x7fa580103f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa570009900 tx=0x7fa57002a410 comp rx=0 tx=0).stop 2024-09-21T02:39:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 -- 172.21.15.84:0/199908130 shutdown_connections 2024-09-21T02:39:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 --2- 172.21.15.84:0/199908130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa580109df0 0x7fa580110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 --2- 172.21.15.84:0/199908130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5801094a0 0x7fa5801098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 --2- 172.21.15.84:0/199908130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa580103b60 0x7fa580103f70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 -- 172.21.15.84:0/199908130 >> 172.21.15.84:0/199908130 conn(0x7fa58007b850 msgr2=0x7fa58007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 -- 172.21.15.84:0/199908130 shutdown_connections 2024-09-21T02:39:19.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.682+0000 7fa585200640 1 -- 172.21.15.84:0/199908130 wait complete. 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.683+0000 7fa585200640 1 Processor -- start 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.683+0000 7fa585200640 1 -- start start 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa585200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa580103b60 0x7fa58019c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa585200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5801094a0 0x7fa58019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa585200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa580109df0 0x7fa5801a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa585200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa580113bf0 con 0x7fa580109df0 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa585200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa580113a70 con 0x7fa5801094a0 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa585200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa580113d70 con 0x7fa580103b60 2024-09-21T02:39:19.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa575400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5801094a0 0x7fa58019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa575400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5801094a0 0x7fa58019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:49144/0 (socket says 172.21.15.84:49144) 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa57e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa580109df0 0x7fa5801a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa575400640 1 -- 172.21.15.84:0/954394683 learned_addr learned my addr 172.21.15.84:0/954394683 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa57de00640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa580103b60 0x7fa58019c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa575400640 1 -- 172.21.15.84:0/954394683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa580103b60 msgr2=0x7fa58019c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa575400640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa580103b60 0x7fa58019c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa575400640 1 -- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa580109df0 msgr2=0x7fa5801a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa575400640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa580109df0 0x7fa5801a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.684+0000 7fa575400640 1 -- 172.21.15.84:0/954394683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5801a26b0 con 0x7fa5801094a0 2024-09-21T02:39:19.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.685+0000 7fa575400640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5801094a0 0x7fa58019cce0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa56800e9f0 tx=0x7fa56800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.685+0000 7fa577400640 1 -- 172.21.15.84:0/954394683 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56800ccc0 con 0x7fa5801094a0 2024-09-21T02:39:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.685+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5801a29a0 con 0x7fa5801094a0 2024-09-21T02:39:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.685+0000 7fa577400640 1 -- 172.21.15.84:0/954394683 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa568010900 con 0x7fa5801094a0 2024-09-21T02:39:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.685+0000 7fa577400640 1 -- 172.21.15.84:0/954394683 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568018900 con 0x7fa5801094a0 2024-09-21T02:39:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.685+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5801a9100 con 0x7fa5801094a0 2024-09-21T02:39:19.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.686+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa580103f70 con 0x7fa5801094a0 2024-09-21T02:39:19.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.688+0000 7fa577400640 1 -- 172.21.15.84:0/954394683 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa568010ab0 con 0x7fa5801094a0 2024-09-21T02:39:19.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.690+0000 7fa577400640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa5640b6510 0x7fa5640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:19.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.690+0000 7fa577400640 1 -- 172.21.15.84:0/954394683 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fa5680e73e0 con 0x7fa5801094a0 2024-09-21T02:39:19.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.690+0000 7fa57de00640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa5640b6510 0x7fa5640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:19.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.691+0000 7fa57de00640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa5640b6510 0x7fa5640b8a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa570009230 tx=0x7fa5700058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:19.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.692+0000 7fa577400640 1 -- 172.21.15.84:0/954394683 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5680b2450 con 0x7fa5801094a0 2024-09-21T02:39:19.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.916+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa58019d870 con 0x7fa5801094a0 2024-09-21T02:39:19.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.917+0000 7fa577400640 1 -- 172.21.15.84:0/954394683 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7fa58019d870 con 0x7fa5801094a0 2024-09-21T02:39:19.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:19.919 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"btime":"2024-09-21T02:39:19:074484+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24647,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24673,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T02:39:19.919 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.919+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa5640b6510 msgr2=0x7fa5640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.919+0000 7fa585200640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa5640b6510 0x7fa5640b8a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa570009230 tx=0x7fa5700058d0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.919+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5801094a0 msgr2=0x7fa58019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.919+0000 7fa585200640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5801094a0 0x7fa58019cce0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa56800e9f0 tx=0x7fa56800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.920+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 shutdown_connections 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.920+0000 7fa585200640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa580109df0 0x7fa5801a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.920+0000 7fa585200640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5801094a0 0x7fa58019cce0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.920+0000 7fa585200640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa5640b6510 0x7fa5640b8a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.920+0000 7fa585200640 1 --2- 172.21.15.84:0/954394683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa580103b60 0x7fa58019c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.920+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 >> 172.21.15.84:0/954394683 conn(0x7fa58007b850 msgr2=0x7fa5801072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:19.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.920+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 shutdown_connections 2024-09-21T02:39:19.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:19.920+0000 7fa585200640 1 -- 172.21.15.84:0/954394683 wait complete. 2024-09-21T02:39:20.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] up:boot 2024-09-21T02:39:20.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: fsmap 7 up:standby 2024-09-21T02:39:20.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:39:20.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:20.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:20.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:20.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: Deploying daemon mds.h on smithi090 2024-09-21T02:39:20.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:20.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:20 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/954394683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:20.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] up:boot 2024-09-21T02:39:20.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: fsmap 7 up:standby 2024-09-21T02:39:20.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:39:20.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:20.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:20.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:20.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: Deploying daemon mds.h on smithi090 2024-09-21T02:39:20.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:20.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:20 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/954394683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] up:boot 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: fsmap 7 up:standby 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: Deploying daemon mds.h on smithi090 2024-09-21T02:39:20.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:20.518 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:20 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/954394683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:21.267 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 systemd[1]: Starting Ceph mds.h for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:21.642 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 podman[62719]: 2024-09-21 02:39:21.267736633 +0000 UTC m=+0.015716212 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:21.643 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 podman[62719]: 2024-09-21 02:39:21.388824991 +0000 UTC m=+0.136804567 container create bce9a61af2cd7e37e717421c92a7537736cbe2ebf24e0fc3608cd51cdf9d9be3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T02:39:21.643 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 podman[62719]: 2024-09-21 02:39:21.641932404 +0000 UTC m=+0.389911980 container init bce9a61af2cd7e37e717421c92a7537736cbe2ebf24e0fc3608cd51cdf9d9be3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T02:39:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:21 smithi172 ceph-mon[35067]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:22.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:21 smithi084 ceph-mon[30747]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:22.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:21 smithi090 ceph-mon[34571]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:22.018 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 podman[62719]: 2024-09-21 02:39:21.64476323 +0000 UTC m=+0.392742806 container start bce9a61af2cd7e37e717421c92a7537736cbe2ebf24e0fc3608cd51cdf9d9be3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T02:39:22.018 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 ceph-mds[62737]: -- 172.21.15.90:0/1093601720 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a72bd9860 con 0x556a76d81600 2024-09-21T02:39:22.018 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h[62733]: starting mds.h at 2024-09-21T02:39:22.018 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 bash[62719]: bce9a61af2cd7e37e717421c92a7537736cbe2ebf24e0fc3608cd51cdf9d9be3 2024-09-21T02:39:22.018 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:39:21 smithi090 systemd[1]: Started Ceph mds.h for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:22.865 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:23.247 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:23.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:23.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:23.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:23.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: Deploying daemon mds.i on smithi172 2024-09-21T02:39:23.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.90:6836/939715852,v1:172.21.15.90:6837/939715852] up:boot 2024-09-21T02:39:23.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: fsmap 8 up:standby 2024-09-21T02:39:23.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:22 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: Deploying daemon mds.i on smithi172 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.90:6836/939715852,v1:172.21.15.90:6837/939715852] up:boot 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: fsmap 8 up:standby 2024-09-21T02:39:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:22 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: Deploying daemon mds.i on smithi172 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.90:6836/939715852,v1:172.21.15.90:6837/939715852] up:boot 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: fsmap 8 up:standby 2024-09-21T02:39:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:22 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:39:23.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 -- 172.21.15.84:0/1704527560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 msgr2=0x7fd474106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:23.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 --2- 172.21.15.84:0/1704527560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 0x7fd474106190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd464009900 tx=0x7fd46402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:39:23.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 -- 172.21.15.84:0/1704527560 shutdown_connections 2024-09-21T02:39:23.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 --2- 172.21.15.84:0/1704527560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47410b6c0 0x7fd47410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:23.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 --2- 172.21.15.84:0/1704527560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd47410c010 0x7fd474112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:23.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 --2- 172.21.15.84:0/1704527560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 0x7fd474106190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:23.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 -- 172.21.15.84:0/1704527560 >> 172.21.15.84:0/1704527560 conn(0x7fd474101810 msgr2=0x7fd474103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:23.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 -- 172.21.15.84:0/1704527560 shutdown_connections 2024-09-21T02:39:23.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.859+0000 7fd47b800640 1 -- 172.21.15.84:0/1704527560 wait complete. 2024-09-21T02:39:23.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.860+0000 7fd47b800640 1 Processor -- start 2024-09-21T02:39:23.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.860+0000 7fd47b800640 1 -- start start 2024-09-21T02:39:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.860+0000 7fd47b800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 0x7fd47419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.860+0000 7fd47b800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd47410b6c0 0x7fd47419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.860+0000 7fd47b800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47410c010 0x7fd4741a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:23.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.860+0000 7fd47b800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd474115df0 con 0x7fd474105d80 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.860+0000 7fd47b800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd474115c70 con 0x7fd47410b6c0 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.860+0000 7fd47b800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd474115f70 con 0x7fd47410c010 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd478e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 0x7fd47419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd478e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 0x7fd47419c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51198/0 (socket says 172.21.15.84:51198) 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd478e00640 1 -- 172.21.15.84:0/780966645 learned_addr learned my addr 172.21.15.84:0/780966645 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd479800640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47410c010 0x7fd4741a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd46be00640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd47410b6c0 0x7fd47419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd478e00640 1 -- 172.21.15.84:0/780966645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47410c010 msgr2=0x7fd4741a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd478e00640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47410c010 0x7fd4741a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd478e00640 1 -- 172.21.15.84:0/780966645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd47410b6c0 msgr2=0x7fd47419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:23.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd478e00640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd47410b6c0 0x7fd47419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd478e00640 1 -- 172.21.15.84:0/780966645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4741a2730 con 0x7fd474105d80 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.861+0000 7fd46be00640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd47410b6c0 0x7fd47419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.862+0000 7fd478e00640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 0x7fd47419c7c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd464005ab0 tx=0x7fd4640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.862+0000 7fd472000640 1 -- 172.21.15.84:0/780966645 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46403f030 con 0x7fd474105d80 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.862+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4741a29c0 con 0x7fd474105d80 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.862+0000 7fd472000640 1 -- 172.21.15.84:0/780966645 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd464003ac0 con 0x7fd474105d80 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.862+0000 7fd472000640 1 -- 172.21.15.84:0/780966645 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464035070 con 0x7fd474105d80 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.862+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4741a9180 con 0x7fd474105d80 2024-09-21T02:39:23.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.863+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd474106190 con 0x7fd474105d80 2024-09-21T02:39:23.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.865+0000 7fd472000640 1 -- 172.21.15.84:0/780966645 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd464042030 con 0x7fd474105d80 2024-09-21T02:39:23.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.867+0000 7fd472000640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd4580b6510 0x7fd4580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:23.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.867+0000 7fd472000640 1 -- 172.21.15.84:0/780966645 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fd4641077a0 con 0x7fd474105d80 2024-09-21T02:39:23.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.867+0000 7fd46be00640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd4580b6510 0x7fd4580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:23.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.868+0000 7fd46be00640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd4580b6510 0x7fd4580b8a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd474104ff0 tx=0x7fd45c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:23.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:23.870+0000 7fd472000640 1 -- 172.21.15.84:0/780966645 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4640d2810 con 0x7fd474105d80 2024-09-21T02:39:24.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:23 smithi172 ceph-mon[35067]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:24.007 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:23 smithi172 systemd[1]: Starting Ceph mds.i for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:24.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:23 smithi084 ceph-mon[30747]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.093+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd47419d8f0 con 0x7fd474105d80 2024-09-21T02:39:24.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.093+0000 7fd472000640 1 -- 172.21.15.84:0/780966645 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7213 (secure 0 0 0) 0x7fd4640d7750 con 0x7fd474105d80 2024-09-21T02:39:24.096 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:24.096 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"btime":"2024-09-21T02:39:22:672124+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24647,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24673,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T02:39:24.096 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2024-09-21T02:39:24.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd4580b6510 msgr2=0x7fd4580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd4580b6510 0x7fd4580b8a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd474104ff0 tx=0x7fd45c005f90 comp rx=0 tx=0).stop 2024-09-21T02:39:24.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 msgr2=0x7fd47419c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:24.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 0x7fd47419c7c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd464005ab0 tx=0x7fd4640040c0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 shutdown_connections 2024-09-21T02:39:24.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd4580b6510 0x7fd4580b8a20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd47410c010 0x7fd4741a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd47410b6c0 0x7fd47419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 --2- 172.21.15.84:0/780966645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd474105d80 0x7fd47419c7c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:24.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 >> 172.21.15.84:0/780966645 conn(0x7fd474101810 msgr2=0x7fd47410ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:24.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 shutdown_connections 2024-09-21T02:39:24.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:24.096+0000 7fd47b800640 1 -- 172.21.15.84:0/780966645 wait complete. 2024-09-21T02:39:24.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:23 smithi090 ceph-mon[34571]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:24.322 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:24 smithi172 podman[64698]: 2024-09-21 02:39:23.964044262 +0000 UTC m=+0.015675678 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:24.323 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:24 smithi172 podman[64698]: 2024-09-21 02:39:24.077648657 +0000 UTC m=+0.129280061 container create 919b18d18202093b94635647a3eb68e2f1c3b725243c953e38e988128cf1f6ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T02:39:24.323 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:24 smithi172 podman[64698]: 2024-09-21 02:39:24.322143357 +0000 UTC m=+0.373774760 container init 919b18d18202093b94635647a3eb68e2f1c3b725243c953e38e988128cf1f6ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:39:24.756 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:24 smithi172 podman[64698]: 2024-09-21 02:39:24.325183025 +0000 UTC m=+0.376814435 container start 919b18d18202093b94635647a3eb68e2f1c3b725243c953e38e988128cf1f6ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T02:39:24.756 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mds[64717]: -- 172.21.15.172:0/3850062083 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a322a3f860 con 0x55a326be7600 2024-09-21T02:39:24.756 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i[64713]: starting mds.i at 2024-09-21T02:39:24.756 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:24 smithi172 bash[64698]: 919b18d18202093b94635647a3eb68e2f1c3b725243c953e38e988128cf1f6ad 2024-09-21T02:39:24.756 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:39:24 smithi172 systemd[1]: Started Ceph mds.i for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:25.118 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:24 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/780966645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:25.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:25.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:25.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:24 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:25.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:24 smithi084 ceph-mon[30747]: Deploying daemon mds.g on smithi084 2024-09-21T02:39:25.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/780966645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:25.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:25.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:25.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:25.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:24 smithi172 ceph-mon[35067]: Deploying daemon mds.g on smithi084 2024-09-21T02:39:25.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:24 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/780966645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:25.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:25.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:25.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:25.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:24 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:25.268 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:24 smithi090 ceph-mon[34571]: Deploying daemon mds.g on smithi084 2024-09-21T02:39:26.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:25 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] up:boot 2024-09-21T02:39:26.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:25 smithi172 ceph-mon[35067]: fsmap 9 up:standby 2024-09-21T02:39:26.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:25 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:39:26.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:25 smithi172 ceph-mon[35067]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:26.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:25 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] up:boot 2024-09-21T02:39:26.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:25 smithi084 ceph-mon[30747]: fsmap 9 up:standby 2024-09-21T02:39:26.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:25 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:39:26.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:25 smithi084 ceph-mon[30747]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:26.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:25 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] up:boot 2024-09-21T02:39:26.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:25 smithi090 ceph-mon[34571]: fsmap 9 up:standby 2024-09-21T02:39:26.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:25 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:39:26.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:25 smithi090 ceph-mon[34571]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:26.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:27.263 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 systemd[1]: Starting Ceph mds.g for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:27.642 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 podman[71111]: 2024-09-21 02:39:27.266648282 +0000 UTC m=+0.033323108 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:27.643 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 podman[71111]: 2024-09-21 02:39:27.405219031 +0000 UTC m=+0.171893839 container create aa068203c8417e14b477b75be57ee5298c1e19427c8a74ca53ef119d6d940f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T02:39:27.643 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 podman[71111]: 2024-09-21 02:39:27.641464985 +0000 UTC m=+0.408139796 container init aa068203c8417e14b477b75be57ee5298c1e19427c8a74ca53ef119d6d940f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T02:39:27.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:27 smithi172 ceph-mon[35067]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:27.806 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:27.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:27 smithi084 ceph-mon[30747]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:27.948 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 podman[71111]: 2024-09-21 02:39:27.64793522 +0000 UTC m=+0.414610041 container start aa068203c8417e14b477b75be57ee5298c1e19427c8a74ca53ef119d6d940f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T02:39:27.948 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 ceph-mds[71156]: -- 172.21.15.84:0/2792950619 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562138abd860 con 0x56213cc65180 2024-09-21T02:39:27.948 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 bash[71111]: aa068203c8417e14b477b75be57ee5298c1e19427c8a74ca53ef119d6d940f8f 2024-09-21T02:39:27.948 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g[71141]: starting mds.g at 2024-09-21T02:39:27.948 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:39:27 smithi084 systemd[1]: Started Ceph mds.g for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:28.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:27 smithi090 ceph-mon[34571]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:28.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.480+0000 7f77c3000640 1 -- 172.21.15.84:0/3013004558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77bc103b70 msgr2=0x7f77bc103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:28.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.480+0000 7f77c3000640 1 --2- 172.21.15.84:0/3013004558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77bc103b70 0x7f77bc103f80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009900 tx=0x7f77ac02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.480+0000 7f77c3000640 1 -- 172.21.15.84:0/3013004558 shutdown_connections 2024-09-21T02:39:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.480+0000 7f77c3000640 1 --2- 172.21.15.84:0/3013004558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc109e00 0x7f77bc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.480+0000 7f77c3000640 1 --2- 172.21.15.84:0/3013004558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77bc1094b0 0x7f77bc1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.480+0000 7f77c3000640 1 --2- 172.21.15.84:0/3013004558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77bc103b70 0x7f77bc103f80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.480+0000 7f77c3000640 1 -- 172.21.15.84:0/3013004558 >> 172.21.15.84:0/3013004558 conn(0x7f77bc0ff5e0 msgr2=0x7f77bc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.481+0000 7f77c3000640 1 -- 172.21.15.84:0/3013004558 shutdown_connections 2024-09-21T02:39:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.481+0000 7f77c3000640 1 -- 172.21.15.84:0/3013004558 wait complete. 2024-09-21T02:39:28.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.482+0000 7f77c3000640 1 Processor -- start 2024-09-21T02:39:28.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.483+0000 7f77c3000640 1 -- start start 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.483+0000 7f77c3000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77bc103b70 0x7f77bc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.483+0000 7f77c3000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc1094b0 0x7f77bc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.483+0000 7f77c3000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77bc109e00 0x7f77bc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.483+0000 7f77c3000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc113c00 con 0x7f77bc103b70 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.483+0000 7f77c3000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc113a80 con 0x7f77bc109e00 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.483+0000 7f77c3000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc113d80 con 0x7f77bc1094b0 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.483+0000 7f77bbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77bc103b70 0x7f77bc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc1094b0 0x7f77bc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc1094b0 0x7f77bc19ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:40220/0 (socket says 172.21.15.84:40220) 2024-09-21T02:39:28.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 -- 172.21.15.84:0/2816388376 learned_addr learned my addr 172.21.15.84:0/2816388376 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:28.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77c1000640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77bc109e00 0x7f77bc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:28.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 -- 172.21.15.84:0/2816388376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77bc109e00 msgr2=0x7f77bc19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77bc109e00 0x7f77bc19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 -- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77bc103b70 msgr2=0x7f77bc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77bc103b70 0x7f77bc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 -- 172.21.15.84:0/2816388376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc1a0500 con 0x7f77bc1094b0 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.484+0000 7f77b3e00640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc1094b0 0x7f77bc19ab30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f77a400e970 tx=0x7f77a400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.485+0000 7f77b9600640 1 -- 172.21.15.84:0/2816388376 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a400cd80 con 0x7f77bc1094b0 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.485+0000 7f77b9600640 1 -- 172.21.15.84:0/2816388376 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f77a40035f0 con 0x7f77bc1094b0 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.485+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc1a07f0 con 0x7f77bc1094b0 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.485+0000 7f77b9600640 1 -- 172.21.15.84:0/2816388376 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4010690 con 0x7f77bc1094b0 2024-09-21T02:39:28.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.485+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc1a6f50 con 0x7f77bc1094b0 2024-09-21T02:39:28.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.486+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77bc103f80 con 0x7f77bc1094b0 2024-09-21T02:39:28.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.488+0000 7f77b9600640 1 -- 172.21.15.84:0/2816388376 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f77a4003b30 con 0x7f77bc1094b0 2024-09-21T02:39:28.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.490+0000 7f77b9600640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f77a00b6510 0x7f77a00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:28.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.490+0000 7f77b9600640 1 -- 172.21.15.84:0/2816388376 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f77a40e7500 con 0x7f77bc1094b0 2024-09-21T02:39:28.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.491+0000 7f77bbe00640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f77a00b6510 0x7f77a00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:28.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.491+0000 7f77bbe00640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f77a00b6510 0x7f77a00b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009230 tx=0x7f77ac0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:28.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.491+0000 7f77b9600640 1 -- 172.21.15.84:0/2816388376 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77a40ae190 con 0x7f77bc1094b0 2024-09-21T02:39:28.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.733+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77bc19b6c0 con 0x7f77bc1094b0 2024-09-21T02:39:28.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.734+0000 7f77b9600640 1 -- 172.21.15.84:0/2816388376 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8866 (secure 0 0 0) 0x7f77bc19b6c0 con 0x7f77bc1094b0 2024-09-21T02:39:28.735 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:28.736 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":11,"btime":"2024-09-21T02:39:28:674454+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24647,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24673,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24703,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T02:39:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 11 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f77a00b6510 msgr2=0x7f77a00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f77a00b6510 0x7f77a00b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009230 tx=0x7f77ac0058d0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc1094b0 msgr2=0x7f77bc19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc1094b0 0x7f77bc19ab30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f77a400e970 tx=0x7f77a400ee30 comp rx=0 tx=0).stop 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 shutdown_connections 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f77a00b6510 0x7f77a00b8a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc1094b0 0x7f77bc19ab30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77bc109e00 0x7f77bc19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 --2- 172.21.15.84:0/2816388376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77bc103b70 0x7f77bc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.736+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 >> 172.21.15.84:0/2816388376 conn(0x7f77bc0ff5e0 msgr2=0x7f77bc101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.737+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 shutdown_connections 2024-09-21T02:39:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:28.737+0000 7f77c3000640 1 -- 172.21.15.84:0/2816388376 wait complete. 2024-09-21T02:39:29.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:29.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:29.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:29.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: Deploying daemon mds.a on smithi084 2024-09-21T02:39:29.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.84:6838/594957392,v1:172.21.15.84:6839/594957392] up:boot 2024-09-21T02:39:29.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: fsmap 10 up:standby 2024-09-21T02:39:29.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:39:29.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:28 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2816388376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:29.240 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.240 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.240 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.241 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:29.241 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:29.241 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:29.241 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: Deploying daemon mds.a on smithi084 2024-09-21T02:39:29.241 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.84:6838/594957392,v1:172.21.15.84:6839/594957392] up:boot 2024-09-21T02:39:29.241 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: fsmap 10 up:standby 2024-09-21T02:39:29.241 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:39:29.241 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:28 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2816388376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: Deploying daemon mds.a on smithi084 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.84:6838/594957392,v1:172.21.15.84:6839/594957392] up:boot 2024-09-21T02:39:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: fsmap 10 up:standby 2024-09-21T02:39:29.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T02:39:29.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:28 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2816388376' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:30.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:29 smithi172 ceph-mon[35067]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:30.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:29 smithi084 ceph-mon[30747]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:30.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:29 smithi090 ceph-mon[34571]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:31.400 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 systemd[1]: Starting Ceph mds.a for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:31.673 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 podman[71460]: 2024-09-21 02:39:31.303209179 +0000 UTC m=+0.026691130 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:31.673 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 podman[71460]: 2024-09-21 02:39:31.435157078 +0000 UTC m=+0.158638997 container create 04c1d944003583146d3948741b024ad9019de5ded47d1e943efa58a4e3a17148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:39:31.673 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 podman[71460]: 2024-09-21 02:39:31.672231641 +0000 UTC m=+0.395713585 container init 04c1d944003583146d3948741b024ad9019de5ded47d1e943efa58a4e3a17148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:39:31.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:31.959 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:31 smithi084 ceph-mon[30747]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:31.959 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 podman[71460]: 2024-09-21 02:39:31.679176916 +0000 UTC m=+0.402658846 container start 04c1d944003583146d3948741b024ad9019de5ded47d1e943efa58a4e3a17148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T02:39:31.959 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 bash[71460]: 04c1d944003583146d3948741b024ad9019de5ded47d1e943efa58a4e3a17148 2024-09-21T02:39:31.959 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 ceph-mds[71479]: -- 172.21.15.84:0/1199330708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648a094d860 con 0x5648a4af5600 2024-09-21T02:39:31.959 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a[71475]: starting mds.a at 2024-09-21T02:39:31.959 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:39:31 smithi084 systemd[1]: Started Ceph mds.a for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:31 smithi172 ceph-mon[35067]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:32.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:31 smithi090 ceph-mon[34571]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:32.280 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:32.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 -- 172.21.15.84:0/4143170795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 msgr2=0x7f24a4102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:32.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 --2- 172.21.15.84:0/4143170795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 0x7f24a4102f40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2494009900 tx=0x7f249402a410 comp rx=0 tx=0).stop 2024-09-21T02:39:32.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 -- 172.21.15.84:0/4143170795 shutdown_connections 2024-09-21T02:39:32.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 --2- 172.21.15.84:0/4143170795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24a41051b0 0x7f24a41055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:32.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 --2- 172.21.15.84:0/4143170795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a4105b00 0x7f24a410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:32.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 --2- 172.21.15.84:0/4143170795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 0x7f24a4102f40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:32.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 -- 172.21.15.84:0/4143170795 >> 172.21.15.84:0/4143170795 conn(0x7f24a40799a0 msgr2=0x7f24a4079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:32.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 -- 172.21.15.84:0/4143170795 shutdown_connections 2024-09-21T02:39:32.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.899+0000 7f24ab600640 1 -- 172.21.15.84:0/4143170795 wait complete. 2024-09-21T02:39:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.900+0000 7f24ab600640 1 Processor -- start 2024-09-21T02:39:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.900+0000 7f24ab600640 1 -- start start 2024-09-21T02:39:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24ab600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 0x7f24a40ff600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24ab600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24a41051b0 0x7f24a40ffb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24ab600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a4105b00 0x7f24a4100080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24ab600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112b90 con 0x7f24a4105b00 2024-09-21T02:39:32.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24ab600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112a10 con 0x7f24a4102b30 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24ab600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112d10 con 0x7f24a41051b0 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24a8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 0x7f24a40ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24a8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 0x7f24a40ff600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:38678/0 (socket says 172.21.15.84:38678) 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24a8c00640 1 -- 172.21.15.84:0/2573138531 learned_addr learned my addr 172.21.15.84:0/2573138531 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f24a9600640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a4105b00 0x7f24a4100080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.901+0000 7f249be00640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24a41051b0 0x7f24a40ffb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f24a8c00640 1 -- 172.21.15.84:0/2573138531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24a41051b0 msgr2=0x7f24a40ffb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f24a8c00640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24a41051b0 0x7f24a40ffb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f24a8c00640 1 -- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a4105b00 msgr2=0x7f24a4100080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f24a8c00640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a4105b00 0x7f24a4100080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f24a8c00640 1 -- 172.21.15.84:0/2573138531 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a41a8930 con 0x7f24a4102b30 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f249be00640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24a41051b0 0x7f24a40ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:32.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f24a9600640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a4105b00 0x7f24a4100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f24a8c00640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 0x7f24a40ff600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24940314b0 tx=0x7f2494003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.902+0000 7f24a2000640 1 -- 172.21.15.84:0/2573138531 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249403f070 con 0x7f24a4102b30 2024-09-21T02:39:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.903+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a41a8bc0 con 0x7f24a4102b30 2024-09-21T02:39:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.903+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a41a90f0 con 0x7f24a4102b30 2024-09-21T02:39:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.903+0000 7f24a2000640 1 -- 172.21.15.84:0/2573138531 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2494031bf0 con 0x7f24a4102b30 2024-09-21T02:39:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.903+0000 7f24a2000640 1 -- 172.21.15.84:0/2573138531 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494049060 con 0x7f24a4102b30 2024-09-21T02:39:32.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.904+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a4102f40 con 0x7f24a4102b30 2024-09-21T02:39:32.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.906+0000 7f24a2000640 1 -- 172.21.15.84:0/2573138531 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2494042070 con 0x7f24a4102b30 2024-09-21T02:39:32.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.907+0000 7f24a2000640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f24880b6590 0x7f24880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.908+0000 7f24a2000640 1 -- 172.21.15.84:0/2573138531 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f2494107550 con 0x7f24a4102b30 2024-09-21T02:39:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.908+0000 7f249be00640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f24880b6590 0x7f24880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:32.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.908+0000 7f249be00640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f24880b6590 0x7f24880b8aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f24a4107e40 tx=0x7f248c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:32.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:32.909+0000 7f24a2000640 1 -- 172.21.15.84:0/2573138531 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24940ce1e0 con 0x7f24a4102b30 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: Deploying daemon mds.b on smithi090 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.84:6840/3752727807,v1:172.21.15.84:6841/3752727807] up:boot 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: fsmap 11 up:standby 2024-09-21T02:39:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:32 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:39:33.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.132+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24a4100900 con 0x7f24a4102b30 2024-09-21T02:39:33.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.133+0000 7f24a2000640 1 -- 172.21.15.84:0/2573138531 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f24a4100900 con 0x7f24a4102b30 2024-09-21T02:39:33.135 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:33.135 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":12,"btime":"2024-09-21T02:39:32:673566+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24647,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24673,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24703,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T02:39:33.135 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-09-21T02:39:33.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f24880b6590 msgr2=0x7f24880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f24880b6590 0x7f24880b8aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f24a4107e40 tx=0x7f248c005f90 comp rx=0 tx=0).stop 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 msgr2=0x7f24a40ff600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 0x7f24a40ff600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24940314b0 tx=0x7f2494003c10 comp rx=0 tx=0).stop 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 shutdown_connections 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f24880b6590 0x7f24880b8aa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24a41051b0 0x7f24a40ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a4105b00 0x7f24a4100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 --2- 172.21.15.84:0/2573138531 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24a4102b30 0x7f24a40ff600 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 >> 172.21.15.84:0/2573138531 conn(0x7f24a40799a0 msgr2=0x7f24a4101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 shutdown_connections 2024-09-21T02:39:33.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:33.136+0000 7f24ab600640 1 -- 172.21.15.84:0/2573138531 wait complete. 2024-09-21T02:39:33.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:33.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:33.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:33.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: Deploying daemon mds.b on smithi090 2024-09-21T02:39:33.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.84:6840/3752727807,v1:172.21.15.84:6841/3752727807] up:boot 2024-09-21T02:39:33.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: fsmap 11 up:standby 2024-09-21T02:39:33.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:32 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: Deploying daemon mds.b on smithi090 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.84:6840/3752727807,v1:172.21.15.84:6841/3752727807] up:boot 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: fsmap 11 up:standby 2024-09-21T02:39:33.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:32 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T02:39:33.880 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:33 smithi090 systemd[1]: Starting Ceph mds.b for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:39:34.134 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:33 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2573138531' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:34.134 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:33 smithi090 ceph-mon[34571]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:34.134 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:33 smithi090 podman[62999]: 2024-09-21 02:39:33.88939666 +0000 UTC m=+0.019801578 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:39:34.134 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:34 smithi090 podman[62999]: 2024-09-21 02:39:34.000700038 +0000 UTC m=+0.131104954 container create 4c2765dca7a27e3e3794c68b379f766d5c96da0897edc2179b731ed8b56ec6bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T02:39:34.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:33 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2573138531' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:34.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:33 smithi172 ceph-mon[35067]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:34.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:33 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2573138531' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:34.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:33 smithi084 ceph-mon[30747]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:34.517 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:34 smithi090 podman[62999]: 2024-09-21 02:39:34.254646168 +0000 UTC m=+0.385051086 container init 4c2765dca7a27e3e3794c68b379f766d5c96da0897edc2179b731ed8b56ec6bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T02:39:34.517 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:34 smithi090 podman[62999]: 2024-09-21 02:39:34.257693489 +0000 UTC m=+0.388098407 container start 4c2765dca7a27e3e3794c68b379f766d5c96da0897edc2179b731ed8b56ec6bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T02:39:34.517 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:34 smithi090 ceph-mds[63018]: -- 172.21.15.90:0/165396490 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe3907d860 con 0x55fe3d225a80 2024-09-21T02:39:34.517 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:34 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b[63014]: starting mds.b at 2024-09-21T02:39:34.517 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:34 smithi090 bash[62999]: 4c2765dca7a27e3e3794c68b379f766d5c96da0897edc2179b731ed8b56ec6bc 2024-09-21T02:39:34.517 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:34 smithi090 systemd[1]: Started Ceph mds.b for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:39:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] up:boot 2024-09-21T02:39:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: fsmap 12 up:standby 2024-09-21T02:39:35.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:35 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] up:boot 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: fsmap 12 up:standby 2024-09-21T02:39:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:35 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:39:35.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] up:boot 2024-09-21T02:39:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: fsmap 12 up:standby 2024-09-21T02:39:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:35 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:39:35.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:39:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:36.698 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:36 smithi084 ceph-mon[30747]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:36.698 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:36 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:36 smithi172 ceph-mon[35067]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:36 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:36 smithi090 ceph-mon[34571]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:36.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:36.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:36 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.114+0000 7fd78be00640 1 -- 172.21.15.84:0/1471091413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 msgr2=0x7fd78c103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.114+0000 7fd78be00640 1 --2- 172.21.15.84:0/1471091413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 0x7fd78c103da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009900 tx=0x7fd77c02a410 comp rx=0 tx=0).stop 2024-09-21T02:39:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.114+0000 7fd78be00640 1 -- 172.21.15.84:0/1471091413 shutdown_connections 2024-09-21T02:39:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.114+0000 7fd78be00640 1 --2- 172.21.15.84:0/1471091413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd78c109c20 0x7fd78c110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.114+0000 7fd78be00640 1 --2- 172.21.15.84:0/1471091413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c1092d0 0x7fd78c1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.114+0000 7fd78be00640 1 --2- 172.21.15.84:0/1471091413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 0x7fd78c103da0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.114+0000 7fd78be00640 1 -- 172.21.15.84:0/1471091413 >> 172.21.15.84:0/1471091413 conn(0x7fd78c0ff3e0 msgr2=0x7fd78c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:37.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.115+0000 7fd78be00640 1 -- 172.21.15.84:0/1471091413 shutdown_connections 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.115+0000 7fd78be00640 1 -- 172.21.15.84:0/1471091413 wait complete. 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78be00640 1 Processor -- start 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78be00640 1 -- start start 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 0x7fd78c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c1092d0 0x7fd78c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd78c109c20 0x7fd78c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c113a70 con 0x7fd78c103990 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1138f0 con 0x7fd78c1092d0 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c113bf0 con 0x7fd78c109c20 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 0x7fd78c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 0x7fd78c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45080/0 (socket says 172.21.15.84:45080) 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78aa00640 1 -- 172.21.15.84:0/3932892382 learned_addr learned my addr 172.21.15.84:0/3932892382 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.116+0000 7fd78b400640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd78c109c20 0x7fd78c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.117+0000 7fd78a000640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c1092d0 0x7fd78c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.117+0000 7fd78aa00640 1 -- 172.21.15.84:0/3932892382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd78c109c20 msgr2=0x7fd78c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.117+0000 7fd78aa00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd78c109c20 0x7fd78c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.117+0000 7fd78aa00640 1 -- 172.21.15.84:0/3932892382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c1092d0 msgr2=0x7fd78c19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.117+0000 7fd78aa00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c1092d0 0x7fd78c19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.117+0000 7fd78aa00640 1 -- 172.21.15.84:0/3932892382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c1a0350 con 0x7fd78c103990 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.117+0000 7fd78aa00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 0x7fd78c19a3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0314b0 tx=0x7fd77c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.117+0000 7fd783400640 1 -- 172.21.15.84:0/3932892382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c03f070 con 0x7fd78c103990 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.118+0000 7fd783400640 1 -- 172.21.15.84:0/3932892382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd77c031bf0 con 0x7fd78c103990 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.118+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c1a05e0 con 0x7fd78c103990 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.118+0000 7fd783400640 1 -- 172.21.15.84:0/3932892382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c035030 con 0x7fd78c103990 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.118+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78c1a6da0 con 0x7fd78c103990 2024-09-21T02:39:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.119+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78c103da0 con 0x7fd78c103990 2024-09-21T02:39:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.121+0000 7fd783400640 1 -- 172.21.15.84:0/3932892382 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd77c042070 con 0x7fd78c103990 2024-09-21T02:39:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.124+0000 7fd783400640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd7700b6590 0x7fd7700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.124+0000 7fd78a000640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd7700b6590 0x7fd7700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.124+0000 7fd783400640 1 -- 172.21.15.84:0/3932892382 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fd77c107b20 con 0x7fd78c103990 2024-09-21T02:39:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.124+0000 7fd78a000640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd7700b6590 0x7fd7700b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd78c108d70 tx=0x7fd778005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.126+0000 7fd783400640 1 -- 172.21.15.84:0/3932892382 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd77c0d2b90 con 0x7fd78c103990 2024-09-21T02:39:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.385+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd78c19b510 con 0x7fd78c103990 2024-09-21T02:39:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.386+0000 7fd783400640 1 -- 172.21.15.84:0/3932892382 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10518 (secure 0 0 0) 0x7fd78c19b510 con 0x7fd78c103990 2024-09-21T02:39:37.388 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:37.388 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"btime":"2024-09-21T02:39:34:878316+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24647,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24673,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24703,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24704,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T02:39:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-09-21T02:39:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd7700b6590 msgr2=0x7fd7700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd7700b6590 0x7fd7700b8aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd78c108d70 tx=0x7fd778005f90 comp rx=0 tx=0).stop 2024-09-21T02:39:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 msgr2=0x7fd78c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 0x7fd78c19a3e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0314b0 tx=0x7fd77c003c10 comp rx=0 tx=0).stop 2024-09-21T02:39:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 shutdown_connections 2024-09-21T02:39:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd7700b6590 0x7fd7700b8aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd78c109c20 0x7fd78c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c1092d0 0x7fd78c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 --2- 172.21.15.84:0/3932892382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd78c103990 0x7fd78c19a3e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 >> 172.21.15.84:0/3932892382 conn(0x7fd78c0ff3e0 msgr2=0x7fd78c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 shutdown_connections 2024-09-21T02:39:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:37.389+0000 7fd78be00640 1 -- 172.21.15.84:0/3932892382 wait complete. 2024-09-21T02:39:37.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:37.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:37.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:37.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:37.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:37.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:37.897 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:37.898 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3932892382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:37.898 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:37 smithi172 ceph-mon[35067]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3932892382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:37 smithi084 ceph-mon[30747]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:38.086 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:38.086 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:38.086 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:38.086 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:38.086 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:38.086 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:38.087 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:39:38.087 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3932892382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:39:38.087 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:37 smithi090 ceph-mon[34571]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:38.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T02:39:39.155 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:39.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 -- 172.21.15.84:0/811743118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c109c40 msgr2=0x7f103c110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:39.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 --2- 172.21.15.84:0/811743118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c109c40 0x7f103c110470 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1034009ca0 tx=0x7f103402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:39:39.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 -- 172.21.15.84:0/811743118 shutdown_connections 2024-09-21T02:39:39.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 --2- 172.21.15.84:0/811743118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c1092f0 0x7f103c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:39.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 --2- 172.21.15.84:0/811743118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c109c40 0x7f103c110470 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:39.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 --2- 172.21.15.84:0/811743118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f103c1039b0 0x7f103c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:39.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 -- 172.21.15.84:0/811743118 >> 172.21.15.84:0/811743118 conn(0x7f103c0ff440 msgr2=0x7f103c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:39.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 -- 172.21.15.84:0/811743118 shutdown_connections 2024-09-21T02:39:39.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.802+0000 7f1040c00640 1 -- 172.21.15.84:0/811743118 wait complete. 2024-09-21T02:39:39.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.803+0000 7f1040c00640 1 Processor -- start 2024-09-21T02:39:39.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.803+0000 7f1040c00640 1 -- start start 2024-09-21T02:39:39.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f1040c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c1039b0 0x7f103c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:39.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f1040c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c1092f0 0x7f103c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:39.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f1040c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f103c109c40 0x7f103c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:39.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f1040c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f103c113a40 con 0x7f103c1039b0 2024-09-21T02:39:39.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f1040c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f103c1138c0 con 0x7f103c109c40 2024-09-21T02:39:39.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f1040c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f103c113bc0 con 0x7f103c1092f0 2024-09-21T02:39:39.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c1092f0 0x7f103c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:39.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c1039b0 0x7f103c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:39.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c1092f0 0x7f103c19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:55178/0 (socket says 172.21.15.84:55178) 2024-09-21T02:39:39.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103aa00640 1 -- 172.21.15.84:0/1513504024 learned_addr learned my addr 172.21.15.84:0/1513504024 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:39.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103be00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f103c109c40 0x7f103c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103aa00640 1 -- 172.21.15.84:0/1513504024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f103c109c40 msgr2=0x7f103c19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103aa00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f103c109c40 0x7f103c19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103aa00640 1 -- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c1039b0 msgr2=0x7f103c19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.804+0000 7f103aa00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c1039b0 0x7f103c19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.805+0000 7f103aa00640 1 -- 172.21.15.84:0/1513504024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c1a0320 con 0x7f103c1092f0 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.805+0000 7f103aa00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c1092f0 0x7f103c19a950 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f102800e9c0 tx=0x7f102800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.805+0000 7f1033e00640 1 -- 172.21.15.84:0/1513504024 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102800ccc0 con 0x7f103c1092f0 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.805+0000 7f1033e00640 1 -- 172.21.15.84:0/1513504024 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10280054f0 con 0x7f103c1092f0 2024-09-21T02:39:39.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.805+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103c1a0610 con 0x7f103c1092f0 2024-09-21T02:39:39.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.805+0000 7f1033e00640 1 -- 172.21.15.84:0/1513504024 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028010430 con 0x7f103c1092f0 2024-09-21T02:39:39.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.805+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103c1a6d70 con 0x7f103c1092f0 2024-09-21T02:39:39.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.807+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103c103dc0 con 0x7f103c1092f0 2024-09-21T02:39:39.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.810+0000 7f1033e00640 1 -- 172.21.15.84:0/1513504024 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f10280046c0 con 0x7f103c1092f0 2024-09-21T02:39:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.812+0000 7f1033e00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f10200b6590 0x7f10200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.812+0000 7f1033e00640 1 -- 172.21.15.84:0/1513504024 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f10280e74d0 con 0x7f103c1092f0 2024-09-21T02:39:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.812+0000 7f103b400640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f10200b6590 0x7f10200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:39.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.813+0000 7f1033e00640 1 -- 172.21.15.84:0/1513504024 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10280ae160 con 0x7f103c1092f0 2024-09-21T02:39:39.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:39.813+0000 7f103b400640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f10200b6590 0x7f10200b8aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f102c009bd0 tx=0x7f102c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:39 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:39 smithi084 ceph-mon[30747]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:40.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.015+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f103c19b4e0 con 0x7f103c1092f0 2024-09-21T02:39:40.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:39 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:39 smithi090 ceph-mon[34571]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:40.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.016+0000 7f1033e00640 1 -- 172.21.15.84:0/1513504024 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f103c19b4e0 con 0x7f103c1092f0 2024-09-21T02:39:40.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:39:40.017 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2024-09-21T02:39:40.018 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:39:40.018 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2024-09-21T02:39:40.018 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2024-09-21T02:39:40.018 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:39:40.018 INFO:teuthology.orchestra.run.smithi084.stdout:] 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f10200b6590 msgr2=0x7f10200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f10200b6590 0x7f10200b8aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f102c009bd0 tx=0x7f102c005f90 comp rx=0 tx=0).stop 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c1092f0 msgr2=0x7f103c19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c1092f0 0x7f103c19a950 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f102800e9c0 tx=0x7f102800ee80 comp rx=0 tx=0).stop 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 shutdown_connections 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f10200b6590 0x7f10200b8aa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103c1092f0 0x7f103c19a950 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f103c109c40 0x7f103c19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 --2- 172.21.15.84:0/1513504024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103c1039b0 0x7f103c19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.018+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 >> 172.21.15.84:0/1513504024 conn(0x7f103c0ff440 msgr2=0x7f103c108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.019+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 shutdown_connections 2024-09-21T02:39:40.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:40.019+0000 7f1040c00640 1 -- 172.21.15.84:0/1513504024 wait complete. 2024-09-21T02:39:40.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:39 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:40.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:39 smithi172 ceph-mon[35067]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:40.829 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T02:39:40.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T02:39:41.079 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:40 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1513504024' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:39:41.079 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.079 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.079 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:41.079 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:41.079 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.208 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:40 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1513504024' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:39:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:41.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:40 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1513504024' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T02:39:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:39:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:39:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:39:41.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 -- 172.21.15.84:0/2314247417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 msgr2=0x7f978c112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:41.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 --2- 172.21.15.84:0/2314247417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 0x7f978c112670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9784009ca0 tx=0x7f978402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:39:41.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 -- 172.21.15.84:0/2314247417 shutdown_connections 2024-09-21T02:39:41.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 --2- 172.21.15.84:0/2314247417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f978c10b4f0 0x7f978c10b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:41.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 --2- 172.21.15.84:0/2314247417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 0x7f978c112670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:41.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 --2- 172.21.15.84:0/2314247417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f978c105bb0 0x7f978c105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:41.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 -- 172.21.15.84:0/2314247417 >> 172.21.15.84:0/2314247417 conn(0x7f978c101680 msgr2=0x7f978c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:41.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 -- 172.21.15.84:0/2314247417 shutdown_connections 2024-09-21T02:39:41.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.848+0000 7f978be00640 1 -- 172.21.15.84:0/2314247417 wait complete. 2024-09-21T02:39:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.849+0000 7f978be00640 1 Processor -- start 2024-09-21T02:39:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.849+0000 7f978be00640 1 -- start start 2024-09-21T02:39:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f978c105bb0 0x7f978c19c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f978c10b4f0 0x7f978c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 0x7f978c1a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:41.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f978c115c40 con 0x7f978c10be40 2024-09-21T02:39:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f978c115ac0 con 0x7f978c105bb0 2024-09-21T02:39:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f978c115dc0 con 0x7f978c10b4f0 2024-09-21T02:39:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f978c105bb0 0x7f978c19c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 0x7f978c1a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f978c105bb0 0x7f978c19c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:35358/0 (socket says 172.21.15.84:35358) 2024-09-21T02:39:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 0x7f978c1a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51334/0 (socket says 172.21.15.84:51334) 2024-09-21T02:39:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f978aa00640 1 -- 172.21.15.84:0/4068391570 learned_addr learned my addr 172.21.15.84:0/4068391570 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:41.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.850+0000 7f9782000640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f978c10b4f0 0x7f978c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:41.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f978aa00640 1 -- 172.21.15.84:0/4068391570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f978c10b4f0 msgr2=0x7f978c19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:41.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f978aa00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f978c10b4f0 0x7f978c19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:41.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f978aa00640 1 -- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 msgr2=0x7f978c1a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:41.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f978aa00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 0x7f978c1a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:41.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f978aa00640 1 -- 172.21.15.84:0/4068391570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c1a2500 con 0x7f978c105bb0 2024-09-21T02:39:41.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f9782000640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f978c10b4f0 0x7f978c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:41.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f978aa00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f978c105bb0 0x7f978c19c590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e9f0 tx=0x7f977c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:41.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f9783e00640 1 -- 172.21.15.84:0/4068391570 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c00cd80 con 0x7f978c105bb0 2024-09-21T02:39:41.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.851+0000 7f9783e00640 1 -- 172.21.15.84:0/4068391570 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f977c010900 con 0x7f978c105bb0 2024-09-21T02:39:41.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.852+0000 7f9783e00640 1 -- 172.21.15.84:0/4068391570 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c018920 con 0x7f978c105bb0 2024-09-21T02:39:41.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.852+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978c1a27f0 con 0x7f978c105bb0 2024-09-21T02:39:41.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.852+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978c1a8f50 con 0x7f978c105bb0 2024-09-21T02:39:41.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.853+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978c105fc0 con 0x7f978c105bb0 2024-09-21T02:39:41.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.855+0000 7f9783e00640 1 -- 172.21.15.84:0/4068391570 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f977c010ab0 con 0x7f978c105bb0 2024-09-21T02:39:41.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.856+0000 7f9783e00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97700b6510 0x7f97700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:41.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.856+0000 7f9783e00640 1 -- 172.21.15.84:0/4068391570 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f977c0e7250 con 0x7f978c105bb0 2024-09-21T02:39:41.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.857+0000 7f9782000640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97700b6510 0x7f97700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:41.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.857+0000 7f9782000640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97700b6510 0x7f97700b8a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f978c104fa0 tx=0x7f9774005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:41.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:41.861+0000 7f9783e00640 1 -- 172.21.15.84:0/4068391570 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f977c0b22c0 con 0x7f978c105bb0 2024-09-21T02:39:42.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:41 smithi084 ceph-mon[30747]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:42.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.050+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f978c02e640 con 0x7f978c105bb0 2024-09-21T02:39:42.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:41 smithi172 ceph-mon[35067]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:42.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:41 smithi090 ceph-mon[34571]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:42.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.804+0000 7f9783e00640 1 -- 172.21.15.84:0/4068391570 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f977c0b7200 con 0x7f978c105bb0 2024-09-21T02:39:42.806 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97700b6510 msgr2=0x7f97700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97700b6510 0x7f97700b8a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f978c104fa0 tx=0x7f9774005f90 comp rx=0 tx=0).stop 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f978c105bb0 msgr2=0x7f978c19c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f978c105bb0 0x7f978c19c590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e9f0 tx=0x7f977c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 shutdown_connections 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97700b6510 0x7f97700b8a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f978c10b4f0 0x7f978c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f978c10be40 0x7f978c1a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 --2- 172.21.15.84:0/4068391570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f978c105bb0 0x7f978c19c590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.808+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 >> 172.21.15.84:0/4068391570 conn(0x7f978c101680 msgr2=0x7f978c108a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.809+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 shutdown_connections 2024-09-21T02:39:42.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:42.809+0000 7f978be00640 1 -- 172.21.15.84:0/4068391570 wait complete. 2024-09-21T02:39:43.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:42 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4068391570' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:39:43.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:42 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:39:43.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:42 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4068391570' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:39:43.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:42 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:39:43.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:42 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4068391570' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:39:43.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:42 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T02:39:43.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T02:39:44.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:43 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:39:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:43 smithi084 ceph-mon[30747]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:39:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:43 smithi084 ceph-mon[30747]: pgmap v302: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:44.044 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:44.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:43 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:39:44.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:43 smithi172 ceph-mon[35067]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:39:44.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:43 smithi172 ceph-mon[35067]: pgmap v302: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:44.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:43 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T02:39:44.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:43 smithi090 ceph-mon[34571]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T02:39:44.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:43 smithi090 ceph-mon[34571]: pgmap v302: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 -- 172.21.15.84:0/3962730450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38103b60 msgr2=0x7f5b38103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/3962730450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38103b60 0x7f5b38103f70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009900 tx=0x7f5b2c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 -- 172.21.15.84:0/3962730450 shutdown_connections 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/3962730450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b381094a0 0x7f5b381098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/3962730450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b38109df0 0x7f5b38110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/3962730450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38103b60 0x7f5b38103f70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 -- 172.21.15.84:0/3962730450 >> 172.21.15.84:0/3962730450 conn(0x7f5b3807b850 msgr2=0x7f5b3807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 -- 172.21.15.84:0/3962730450 shutdown_connections 2024-09-21T02:39:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.673+0000 7f5b3fe00640 1 -- 172.21.15.84:0/3962730450 wait complete. 2024-09-21T02:39:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.675+0000 7f5b3fe00640 1 Processor -- start 2024-09-21T02:39:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.675+0000 7f5b3fe00640 1 -- start start 2024-09-21T02:39:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.675+0000 7f5b3fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b38103b60 0x7f5b3819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.675+0000 7f5b3fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b381094a0 0x7f5b3819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.675+0000 7f5b3fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38109df0 0x7f5b3819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.675+0000 7f5b3fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38113c20 con 0x7f5b38103b60 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.675+0000 7f5b3fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38113aa0 con 0x7f5b38109df0 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.675+0000 7f5b3fe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38113da0 con 0x7f5b381094a0 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b38103b60 0x7f5b3819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3ca00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b381094a0 0x7f5b3819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b38103b60 0x7f5b3819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51350/0 (socket says 172.21.15.84:51350) 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3ca00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b381094a0 0x7f5b3819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47670/0 (socket says 172.21.15.84:47670) 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3d400640 1 -- 172.21.15.84:0/2957203405 learned_addr learned my addr 172.21.15.84:0/2957203405 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3de00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38109df0 0x7f5b3819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3de00640 1 -- 172.21.15.84:0/2957203405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b381094a0 msgr2=0x7f5b3819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3de00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b381094a0 0x7f5b3819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3de00640 1 -- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b38103b60 msgr2=0x7f5b3819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3de00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b38103b60 0x7f5b3819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3de00640 1 -- 172.21.15.84:0/2957203405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b381a0500 con 0x7f5b38109df0 2024-09-21T02:39:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.676+0000 7f5b3ca00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b381094a0 0x7f5b3819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.677+0000 7f5b3de00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38109df0 0x7f5b3819fdd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009fd0 tx=0x7f5b3000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.677+0000 7f5b36000640 1 -- 172.21.15.84:0/2957203405 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000ce20 con 0x7f5b38109df0 2024-09-21T02:39:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.677+0000 7f5b36000640 1 -- 172.21.15.84:0/2957203405 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5b30005020 con 0x7f5b38109df0 2024-09-21T02:39:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.677+0000 7f5b36000640 1 -- 172.21.15.84:0/2957203405 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b30010720 con 0x7f5b38109df0 2024-09-21T02:39:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.677+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b381a07f0 con 0x7f5b38109df0 2024-09-21T02:39:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.677+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b380755f0 con 0x7f5b38109df0 2024-09-21T02:39:44.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.678+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b38104de0 con 0x7f5b38109df0 2024-09-21T02:39:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.681+0000 7f5b36000640 1 -- 172.21.15.84:0/2957203405 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f5b30005560 con 0x7f5b38109df0 2024-09-21T02:39:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.682+0000 7f5b36000640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b200b6590 0x7f5b200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.682+0000 7f5b36000640 1 -- 172.21.15.84:0/2957203405 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7497+0+0 (secure 0 0 0) 0x7f5b300e7640 con 0x7f5b38109df0 2024-09-21T02:39:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.682+0000 7f5b3d400640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b200b6590 0x7f5b200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.683+0000 7f5b3d400640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b200b6590 0x7f5b200b8aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005f70 tx=0x7f5b2c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.684+0000 7f5b36000640 1 -- 172.21.15.84:0/2957203405 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b300ae160 con 0x7f5b38109df0 2024-09-21T02:39:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:44.878+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f5b38103f70 con 0x7f5b38109df0 2024-09-21T02:39:45.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:44 smithi172 ceph-mon[35067]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:39:45.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:44 smithi084 ceph-mon[30747]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:39:45.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:44 smithi090 ceph-mon[34571]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T02:39:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.828+0000 7f5b36000640 1 -- 172.21.15.84:0/2957203405 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v74) ==== 171+0+0 (secure 0 0 0) 0x7f5b38103f70 con 0x7f5b38109df0 2024-09-21T02:39:45.830 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2024-09-21T02:39:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.834+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b200b6590 msgr2=0x7f5b200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.834+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b200b6590 0x7f5b200b8aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005f70 tx=0x7f5b2c031400 comp rx=0 tx=0).stop 2024-09-21T02:39:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.834+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38109df0 msgr2=0x7f5b3819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:45.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.834+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38109df0 0x7f5b3819fdd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009fd0 tx=0x7f5b3000ef10 comp rx=0 tx=0).stop 2024-09-21T02:39:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.835+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 shutdown_connections 2024-09-21T02:39:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.835+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b200b6590 0x7f5b200b8aa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.835+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b381094a0 0x7f5b3819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.835+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b38109df0 0x7f5b3819fdd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.835+0000 7f5b3fe00640 1 --2- 172.21.15.84:0/2957203405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b38103b60 0x7f5b3819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.835+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 >> 172.21.15.84:0/2957203405 conn(0x7f5b3807b850 msgr2=0x7f5b38107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.836+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 shutdown_connections 2024-09-21T02:39:45.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:45.836+0000 7f5b3fe00640 1 -- 172.21.15.84:0/2957203405 wait complete. 2024-09-21T02:39:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:45 smithi090 ceph-mon[34571]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:39:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:45 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2957203405' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:39:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:45 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:39:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:45 smithi090 ceph-mon[34571]: pgmap v305: 33 pgs: 23 unknown, 10 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:46.216 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:45 smithi084 ceph-mon[30747]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:39:46.216 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:45 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2957203405' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:39:46.216 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:45 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:39:46.216 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:45 smithi084 ceph-mon[30747]: pgmap v305: 33 pgs: 23 unknown, 10 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:46.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:45 smithi172 ceph-mon[35067]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T02:39:46.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:45 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2957203405' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:39:46.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:45 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T02:39:46.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:45 smithi172 ceph-mon[35067]: pgmap v305: 33 pgs: 23 unknown, 10 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:46.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T02:39:46.836 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:46 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:39:46.837 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:46 smithi084 ceph-mon[30747]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:39:46.982 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:47.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:46 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:39:47.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:46 smithi172 ceph-mon[35067]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:39:47.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:46 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T02:39:47.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:46 smithi090 ceph-mon[34571]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 -- 172.21.15.84:0/3259688582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 msgr2=0x7f72f41087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 --2- 172.21.15.84:0/3259688582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 0x7f72f41087d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009900 tx=0x7f72dc02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 -- 172.21.15.84:0/3259688582 shutdown_connections 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 --2- 172.21.15.84:0/3259688582 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f4108d10 0x7f72f410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 --2- 172.21.15.84:0/3259688582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 0x7f72f41087d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 --2- 172.21.15.84:0/3259688582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f4102a80 0x7f72f4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 -- 172.21.15.84:0/3259688582 >> 172.21.15.84:0/3259688582 conn(0x7f72f4079740 msgr2=0x7f72f4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 -- 172.21.15.84:0/3259688582 shutdown_connections 2024-09-21T02:39:47.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.619+0000 7f72fb400640 1 -- 172.21.15.84:0/3259688582 wait complete. 2024-09-21T02:39:47.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.620+0000 7f72fb400640 1 Processor -- start 2024-09-21T02:39:47.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.620+0000 7f72fb400640 1 -- start start 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72fb400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f4102a80 0x7f72f419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72fb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 0x7f72f419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72fb400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f4108d10 0x7f72f41a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72fb400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4112af0 con 0x7f72f41083c0 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72fb400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4112970 con 0x7f72f4102a80 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72fb400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4112c70 con 0x7f72f4108d10 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72ebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 0x7f72f419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72f8a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f4102a80 0x7f72f419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72ebe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 0x7f72f419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51370/0 (socket says 172.21.15.84:51370) 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72f8a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f4102a80 0x7f72f419c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:35374/0 (socket says 172.21.15.84:35374) 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72ebe00640 1 -- 172.21.15.84:0/1506519416 learned_addr learned my addr 172.21.15.84:0/1506519416 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.621+0000 7f72f9400640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f4108d10 0x7f72f41a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:47.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72ebe00640 1 -- 172.21.15.84:0/1506519416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f4108d10 msgr2=0x7f72f41a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72ebe00640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f4108d10 0x7f72f41a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72ebe00640 1 -- 172.21.15.84:0/1506519416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f4102a80 msgr2=0x7f72f419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72ebe00640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f4102a80 0x7f72f419c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72ebe00640 1 -- 172.21.15.84:0/1506519416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f41a2780 con 0x7f72f41083c0 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72f9400640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f4108d10 0x7f72f41a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72f8a00640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f4102a80 0x7f72f419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72ebe00640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 0x7f72f419cdb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72dc02a9e0 tx=0x7f72dc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72f2000640 1 -- 172.21.15.84:0/1506519416 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc03f070 con 0x7f72f41083c0 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72f2000640 1 -- 172.21.15.84:0/1506519416 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f72dc031be0 con 0x7f72f41083c0 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f41a2a10 con 0x7f72f41083c0 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72f2000640 1 -- 172.21.15.84:0/1506519416 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc035030 con 0x7f72f41083c0 2024-09-21T02:39:47.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.622+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f41a91d0 con 0x7f72f41083c0 2024-09-21T02:39:47.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.623+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f4103d00 con 0x7f72f41083c0 2024-09-21T02:39:47.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.626+0000 7f72f2000640 1 -- 172.21.15.84:0/1506519416 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f72dc042070 con 0x7f72f41083c0 2024-09-21T02:39:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.628+0000 7f72f2000640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72d80b6510 0x7f72d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.628+0000 7f72f2000640 1 -- 172.21.15.84:0/1506519416 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7879+0+0 (secure 0 0 0) 0x7f72dc107ff0 con 0x7f72f41083c0 2024-09-21T02:39:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.628+0000 7f72f8a00640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72d80b6510 0x7f72d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:47.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.629+0000 7f72f8a00640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72d80b6510 0x7f72d80b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009fc0 tx=0x7f72e4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:47.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.630+0000 7f72f2000640 1 -- 172.21.15.84:0/1506519416 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72dc0ce9b0 con 0x7f72f41083c0 2024-09-21T02:39:47.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:47.857+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f72f4102e90 con 0x7f72f41083c0 2024-09-21T02:39:48.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:47 smithi172 ceph-mon[35067]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:39:48.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:47 smithi172 ceph-mon[35067]: pgmap v308: 97 pgs: 27 creating+peering, 42 unknown, 28 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:48.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:47 smithi084 ceph-mon[30747]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:39:48.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:47 smithi084 ceph-mon[30747]: pgmap v308: 97 pgs: 27 creating+peering, 42 unknown, 28 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:48.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:47 smithi090 ceph-mon[34571]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T02:39:48.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:47 smithi090 ceph-mon[34571]: pgmap v308: 97 pgs: 27 creating+peering, 42 unknown, 28 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.843+0000 7f72f2000640 1 -- 172.21.15.84:0/1506519416 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f72dc0d2d90 con 0x7f72f41083c0 2024-09-21T02:39:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72d80b6510 msgr2=0x7f72d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72d80b6510 0x7f72d80b8a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f72e4009fc0 tx=0x7f72e4005f90 comp rx=0 tx=0).stop 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 msgr2=0x7f72f419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 0x7f72f419cdb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72dc02a9e0 tx=0x7f72dc003b90 comp rx=0 tx=0).stop 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 shutdown_connections 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72d80b6510 0x7f72d80b8a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f4108d10 0x7f72f41a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72f41083c0 0x7f72f419cdb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 --2- 172.21.15.84:0/1506519416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72f4102a80 0x7f72f419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.847+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 >> 172.21.15.84:0/1506519416 conn(0x7f72f4079740 msgr2=0x7f72f406bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.848+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 shutdown_connections 2024-09-21T02:39:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:48.848+0000 7f72fb400640 1 -- 172.21.15.84:0/1506519416 wait complete. 2024-09-21T02:39:49.239 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:48 smithi084 ceph-mon[30747]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:39:49.240 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:48 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1506519416' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:39:49.240 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:48 smithi084 ceph-mon[30747]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:39:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:48 smithi172 ceph-mon[35067]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:39:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:48 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1506519416' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:39:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:48 smithi172 ceph-mon[35067]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:39:49.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:48 smithi090 ceph-mon[34571]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T02:39:49.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:48 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1506519416' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T02:39:49.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:48 smithi090 ceph-mon[34571]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T02:39:49.656 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T02:39:49.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T02:39:50.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:49 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1506519416' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:39:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:49 smithi084 ceph-mon[30747]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:39:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:49 smithi084 ceph-mon[30747]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:39:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:49 smithi084 ceph-mon[30747]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:39:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:49 smithi084 ceph-mon[30747]: pgmap v311: 97 pgs: 27 creating+peering, 21 unknown, 49 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:50.026 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:50.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:49 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1506519416' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:39:50.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:49 smithi172 ceph-mon[35067]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:39:50.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:49 smithi172 ceph-mon[35067]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:39:50.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:49 smithi172 ceph-mon[35067]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:39:50.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:49 smithi172 ceph-mon[35067]: pgmap v311: 97 pgs: 27 creating+peering, 21 unknown, 49 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:50.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:49 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1506519416' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T02:39:50.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:49 smithi090 ceph-mon[34571]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T02:39:50.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:49 smithi090 ceph-mon[34571]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T02:39:50.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:49 smithi090 ceph-mon[34571]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T02:39:50.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:49 smithi090 ceph-mon[34571]: pgmap v311: 97 pgs: 27 creating+peering, 21 unknown, 49 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:39:50.267 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:39:49 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b[63014]: 2024-09-21T02:39:49.889+0000 7f08c34f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.672+0000 7f0b09c00640 1 -- 172.21.15.84:0/1414411491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b04109df0 msgr2=0x7f0b04110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.672+0000 7f0b09c00640 1 --2- 172.21.15.84:0/1414411491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b04109df0 0x7f0b04110620 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009ca0 tx=0x7f0afc02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.672+0000 7f0b09c00640 1 -- 172.21.15.84:0/1414411491 shutdown_connections 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.672+0000 7f0b09c00640 1 --2- 172.21.15.84:0/1414411491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b04109df0 0x7f0b04110620 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.672+0000 7f0b09c00640 1 --2- 172.21.15.84:0/1414411491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b041094a0 0x7f0b041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.672+0000 7f0b09c00640 1 --2- 172.21.15.84:0/1414411491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b04103b60 0x7f0b04103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.672+0000 7f0b09c00640 1 -- 172.21.15.84:0/1414411491 >> 172.21.15.84:0/1414411491 conn(0x7f0b0407b850 msgr2=0x7f0b0407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.672+0000 7f0b09c00640 1 -- 172.21.15.84:0/1414411491 shutdown_connections 2024-09-21T02:39:50.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.673+0000 7f0b09c00640 1 -- 172.21.15.84:0/1414411491 wait complete. 2024-09-21T02:39:50.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.673+0000 7f0b09c00640 1 Processor -- start 2024-09-21T02:39:50.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b09c00640 1 -- start start 2024-09-21T02:39:50.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b09c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b04103b60 0x7f0b0419c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b09c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b041094a0 0x7f0b0419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b09c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b04109df0 0x7f0b041a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b09c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04113c40 con 0x7f0b041094a0 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b09c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04113ac0 con 0x7f0b04103b60 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b09c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04113dc0 con 0x7f0b04109df0 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b02000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b041094a0 0x7f0b0419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b02000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b041094a0 0x7f0b0419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32786/0 (socket says 172.21.15.84:32786) 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b02a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b04103b60 0x7f0b0419c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b02000640 1 -- 172.21.15.84:0/2280098916 learned_addr learned my addr 172.21.15.84:0/2280098916 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:50.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.674+0000 7f0b03400640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b04109df0 0x7f0b041a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0b02a00640 1 -- 172.21.15.84:0/2280098916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b04109df0 msgr2=0x7f0b041a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0b02a00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b04109df0 0x7f0b041a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0b02a00640 1 -- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b041094a0 msgr2=0x7f0b0419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0b02a00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b041094a0 0x7f0b0419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0b02a00640 1 -- 172.21.15.84:0/2280098916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b041a2700 con 0x7f0b04103b60 2024-09-21T02:39:50.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0b02a00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b04103b60 0x7f0b0419c790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0af400e9f0 tx=0x7f0af400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0afb400640 1 -- 172.21.15.84:0/2280098916 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af400ccc0 con 0x7f0b04103b60 2024-09-21T02:39:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b041a29f0 con 0x7f0b04103b60 2024-09-21T02:39:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0afb400640 1 -- 172.21.15.84:0/2280098916 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0af4005020 con 0x7f0b04103b60 2024-09-21T02:39:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0afb400640 1 -- 172.21.15.84:0/2280098916 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af40049c0 con 0x7f0b04103b60 2024-09-21T02:39:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.675+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b041a9150 con 0x7f0b04103b60 2024-09-21T02:39:50.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.676+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b04103f70 con 0x7f0b04103b60 2024-09-21T02:39:50.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.679+0000 7f0afb400640 1 -- 172.21.15.84:0/2280098916 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0af40051d0 con 0x7f0b04103b60 2024-09-21T02:39:50.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.680+0000 7f0afb400640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0ae80b6510 0x7f0ae80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.681+0000 7f0afb400640 1 -- 172.21.15.84:0/2280098916 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f0af40e7260 con 0x7f0b04103b60 2024-09-21T02:39:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.681+0000 7f0b02000640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0ae80b6510 0x7f0ae80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:50.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.681+0000 7f0b02000640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0ae80b6510 0x7f0ae80b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0af00095f0 tx=0x7f0af0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:50.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.682+0000 7f0afb400640 1 -- 172.21.15.84:0/2280098916 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0af40adc30 con 0x7f0b04103b60 2024-09-21T02:39:50.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:50.879+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f0b0419d8c0 con 0x7f0b04103b60 2024-09-21T02:39:51.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:50 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] up:active 2024-09-21T02:39:51.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:50 smithi172 ceph-mon[35067]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:39:51.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:50 smithi172 ceph-mon[35067]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:39:51.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:50 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] up:active 2024-09-21T02:39:51.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:50 smithi084 ceph-mon[30747]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:39:51.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:50 smithi084 ceph-mon[30747]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:39:51.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:50 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] up:active 2024-09-21T02:39:51.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:50 smithi090 ceph-mon[34571]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:39:51.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:50 smithi090 ceph-mon[34571]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:39:51.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.880+0000 7f0afb400640 1 -- 172.21.15.84:0/2280098916 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v78) ==== 157+0+0 (secure 0 0 0) 0x7f0af40b2010 con 0x7f0b04103b60 2024-09-21T02:39:51.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0ae80b6510 msgr2=0x7f0ae80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:51.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0ae80b6510 0x7f0ae80b8a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0af00095f0 tx=0x7f0af0005f90 comp rx=0 tx=0).stop 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b04103b60 msgr2=0x7f0b0419c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b04103b60 0x7f0b0419c790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0af400e9f0 tx=0x7f0af400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 shutdown_connections 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0ae80b6510 0x7f0ae80b8a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b04109df0 0x7f0b041a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b041094a0 0x7f0b0419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 --2- 172.21.15.84:0/2280098916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b04103b60 0x7f0b0419c790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.883+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 >> 172.21.15.84:0/2280098916 conn(0x7f0b0407b850 msgr2=0x7f0b04105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.884+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 shutdown_connections 2024-09-21T02:39:51.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:51.884+0000 7f0b09c00640 1 -- 172.21.15.84:0/2280098916 wait complete. 2024-09-21T02:39:52.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:51 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2280098916' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:39:52.247 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:51 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:39:52.248 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:51 smithi084 ceph-mon[30747]: pgmap v312: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-21T02:39:52.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:51 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2280098916' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:39:52.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:51 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:39:52.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:51 smithi172 ceph-mon[35067]: pgmap v312: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-21T02:39:52.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:51 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2280098916' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:39:52.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:51 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T02:39:52.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:51 smithi090 ceph-mon[34571]: pgmap v312: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-21T02:39:52.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T02:39:53.251 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:52 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:39:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:52 smithi172 ceph-mon[35067]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:39:53.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:52 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:39:53.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:52 smithi084 ceph-mon[30747]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:39:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:52 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T02:39:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:52 smithi090 ceph-mon[34571]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T02:39:53.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 -- 172.21.15.84:0/4087199657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 msgr2=0x7f613c10fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:53.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 --2- 172.21.15.84:0/4087199657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 0x7f613c10fba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6128009900 tx=0x7f612802a410 comp rx=0 tx=0).stop 2024-09-21T02:39:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 -- 172.21.15.84:0/4087199657 shutdown_connections 2024-09-21T02:39:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 --2- 172.21.15.84:0/4087199657 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f613c1100e0 0x7f613c112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 --2- 172.21.15.84:0/4087199657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 0x7f613c10fba0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 --2- 172.21.15.84:0/4087199657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f613c0757b0 0x7f613c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 -- 172.21.15.84:0/4087199657 >> 172.21.15.84:0/4087199657 conn(0x7f613c0ff5d0 msgr2=0x7f613c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 -- 172.21.15.84:0/4087199657 shutdown_connections 2024-09-21T02:39:53.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.899+0000 7f6143200640 1 -- 172.21.15.84:0/4087199657 wait complete. 2024-09-21T02:39:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.900+0000 7f6143200640 1 Processor -- start 2024-09-21T02:39:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.900+0000 7f6143200640 1 -- start start 2024-09-21T02:39:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.900+0000 7f6143200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f613c0757b0 0x7f613c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:53.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.900+0000 7f6143200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 0x7f613c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.900+0000 7f6143200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f613c1100e0 0x7f613c1a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.900+0000 7f6143200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f613c115e00 con 0x7f613c076100 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.900+0000 7f6143200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f613c115c80 con 0x7f613c0757b0 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.900+0000 7f6143200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f613c115f80 con 0x7f613c1100e0 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 0x7f613c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 0x7f613c19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32798/0 (socket says 172.21.15.84:32798) 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613b400640 1 -- 172.21.15.84:0/3476021744 learned_addr learned my addr 172.21.15.84:0/3476021744 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613be00640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f613c0757b0 0x7f613c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f6141200640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f613c1100e0 0x7f613c1a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613be00640 1 -- 172.21.15.84:0/3476021744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f613c1100e0 msgr2=0x7f613c1a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613be00640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f613c1100e0 0x7f613c1a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613be00640 1 -- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 msgr2=0x7f613c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613be00640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 0x7f613c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:53.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f613be00640 1 -- 172.21.15.84:0/3476021744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c1a2680 con 0x7f613c0757b0 2024-09-21T02:39:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.901+0000 7f6141200640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f613c1100e0 0x7f613c1a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:39:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.902+0000 7f613be00640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f613c0757b0 0x7f613c19c710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f612c00d6d0 tx=0x7f612c00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.902+0000 7f6138c00640 1 -- 172.21.15.84:0/3476021744 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c017070 con 0x7f613c0757b0 2024-09-21T02:39:53.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.902+0000 7f6138c00640 1 -- 172.21.15.84:0/3476021744 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f612c009820 con 0x7f613c0757b0 2024-09-21T02:39:53.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.902+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613c1a2970 con 0x7f613c0757b0 2024-09-21T02:39:53.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.902+0000 7f6138c00640 1 -- 172.21.15.84:0/3476021744 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c004c30 con 0x7f613c0757b0 2024-09-21T02:39:53.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.902+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613c1a90d0 con 0x7f613c0757b0 2024-09-21T02:39:53.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.903+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613c075bc0 con 0x7f613c0757b0 2024-09-21T02:39:53.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.905+0000 7f6138c00640 1 -- 172.21.15.84:0/3476021744 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f612c0099d0 con 0x7f613c0757b0 2024-09-21T02:39:53.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.907+0000 7f6138c00640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f61200b6590 0x7f61200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:53.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.907+0000 7f6138c00640 1 -- 172.21.15.84:0/3476021744 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8277+0+0 (secure 0 0 0) 0x7f612c0e6e10 con 0x7f613c0757b0 2024-09-21T02:39:53.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.907+0000 7f613b400640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f61200b6590 0x7f61200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:53.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.908+0000 7f613b400640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f61200b6590 0x7f61200b8aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6128005f70 tx=0x7f6128009660 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:53.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:53.909+0000 7f6138c00640 1 -- 172.21.15.84:0/3476021744 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f612c0ad710 con 0x7f613c0757b0 2024-09-21T02:39:54.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:53 smithi084 ceph-mon[30747]: pgmap v314: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T02:39:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:54.103+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f613c19d840 con 0x7f613c0757b0 2024-09-21T02:39:54.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:53 smithi172 ceph-mon[35067]: pgmap v314: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T02:39:54.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:53 smithi090 ceph-mon[34571]: pgmap v314: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-21T02:39:55.157 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:54 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3476021744' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:39:55.158 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:54 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:39:55.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:54 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3476021744' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:39:55.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:54 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:39:55.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:54 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3476021744' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:39:55.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:54 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T02:39:55.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.903+0000 7f6138c00640 1 -- 172.21.15.84:0/3476021744 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v80) ==== 228+0+0 (secure 0 0 0) 0x7f612c0b1af0 con 0x7f613c0757b0 2024-09-21T02:39:55.907 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' created 2024-09-21T02:39:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f61200b6590 msgr2=0x7f61200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:55.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f61200b6590 0x7f61200b8aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6128005f70 tx=0x7f6128009660 comp rx=0 tx=0).stop 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f613c0757b0 msgr2=0x7f613c19c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f613c0757b0 0x7f613c19c710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f612c00d6d0 tx=0x7f612c00db90 comp rx=0 tx=0).stop 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 shutdown_connections 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f61200b6590 0x7f61200b8aa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f613c1100e0 0x7f613c1a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f613c076100 0x7f613c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 --2- 172.21.15.84:0/3476021744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f613c0757b0 0x7f613c19c710 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f612c00d6d0 tx=0x7f612c00db90 comp rx=0 tx=0).stop 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.912+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 >> 172.21.15.84:0/3476021744 conn(0x7f613c0ff5d0 msgr2=0x7f613c107b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.914+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 shutdown_connections 2024-09-21T02:39:55.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:55.914+0000 7f6143200640 1 -- 172.21.15.84:0/3476021744 wait complete. 2024-09-21T02:39:56.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:55 smithi172 ceph-mon[35067]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:39:56.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:55 smithi172 ceph-mon[35067]: pgmap v316: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-21T02:39:56.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:55 smithi084 ceph-mon[30747]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:39:56.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:55 smithi084 ceph-mon[30747]: pgmap v316: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-21T02:39:56.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:55 smithi090 ceph-mon[34571]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T02:39:56.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:55 smithi090 ceph-mon[34571]: pgmap v316: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-21T02:39:56.782 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T02:39:57.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:56 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:39:57.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:56 smithi084 ceph-mon[30747]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:39:57.175 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:39:57.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:56 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:39:57.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:56 smithi172 ceph-mon[35067]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:39:57.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:56 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T02:39:57.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:56 smithi090 ceph-mon[34571]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T02:39:57.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.820+0000 7fe574000640 1 -- 172.21.15.84:0/402148307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 msgr2=0x7fe56c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:57.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.820+0000 7fe574000640 1 --2- 172.21.15.84:0/402148307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 0x7fe56c1098d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe558009900 tx=0x7fe55802a410 comp rx=0 tx=0).stop 2024-09-21T02:39:57.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.821+0000 7fe574000640 1 -- 172.21.15.84:0/402148307 shutdown_connections 2024-09-21T02:39:57.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.821+0000 7fe574000640 1 --2- 172.21.15.84:0/402148307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe56c109e10 0x7fe56c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:57.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.821+0000 7fe574000640 1 --2- 172.21.15.84:0/402148307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 0x7fe56c1098d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:57.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.821+0000 7fe574000640 1 --2- 172.21.15.84:0/402148307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe56c103b80 0x7fe56c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:57.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.821+0000 7fe574000640 1 -- 172.21.15.84:0/402148307 >> 172.21.15.84:0/402148307 conn(0x7fe56c0ff5d0 msgr2=0x7fe56c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:57.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.821+0000 7fe574000640 1 -- 172.21.15.84:0/402148307 shutdown_connections 2024-09-21T02:39:57.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.821+0000 7fe574000640 1 -- 172.21.15.84:0/402148307 wait complete. 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.822+0000 7fe574000640 1 Processor -- start 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.822+0000 7fe574000640 1 -- start start 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.822+0000 7fe574000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe56c103b80 0x7fe56c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.822+0000 7fe574000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 0x7fe56c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.822+0000 7fe574000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe56c109e10 0x7fe56c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.822+0000 7fe574000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c113c40 con 0x7fe56c1094c0 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.822+0000 7fe574000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c113ac0 con 0x7fe56c103b80 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.822+0000 7fe574000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c113dc0 con 0x7fe56c109e10 2024-09-21T02:39:57.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 0x7fe56c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:57.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 0x7fe56c075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32820/0 (socket says 172.21.15.84:32820) 2024-09-21T02:39:57.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 -- 172.21.15.84:0/1603831647 learned_addr learned my addr 172.21.15.84:0/1603831647 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:39:57.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe571600640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe56c103b80 0x7fe56c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:57.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe572000640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe56c109e10 0x7fe56c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 -- 172.21.15.84:0/1603831647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe56c109e10 msgr2=0x7fe56c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe56c109e10 0x7fe56c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 -- 172.21.15.84:0/1603831647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe56c103b80 msgr2=0x7fe56c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe56c103b80 0x7fe56c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 -- 172.21.15.84:0/1603831647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c1a8870 con 0x7fe56c1094c0 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.823+0000 7fe570c00640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 0x7fe56c075c50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe558004770 tx=0x7fe558003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.824+0000 7fe56a000640 1 -- 172.21.15.84:0/1603831647 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55803f070 con 0x7fe56c1094c0 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.824+0000 7fe56a000640 1 -- 172.21.15.84:0/1603831647 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe558031be0 con 0x7fe56c1094c0 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.824+0000 7fe56a000640 1 -- 172.21.15.84:0/1603831647 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558035030 con 0x7fe56c1094c0 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.824+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c1a8b00 con 0x7fe56c1094c0 2024-09-21T02:39:57.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.824+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c1a8f90 con 0x7fe56c1094c0 2024-09-21T02:39:57.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.825+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56c103f90 con 0x7fe56c1094c0 2024-09-21T02:39:57.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.827+0000 7fe56a000640 1 -- 172.21.15.84:0/1603831647 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe558042070 con 0x7fe56c1094c0 2024-09-21T02:39:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.829+0000 7fe56a000640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5540b6590 0x7fe5540b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:39:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.829+0000 7fe56a000640 1 -- 172.21.15.84:0/1603831647 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8770+0+0 (secure 0 0 0) 0x7fe5581082a0 con 0x7fe56c1094c0 2024-09-21T02:39:57.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.829+0000 7fe571600640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5540b6590 0x7fe5540b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:39:57.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.830+0000 7fe571600640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5540b6590 0x7fe5540b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe56c077160 tx=0x7fe560009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:39:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:57.832+0000 7fe56a000640 1 -- 172.21.15.84:0/1603831647 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5580ce8b0 con 0x7fe56c1094c0 2024-09-21T02:39:58.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.023+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fe56c076a10 con 0x7fe56c1094c0 2024-09-21T02:39:58.169 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:57 smithi090 ceph-mon[34571]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:39:58.169 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:57 smithi090 ceph-mon[34571]: pgmap v319: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T02:39:58.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:57 smithi172 ceph-mon[35067]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:39:58.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:57 smithi172 ceph-mon[35067]: pgmap v319: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T02:39:58.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:57 smithi084 ceph-mon[30747]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T02:39:58.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:57 smithi084 ceph-mon[30747]: pgmap v319: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T02:39:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.922+0000 7fe56a000640 1 -- 172.21.15.84:0/1603831647 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v83) ==== 169+0+0 (secure 0 0 0) 0x7fe56c076a10 con 0x7fe56c1094c0 2024-09-21T02:39:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T02:39:58.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.925+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5540b6590 msgr2=0x7fe5540b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:58.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.925+0000 7fe574000640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5540b6590 0x7fe5540b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe56c077160 tx=0x7fe560009680 comp rx=0 tx=0).stop 2024-09-21T02:39:58.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.925+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 msgr2=0x7fe56c075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:39:58.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.925+0000 7fe574000640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 0x7fe56c075c50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe558004770 tx=0x7fe558003bb0 comp rx=0 tx=0).stop 2024-09-21T02:39:58.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.926+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 shutdown_connections 2024-09-21T02:39:58.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.926+0000 7fe574000640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5540b6590 0x7fe5540b8aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:58.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.926+0000 7fe574000640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe56c109e10 0x7fe56c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:58.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.926+0000 7fe574000640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe56c1094c0 0x7fe56c075c50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:58.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.926+0000 7fe574000640 1 --2- 172.21.15.84:0/1603831647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe56c103b80 0x7fe56c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:39:58.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.926+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 >> 172.21.15.84:0/1603831647 conn(0x7fe56c0ff5d0 msgr2=0x7fe56c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:39:58.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.926+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 shutdown_connections 2024-09-21T02:39:58.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:39:58.926+0000 7fe574000640 1 -- 172.21.15.84:0/1603831647 wait complete. 2024-09-21T02:39:59.182 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:58 smithi090 ceph-mon[34571]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:39:59.182 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:58 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1603831647' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:39:59.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:58 smithi172 ceph-mon[35067]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:39:59.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:58 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1603831647' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:39:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:58 smithi084 ceph-mon[30747]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T02:39:59.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:58 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1603831647' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T02:39:59.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T02:40:00.044 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:00.183 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:59 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1603831647' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:40:00.183 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:59 smithi084 ceph-mon[30747]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T02:40:00.183 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:39:59 smithi084 ceph-mon[30747]: pgmap v322: 129 pgs: 11 creating+peering, 18 unknown, 100 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T02:40:00.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:59 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1603831647' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:40:00.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:59 smithi172 ceph-mon[35067]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T02:40:00.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:39:59 smithi172 ceph-mon[35067]: pgmap v322: 129 pgs: 11 creating+peering, 18 unknown, 100 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T02:40:00.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:59 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1603831647' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T02:40:00.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:59 smithi090 ceph-mon[34571]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T02:40:00.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:39:59 smithi090 ceph-mon[34571]: pgmap v322: 129 pgs: 11 creating+peering, 18 unknown, 100 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 -- 172.21.15.84:0/2306493665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12a410be40 msgr2=0x7f12a4112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 --2- 172.21.15.84:0/2306493665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12a410be40 0x7f12a4112670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f129c009ca0 tx=0x7f129c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 -- 172.21.15.84:0/2306493665 shutdown_connections 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 --2- 172.21.15.84:0/2306493665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a410b4f0 0x7f12a410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 --2- 172.21.15.84:0/2306493665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12a410be40 0x7f12a4112670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 --2- 172.21.15.84:0/2306493665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12a4105bb0 0x7f12a4105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 -- 172.21.15.84:0/2306493665 >> 172.21.15.84:0/2306493665 conn(0x7f12a4101680 msgr2=0x7f12a4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 -- 172.21.15.84:0/2306493665 shutdown_connections 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.732+0000 7f12aa600640 1 -- 172.21.15.84:0/2306493665 wait complete. 2024-09-21T02:40:00.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.733+0000 7f12aa600640 1 Processor -- start 2024-09-21T02:40:00.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.733+0000 7f12aa600640 1 -- start start 2024-09-21T02:40:00.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.733+0000 7f12aa600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a4105bb0 0x7f12a419c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.733+0000 7f12aa600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12a410b4f0 0x7f12a419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f12aa600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12a410be40 0x7f12a41a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f12aa600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4115c40 con 0x7f12a410be40 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f12aa600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4115ac0 con 0x7f12a410b4f0 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f12aa600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12a4115dc0 con 0x7f12a4105bb0 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f129be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12a410b4f0 0x7f12a419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f12a9c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12a410be40 0x7f12a41a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f129be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12a410b4f0 0x7f12a419cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52322/0 (socket says 172.21.15.84:52322) 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f129be00640 1 -- 172.21.15.84:0/1275370735 learned_addr learned my addr 172.21.15.84:0/1275370735 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f12a9200640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a4105bb0 0x7f12a419c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f129be00640 1 -- 172.21.15.84:0/1275370735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a4105bb0 msgr2=0x7f12a419c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f129be00640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a4105bb0 0x7f12a419c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:00.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f129be00640 1 -- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12a410be40 msgr2=0x7f12a41a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:00.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f129be00640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12a410be40 0x7f12a41a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:00.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.734+0000 7f129be00640 1 -- 172.21.15.84:0/1275370735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a41a24e0 con 0x7f12a410b4f0 2024-09-21T02:40:00.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.735+0000 7f129be00640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12a410b4f0 0x7f12a419cb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f128c00e9c0 tx=0x7f128c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:00.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.735+0000 7f12a2000640 1 -- 172.21.15.84:0/1275370735 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c00ccc0 con 0x7f12a410b4f0 2024-09-21T02:40:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.735+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a41a27d0 con 0x7f12a410b4f0 2024-09-21T02:40:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.735+0000 7f12a2000640 1 -- 172.21.15.84:0/1275370735 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f128c0054f0 con 0x7f12a410b4f0 2024-09-21T02:40:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.735+0000 7f12a2000640 1 -- 172.21.15.84:0/1275370735 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128c010430 con 0x7f12a410b4f0 2024-09-21T02:40:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.735+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a41a8f30 con 0x7f12a410b4f0 2024-09-21T02:40:00.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.736+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a4105fc0 con 0x7f12a410b4f0 2024-09-21T02:40:00.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.738+0000 7f12a2000640 1 -- 172.21.15.84:0/1275370735 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f128c0046c0 con 0x7f12a410b4f0 2024-09-21T02:40:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.740+0000 7f12a2000640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12880b6590 0x7f12880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.740+0000 7f12a2000640 1 -- 172.21.15.84:0/1275370735 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8770+0+0 (secure 0 0 0) 0x7f128c0e7b60 con 0x7f12a410b4f0 2024-09-21T02:40:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.740+0000 7f12a9200640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12880b6590 0x7f12880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.741+0000 7f12a9200640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12880b6590 0x7f12880b8aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1294009bd0 tx=0x7f1294005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.741+0000 7f12a2000640 1 -- 172.21.15.84:0/1275370735 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f128c0ae170 con 0x7f12a410b4f0 2024-09-21T02:40:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:00.968+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f12a419d6a0 con 0x7f12a410b4f0 2024-09-21T02:40:01.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:00 smithi172 ceph-mon[35067]: overall HEALTH_OK 2024-09-21T02:40:01.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:00 smithi084 ceph-mon[30747]: overall HEALTH_OK 2024-09-21T02:40:01.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:00 smithi090 ceph-mon[34571]: overall HEALTH_OK 2024-09-21T02:40:01.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.945+0000 7f12a2000640 1 -- 172.21.15.84:0/1275370735 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f12a419d6a0 con 0x7f12a410b4f0 2024-09-21T02:40:01.947 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 4 to fsmap 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12880b6590 msgr2=0x7f12880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12880b6590 0x7f12880b8aa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1294009bd0 tx=0x7f1294005f90 comp rx=0 tx=0).stop 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12a410b4f0 msgr2=0x7f12a419cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12a410b4f0 0x7f12a419cb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f128c00e9c0 tx=0x7f128c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 shutdown_connections 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12a410be40 0x7f12a41a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12a410b4f0 0x7f12a419cb10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12880b6590 0x7f12880b8aa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:01.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 --2- 172.21.15.84:0/1275370735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a4105bb0 0x7f12a419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:01.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.948+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 >> 172.21.15.84:0/1275370735 conn(0x7f12a4101680 msgr2=0x7f12a410aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:01.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.949+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 shutdown_connections 2024-09-21T02:40:01.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:01.949+0000 7f12aa600640 1 -- 172.21.15.84:0/1275370735 wait complete. 2024-09-21T02:40:02.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:01 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1275370735' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:40:02.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:01 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:40:02.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:01 smithi172 ceph-mon[35067]: pgmap v323: 129 pgs: 8 creating+peering, 121 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:02.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:01 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1275370735' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:40:02.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:01 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:40:02.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:01 smithi084 ceph-mon[30747]: pgmap v323: 129 pgs: 8 creating+peering, 121 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:02.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:01 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1275370735' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:40:02.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:01 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T02:40:02.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:01 smithi090 ceph-mon[34571]: pgmap v323: 129 pgs: 8 creating+peering, 121 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:02.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:40:03.203 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:02 smithi172 ceph-mon[35067]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T02:40:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:02 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:40:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:02 smithi172 ceph-mon[35067]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:03.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:02 smithi084 ceph-mon[30747]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T02:40:03.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:02 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:40:03.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:02 smithi084 ceph-mon[30747]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:03.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:02 smithi090 ceph-mon[34571]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T02:40:03.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:02 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T02:40:03.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:02 smithi090 ceph-mon[34571]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.875+0000 7fddb6a00640 1 -- 172.21.15.84:0/2408457681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010b500 msgr2=0x7fddb010b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.875+0000 7fddb6a00640 1 --2- 172.21.15.84:0/2408457681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010b500 0x7fddb010b910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009900 tx=0x7fdd9c02a410 comp rx=0 tx=0).stop 2024-09-21T02:40:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.875+0000 7fddb6a00640 1 -- 172.21.15.84:0/2408457681 shutdown_connections 2024-09-21T02:40:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.876+0000 7fddb6a00640 1 --2- 172.21.15.84:0/2408457681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddb010be50 0x7fddb0112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:03.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.876+0000 7fddb6a00640 1 --2- 172.21.15.84:0/2408457681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010b500 0x7fddb010b910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.876+0000 7fddb6a00640 1 --2- 172.21.15.84:0/2408457681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddb0105bc0 0x7fddb0105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.876+0000 7fddb6a00640 1 -- 172.21.15.84:0/2408457681 >> 172.21.15.84:0/2408457681 conn(0x7fddb0101670 msgr2=0x7fddb0103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.876+0000 7fddb6a00640 1 -- 172.21.15.84:0/2408457681 shutdown_connections 2024-09-21T02:40:03.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.876+0000 7fddb6a00640 1 -- 172.21.15.84:0/2408457681 wait complete. 2024-09-21T02:40:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6a00640 1 Processor -- start 2024-09-21T02:40:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6a00640 1 -- start start 2024-09-21T02:40:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddb0105bc0 0x7fddb019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddb010b500 0x7fddb019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010be50 0x7fddb01a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fddb0115c30 con 0x7fddb010be50 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fddb0115ab0 con 0x7fddb0105bc0 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddb0115db0 con 0x7fddb010b500 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.877+0000 7fddb6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010be50 0x7fddb01a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010be50 0x7fddb01a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55670/0 (socket says 172.21.15.84:55670) 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb6000640 1 -- 172.21.15.84:0/579927776 learned_addr learned my addr 172.21.15.84:0/579927776 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb4c00640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddb010b500 0x7fddb019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb5600640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddb0105bc0 0x7fddb019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb6000640 1 -- 172.21.15.84:0/579927776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddb010b500 msgr2=0x7fddb019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb6000640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddb010b500 0x7fddb019cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb6000640 1 -- 172.21.15.84:0/579927776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddb0105bc0 msgr2=0x7fddb019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb6000640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddb0105bc0 0x7fddb019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb6000640 1 -- 172.21.15.84:0/579927776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb01a2550 con 0x7fddb010be50 2024-09-21T02:40:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.878+0000 7fddb6000640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010be50 0x7fddb01a1e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdda800eb10 tx=0x7fdda800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.879+0000 7fddae000640 1 -- 172.21.15.84:0/579927776 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8004b20 con 0x7fddb010be50 2024-09-21T02:40:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.879+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb01a2840 con 0x7fddb010be50 2024-09-21T02:40:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.879+0000 7fddae000640 1 -- 172.21.15.84:0/579927776 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdda8004cc0 con 0x7fddb010be50 2024-09-21T02:40:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.879+0000 7fddae000640 1 -- 172.21.15.84:0/579927776 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda8010720 con 0x7fddb010be50 2024-09-21T02:40:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.879+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb01a8fa0 con 0x7fddb010be50 2024-09-21T02:40:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.880+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb0105fd0 con 0x7fddb010be50 2024-09-21T02:40:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.882+0000 7fddae000640 1 -- 172.21.15.84:0/579927776 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdda80108c0 con 0x7fddb010be50 2024-09-21T02:40:03.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.884+0000 7fddae000640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd980b6510 0x7fdd980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:03.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.884+0000 7fddae000640 1 -- 172.21.15.84:0/579927776 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fdda80e7cc0 con 0x7fddb010be50 2024-09-21T02:40:03.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.884+0000 7fddb5600640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd980b6510 0x7fdd980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:03.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.884+0000 7fddb5600640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd980b6510 0x7fdd980b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009bd0 tx=0x7fdda4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:03.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:03.886+0000 7fddae000640 1 -- 172.21.15.84:0/579927776 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdda8056710 con 0x7fddb010be50 2024-09-21T02:40:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:03 smithi084 ceph-mon[30747]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:04.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.113+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddb019d710 con 0x7fddb010be50 2024-09-21T02:40:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.115+0000 7fddae000640 1 -- 172.21.15.84:0/579927776 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11836 (secure 0 0 0) 0x7fddb019d710 con 0x7fddb010be50 2024-09-21T02:40:04.116 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:04.116 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"btime":"2024-09-21T02:40:01:932292+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24647,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24673,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24703,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:40:00.971666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:40:04.116 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-09-21T02:40:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd980b6510 msgr2=0x7fdd980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd980b6510 0x7fdd980b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009bd0 tx=0x7fdda4005f90 comp rx=0 tx=0).stop 2024-09-21T02:40:04.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010be50 msgr2=0x7fddb01a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010be50 0x7fddb01a1e20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdda800eb10 tx=0x7fdda800c2d0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 shutdown_connections 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd980b6510 0x7fdd980b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddb010b500 0x7fddb019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddb010be50 0x7fddb01a1e20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 --2- 172.21.15.84:0/579927776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddb0105bc0 0x7fddb019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 >> 172.21.15.84:0/579927776 conn(0x7fddb0101670 msgr2=0x7fddb0108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 shutdown_connections 2024-09-21T02:40:04.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:04.117+0000 7fddb6a00640 1 -- 172.21.15.84:0/579927776 wait complete. 2024-09-21T02:40:04.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:03 smithi172 ceph-mon[35067]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:04.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:03 smithi090 ceph-mon[34571]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:04.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:40:05.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:04 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/579927776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:05.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:04 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/579927776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:05.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:04 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/579927776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:05.287 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 -- 172.21.15.84:0/3656107981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef0810b500 msgr2=0x7fef0810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 --2- 172.21.15.84:0/3656107981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef0810b500 0x7fef0810b910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7feef0009900 tx=0x7feef002a410 comp rx=0 tx=0).stop 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 -- 172.21.15.84:0/3656107981 shutdown_connections 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 --2- 172.21.15.84:0/3656107981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef0810be50 0x7fef08112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 --2- 172.21.15.84:0/3656107981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef0810b500 0x7fef0810b910 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 --2- 172.21.15.84:0/3656107981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef08105bc0 0x7fef08105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 -- 172.21.15.84:0/3656107981 >> 172.21.15.84:0/3656107981 conn(0x7fef08101670 msgr2=0x7fef08103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 -- 172.21.15.84:0/3656107981 shutdown_connections 2024-09-21T02:40:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.918+0000 7fef0cc00640 1 -- 172.21.15.84:0/3656107981 wait complete. 2024-09-21T02:40:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.919+0000 7fef0cc00640 1 Processor -- start 2024-09-21T02:40:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef0cc00640 1 -- start start 2024-09-21T02:40:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef0cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08105bc0 0x7fef0819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef0cc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef0810b500 0x7fef0819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:05.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef0cc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef0810be50 0x7fef081a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef0cc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fef08115c80 con 0x7fef08105bc0 2024-09-21T02:40:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef0cc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fef08115b00 con 0x7fef0810be50 2024-09-21T02:40:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef0cc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fef08115e00 con 0x7fef0810b500 2024-09-21T02:40:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef07400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08105bc0 0x7fef0819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef07400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08105bc0 0x7fef0819c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55684/0 (socket says 172.21.15.84:55684) 2024-09-21T02:40:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef07400640 1 -- 172.21.15.84:0/1260325357 learned_addr learned my addr 172.21.15.84:0/1260325357 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7feefea00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef0810b500 0x7fef0819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.920+0000 7fef07e00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef0810be50 0x7fef081a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef07400640 1 -- 172.21.15.84:0/1260325357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef0810b500 msgr2=0x7fef0819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef07400640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef0810b500 0x7fef0819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef07400640 1 -- 172.21.15.84:0/1260325357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef0810be50 msgr2=0x7fef081a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef07400640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef0810be50 0x7fef081a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef07400640 1 -- 172.21.15.84:0/1260325357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef081a2560 con 0x7fef08105bc0 2024-09-21T02:40:05.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef07400640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08105bc0 0x7fef0819c5f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feef800e9f0 tx=0x7feef800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef04c00640 1 -- 172.21.15.84:0/1260325357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef800cd80 con 0x7fef08105bc0 2024-09-21T02:40:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef04c00640 1 -- 172.21.15.84:0/1260325357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feef8010900 con 0x7fef08105bc0 2024-09-21T02:40:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef04c00640 1 -- 172.21.15.84:0/1260325357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8018920 con 0x7fef08105bc0 2024-09-21T02:40:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.921+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef081a2850 con 0x7fef08105bc0 2024-09-21T02:40:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.922+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef081a8fb0 con 0x7fef08105bc0 2024-09-21T02:40:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.923+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef08106e40 con 0x7fef08105bc0 2024-09-21T02:40:05.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.925+0000 7fef04c00640 1 -- 172.21.15.84:0/1260325357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7feef8010ab0 con 0x7fef08105bc0 2024-09-21T02:40:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.927+0000 7fef04c00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feeec0b6590 0x7feeec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.927+0000 7fef04c00640 1 -- 172.21.15.84:0/1260325357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7feef80e7d40 con 0x7fef08105bc0 2024-09-21T02:40:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.927+0000 7feefea00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feeec0b6590 0x7feeec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.928+0000 7feefea00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feeec0b6590 0x7feeec0b8aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feef002aa00 tx=0x7feef0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:05.929+0000 7fef04c00640 1 -- 172.21.15.84:0/1260325357 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feef80b2710 con 0x7fef08105bc0 2024-09-21T02:40:06.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:05 smithi084 ceph-mon[30747]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:06.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.124+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef08105fd0 con 0x7fef08105bc0 2024-09-21T02:40:06.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.125+0000 7fef04c00640 1 -- 172.21.15.84:0/1260325357 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24200 (secure 0 0 0) 0x7feef80b7650 con 0x7fef08105bc0 2024-09-21T02:40:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:06.127 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:40:00.971518+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:40:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feeec0b6590 msgr2=0x7feeec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feeec0b6590 0x7feeec0b8aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feef002aa00 tx=0x7feef0000bc0 comp rx=0 tx=0).stop 2024-09-21T02:40:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08105bc0 msgr2=0x7fef0819c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08105bc0 0x7fef0819c5f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feef800e9f0 tx=0x7feef800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:40:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 shutdown_connections 2024-09-21T02:40:06.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feeec0b6590 0x7feeec0b8aa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef0810b500 0x7fef0819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef0810be50 0x7fef081a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 --2- 172.21.15.84:0/1260325357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef08105bc0 0x7fef0819c5f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 >> 172.21.15.84:0/1260325357 conn(0x7fef08101670 msgr2=0x7fef08108ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 shutdown_connections 2024-09-21T02:40:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:06.128+0000 7fef0cc00640 1 -- 172.21.15.84:0/1260325357 wait complete. 2024-09-21T02:40:06.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:05 smithi172 ceph-mon[35067]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:06.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:05 smithi090 ceph-mon[34571]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:06.881 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:40:07.250 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:07.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:06 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1260325357' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:07.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:06 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1260325357' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:07.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:06 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1260325357' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 -- 172.21.15.84:0/2587630113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410b6c0 msgr2=0x7f529410bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 --2- 172.21.15.84:0/2587630113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410b6c0 0x7f529410bad0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5280009900 tx=0x7f528002a410 comp rx=0 tx=0).stop 2024-09-21T02:40:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 -- 172.21.15.84:0/2587630113 shutdown_connections 2024-09-21T02:40:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 --2- 172.21.15.84:0/2587630113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f529410c010 0x7f5294112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 --2- 172.21.15.84:0/2587630113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410b6c0 0x7f529410bad0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 --2- 172.21.15.84:0/2587630113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5294105d80 0x7f5294106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 -- 172.21.15.84:0/2587630113 >> 172.21.15.84:0/2587630113 conn(0x7f5294101810 msgr2=0x7f5294103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:07.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 -- 172.21.15.84:0/2587630113 shutdown_connections 2024-09-21T02:40:07.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.913+0000 7f529c000640 1 -- 172.21.15.84:0/2587630113 wait complete. 2024-09-21T02:40:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.914+0000 7f529c000640 1 Processor -- start 2024-09-21T02:40:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529c000640 1 -- start start 2024-09-21T02:40:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529c000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5294105d80 0x7f529419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529c000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f529410b6c0 0x7f529419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529c000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410c010 0x7f52941a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529c000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5294115df0 con 0x7f529410c010 2024-09-21T02:40:07.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529c000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5294115c70 con 0x7f5294105d80 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529c000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5294115f70 con 0x7f529410b6c0 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410c010 0x7f52941a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f5299600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5294105d80 0x7f529419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410c010 0x7f52941a2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55706/0 (socket says 172.21.15.84:55706) 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f529a000640 1 -- 172.21.15.84:0/2186521909 learned_addr learned my addr 172.21.15.84:0/2186521909 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.915+0000 7f5298c00640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f529410b6c0 0x7f529419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f5299600640 1 -- 172.21.15.84:0/2186521909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f529410b6c0 msgr2=0x7f529419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f5299600640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f529410b6c0 0x7f529419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f5299600640 1 -- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410c010 msgr2=0x7f52941a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f5299600640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410c010 0x7f52941a2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f5299600640 1 -- 172.21.15.84:0/2186521909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52941a2790 con 0x7f5294105d80 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f529a000640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410c010 0x7f52941a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:07.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f5298c00640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f529410b6c0 0x7f529419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f5299600640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5294105d80 0x7f529419c820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f528800e9f0 tx=0x7f528800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.916+0000 7f5292000640 1 -- 172.21.15.84:0/2186521909 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528800ccc0 con 0x7f5294105d80 2024-09-21T02:40:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.917+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52941a2a80 con 0x7f5294105d80 2024-09-21T02:40:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.917+0000 7f5292000640 1 -- 172.21.15.84:0/2186521909 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5288005020 con 0x7f5294105d80 2024-09-21T02:40:07.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.917+0000 7f5292000640 1 -- 172.21.15.84:0/2186521909 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52880049c0 con 0x7f5294105d80 2024-09-21T02:40:07.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.917+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941a91e0 con 0x7f5294105d80 2024-09-21T02:40:07.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.918+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5294106190 con 0x7f5294105d80 2024-09-21T02:40:07.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.921+0000 7f5292000640 1 -- 172.21.15.84:0/2186521909 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f52880051d0 con 0x7f5294105d80 2024-09-21T02:40:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.922+0000 7f5292000640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f527c0b6510 0x7f527c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.922+0000 7f5292000640 1 -- 172.21.15.84:0/2186521909 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f52880e7560 con 0x7f5294105d80 2024-09-21T02:40:07.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.922+0000 7f5298c00640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f527c0b6510 0x7f527c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:07.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.923+0000 7f5298c00640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f527c0b6510 0x7f527c0b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5280005940 tx=0x7f52800058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:07.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:07.924+0000 7f5292000640 1 -- 172.21.15.84:0/2186521909 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52880adc40 con 0x7f5294105d80 2024-09-21T02:40:08.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:07 smithi084 ceph-mon[30747]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:08.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.114+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f529419d950 con 0x7f5294105d80 2024-09-21T02:40:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.116+0000 7f5292000640 1 -- 172.21.15.84:0/2186521909 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24200 (secure 0 0 0) 0x7f52880b4070 con 0x7f5294105d80 2024-09-21T02:40:08.118 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:08.118 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:40:00.971518+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:40:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f527c0b6510 msgr2=0x7f527c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f527c0b6510 0x7f527c0b8a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5280005940 tx=0x7f52800058d0 comp rx=0 tx=0).stop 2024-09-21T02:40:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5294105d80 msgr2=0x7f529419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5294105d80 0x7f529419c820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f528800e9f0 tx=0x7f528800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:40:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 shutdown_connections 2024-09-21T02:40:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f527c0b6510 0x7f527c0b8a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f529410b6c0 0x7f529419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f529410c010 0x7f52941a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 --2- 172.21.15.84:0/2186521909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5294105d80 0x7f529419c820 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 >> 172.21.15.84:0/2186521909 conn(0x7f5294101810 msgr2=0x7f529410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 shutdown_connections 2024-09-21T02:40:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:08.119+0000 7f529c000640 1 -- 172.21.15.84:0/2186521909 wait complete. 2024-09-21T02:40:08.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:07 smithi172 ceph-mon[35067]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:08.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:07 smithi090 ceph-mon[34571]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:08.950 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:40:09.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:08 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2186521909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:09.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:08 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2186521909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:09.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:08 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2186521909' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:09.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 -- 172.21.15.84:0/2790938129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3370103b70 msgr2=0x7f3370103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:09.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 --2- 172.21.15.84:0/2790938129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3370103b70 0x7f3370103f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3360009900 tx=0x7f336002a410 comp rx=0 tx=0).stop 2024-09-21T02:40:09.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 -- 172.21.15.84:0/2790938129 shutdown_connections 2024-09-21T02:40:09.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 --2- 172.21.15.84:0/2790938129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33701094b0 0x7f33701098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 --2- 172.21.15.84:0/2790938129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370109e00 0x7f3370110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 --2- 172.21.15.84:0/2790938129 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3370103b70 0x7f3370103f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 -- 172.21.15.84:0/2790938129 >> 172.21.15.84:0/2790938129 conn(0x7f33700ff5e0 msgr2=0x7f3370101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 -- 172.21.15.84:0/2790938129 shutdown_connections 2024-09-21T02:40:09.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.970+0000 7f3376e00640 1 -- 172.21.15.84:0/2790938129 wait complete. 2024-09-21T02:40:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.971+0000 7f3376e00640 1 Processor -- start 2024-09-21T02:40:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f3376e00640 1 -- start start 2024-09-21T02:40:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f3376e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3370103b70 0x7f337019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f3376e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33701094b0 0x7f337019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f3376e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370109e00 0x7f33701a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f3376e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3370113c50 con 0x7f3370109e00 2024-09-21T02:40:09.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f3376e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3370113ad0 con 0x7f33701094b0 2024-09-21T02:40:09.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f3376e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3370113dd0 con 0x7f3370103b70 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f336fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3370103b70 0x7f337019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f336f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33701094b0 0x7f337019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.972+0000 7f3374e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370109e00 0x7f33701a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33701094b0 0x7f337019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52386/0 (socket says 172.21.15.84:52386) 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3370103b70 0x7f337019c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:48390/0 (socket says 172.21.15.84:48390) 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336f400640 1 -- 172.21.15.84:0/2528268268 learned_addr learned my addr 172.21.15.84:0/2528268268 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336f400640 1 -- 172.21.15.84:0/2528268268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3370103b70 msgr2=0x7f337019c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336f400640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3370103b70 0x7f337019c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336f400640 1 -- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370109e00 msgr2=0x7f33701a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336f400640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370109e00 0x7f33701a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336f400640 1 -- 172.21.15.84:0/2528268268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33701a2730 con 0x7f33701094b0 2024-09-21T02:40:09.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336f400640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33701094b0 0x7f337019cd60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e9c0 tx=0x7f335c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336cc00640 1 -- 172.21.15.84:0/2528268268 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c00ccc0 con 0x7f33701094b0 2024-09-21T02:40:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.973+0000 7f336cc00640 1 -- 172.21.15.84:0/2528268268 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f335c0054f0 con 0x7f33701094b0 2024-09-21T02:40:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.974+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33701a2a20 con 0x7f33701094b0 2024-09-21T02:40:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.974+0000 7f336cc00640 1 -- 172.21.15.84:0/2528268268 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c010430 con 0x7f33701094b0 2024-09-21T02:40:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.974+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33701a9180 con 0x7f33701094b0 2024-09-21T02:40:09.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.975+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3370103f80 con 0x7f33701094b0 2024-09-21T02:40:09.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.977+0000 7f336cc00640 1 -- 172.21.15.84:0/2528268268 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f335c0046c0 con 0x7f33701094b0 2024-09-21T02:40:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.979+0000 7f336cc00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f33540b6590 0x7f33540b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.979+0000 7f336fe00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f33540b6590 0x7f33540b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.979+0000 7f336cc00640 1 -- 172.21.15.84:0/2528268268 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f335c0e7880 con 0x7f33701094b0 2024-09-21T02:40:09.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.980+0000 7f336fe00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f33540b6590 0x7f33540b8aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3360006010 tx=0x7f3360000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:09.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:09.983+0000 7f336cc00640 1 -- 172.21.15.84:0/2528268268 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f335c0ade70 con 0x7f33701094b0 2024-09-21T02:40:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.205+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33701a94c0 con 0x7f33701094b0 2024-09-21T02:40:10.206 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:09 smithi084 ceph-mon[30747]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.206+0000 7f336cc00640 1 -- 172.21.15.84:0/2528268268 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11836 (secure 0 0 0) 0x7f335c0b2250 con 0x7f33701094b0 2024-09-21T02:40:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:10.208 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"btime":"2024-09-21T02:40:01:932292+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24647,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24668,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24673,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24703,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:40:00.971666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24704,"qdb_cluster":[24704]},"id":1}]} 2024-09-21T02:40:10.208 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2024-09-21T02:40:10.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.208+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f33540b6590 msgr2=0x7f33540b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:10.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.208+0000 7f3376e00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f33540b6590 0x7f33540b8aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3360006010 tx=0x7f3360000bc0 comp rx=0 tx=0).stop 2024-09-21T02:40:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.208+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33701094b0 msgr2=0x7f337019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.208+0000 7f3376e00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33701094b0 0x7f337019cd60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e9c0 tx=0x7f335c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:40:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.209+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 shutdown_connections 2024-09-21T02:40:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.209+0000 7f3376e00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3370109e00 0x7f33701a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.209+0000 7f3376e00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33701094b0 0x7f337019cd60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.209+0000 7f3376e00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f33540b6590 0x7f33540b8aa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.209+0000 7f3376e00640 1 --2- 172.21.15.84:0/2528268268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3370103b70 0x7f337019c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.209+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 >> 172.21.15.84:0/2528268268 conn(0x7f33700ff5e0 msgr2=0x7f3370108ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.209+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 shutdown_connections 2024-09-21T02:40:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:10.209+0000 7f3376e00640 1 -- 172.21.15.84:0/2528268268 wait complete. 2024-09-21T02:40:10.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:09 smithi172 ceph-mon[35067]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:10.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:09 smithi090 ceph-mon[34571]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:11.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:40:11.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:10 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2528268268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:11.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:10 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2528268268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:11.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:10 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2528268268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 -- 172.21.15.84:0/461735078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88109c40 msgr2=0x7fde88110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 --2- 172.21.15.84:0/461735078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88109c40 0x7fde88110470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fde80009ca0 tx=0x7fde8002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 -- 172.21.15.84:0/461735078 shutdown_connections 2024-09-21T02:40:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 --2- 172.21.15.84:0/461735078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde88109c40 0x7fde88110470 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 --2- 172.21.15.84:0/461735078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde881092f0 0x7fde88109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 --2- 172.21.15.84:0/461735078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde881039b0 0x7fde88103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 -- 172.21.15.84:0/461735078 >> 172.21.15.84:0/461735078 conn(0x7fde880ff400 msgr2=0x7fde88101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:12.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 -- 172.21.15.84:0/461735078 shutdown_connections 2024-09-21T02:40:12.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.053+0000 7fde87e00640 1 -- 172.21.15.84:0/461735078 wait complete. 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.054+0000 7fde87e00640 1 Processor -- start 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde87e00640 1 -- start start 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde87e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde881039b0 0x7fde8819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde881092f0 0x7fde8819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde87e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde88109c40 0x7fde8819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde87e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fde88113a20 con 0x7fde881092f0 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde87e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde881138a0 con 0x7fde881039b0 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde87e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde88113ba0 con 0x7fde88109c40 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde86000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde881092f0 0x7fde8819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:12.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde86000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde881092f0 0x7fde8819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47330/0 (socket says 172.21.15.84:47330) 2024-09-21T02:40:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde86000640 1 -- 172.21.15.84:0/836627936 learned_addr learned my addr 172.21.15.84:0/836627936 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.055+0000 7fde86a00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde881039b0 0x7fde8819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde87400640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde88109c40 0x7fde8819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde86000640 1 -- 172.21.15.84:0/836627936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde88109c40 msgr2=0x7fde8819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde86000640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde88109c40 0x7fde8819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde86000640 1 -- 172.21.15.84:0/836627936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde881039b0 msgr2=0x7fde8819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde86000640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde881039b0 0x7fde8819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde86000640 1 -- 172.21.15.84:0/836627936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde881a0340 con 0x7fde881092f0 2024-09-21T02:40:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde86000640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde881092f0 0x7fde8819a970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fde7400e9f0 tx=0x7fde7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde7f400640 1 -- 172.21.15.84:0/836627936 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7400ccc0 con 0x7fde881092f0 2024-09-21T02:40:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde7f400640 1 -- 172.21.15.84:0/836627936 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fde74010900 con 0x7fde881092f0 2024-09-21T02:40:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.056+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde881a0630 con 0x7fde881092f0 2024-09-21T02:40:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.057+0000 7fde7f400640 1 -- 172.21.15.84:0/836627936 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74018900 con 0x7fde881092f0 2024-09-21T02:40:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.057+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881a6d90 con 0x7fde881092f0 2024-09-21T02:40:12.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.058+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde88103dc0 con 0x7fde881092f0 2024-09-21T02:40:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.060+0000 7fde7f400640 1 -- 172.21.15.84:0/836627936 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fde74010ab0 con 0x7fde881092f0 2024-09-21T02:40:12.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.061+0000 7fde7f400640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fde6c0b6590 0x7fde6c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:12.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.062+0000 7fde7f400640 1 -- 172.21.15.84:0/836627936 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fde740e7bf0 con 0x7fde881092f0 2024-09-21T02:40:12.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.062+0000 7fde86a00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fde6c0b6590 0x7fde6c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:12.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.063+0000 7fde86a00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fde6c0b6590 0x7fde6c0b8aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fde78009bd0 tx=0x7fde78005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:12.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.064+0000 7fde7f400640 1 -- 172.21.15.84:0/836627936 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde740b25c0 con 0x7fde881092f0 2024-09-21T02:40:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.252+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde8819b500 con 0x7fde881092f0 2024-09-21T02:40:12.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:11 smithi084 ceph-mon[30747]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.253+0000 7fde7f400640 1 -- 172.21.15.84:0/836627936 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24200 (secure 0 0 0) 0x7fde8819b500 con 0x7fde881092f0 2024-09-21T02:40:12.255 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:40:00.971518+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:40:12.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:11 smithi172 ceph-mon[35067]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fde6c0b6590 msgr2=0x7fde6c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fde6c0b6590 0x7fde6c0b8aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fde78009bd0 tx=0x7fde78005f90 comp rx=0 tx=0).stop 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde881092f0 msgr2=0x7fde8819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde881092f0 0x7fde8819a970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fde7400e9f0 tx=0x7fde7400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 shutdown_connections 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fde6c0b6590 0x7fde6c0b8aa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde88109c40 0x7fde8819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde881092f0 0x7fde8819a970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 --2- 172.21.15.84:0/836627936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde881039b0 0x7fde8819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.256+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 >> 172.21.15.84:0/836627936 conn(0x7fde880ff400 msgr2=0x7fde88106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.257+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 shutdown_connections 2024-09-21T02:40:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:12.257+0000 7fde87e00640 1 -- 172.21.15.84:0/836627936 wait complete. 2024-09-21T02:40:12.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:11 smithi090 ceph-mon[34571]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:13.175 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T02:39:47.859217+0000', 'modified': '2024-09-21T02:40:00.971666+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6839/3427873852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6838', 'nonce': 3427873852}, {'type': 'v1', 'addr': '172.21.15.90:6839', 'nonce': 3427873852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24704, 'qdb_cluster': [24704]} 2024-09-21T02:40:13.175 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T02:40:13.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:40:13.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:12 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/836627936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:13.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:12 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/836627936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:13.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:12 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/836627936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:13.543 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 -- 172.21.15.84:0/2789936954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 msgr2=0x7f28d8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 --2- 172.21.15.84:0/2789936954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 0x7f28d8103f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009900 tx=0x7f28c802a410 comp rx=0 tx=0).stop 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 -- 172.21.15.84:0/2789936954 shutdown_connections 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 --2- 172.21.15.84:0/2789936954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d81094a0 0x7f28d81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 --2- 172.21.15.84:0/2789936954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28d8109df0 0x7f28d8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 --2- 172.21.15.84:0/2789936954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 0x7f28d8103f70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 -- 172.21.15.84:0/2789936954 >> 172.21.15.84:0/2789936954 conn(0x7f28d807b850 msgr2=0x7f28d807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 -- 172.21.15.84:0/2789936954 shutdown_connections 2024-09-21T02:40:14.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.205+0000 7f28de200640 1 -- 172.21.15.84:0/2789936954 wait complete. 2024-09-21T02:40:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28de200640 1 Processor -- start 2024-09-21T02:40:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28de200640 1 -- start start 2024-09-21T02:40:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28de200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 0x7f28d819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28de200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28d81094a0 0x7f28d819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28de200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d8109df0 0x7f28d819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28de200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f28d8113c20 con 0x7f28d8103b60 2024-09-21T02:40:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28de200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28d8113aa0 con 0x7f28d81094a0 2024-09-21T02:40:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28de200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28d8113da0 con 0x7f28d8109df0 2024-09-21T02:40:14.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 0x7f28d819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 0x7f28d819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47340/0 (socket says 172.21.15.84:47340) 2024-09-21T02:40:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.207+0000 7f28d7400640 1 -- 172.21.15.84:0/1496623804 learned_addr learned my addr 172.21.15.84:0/1496623804 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d6a00640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28d81094a0 0x7f28d819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d7e00640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d8109df0 0x7f28d819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d7400640 1 -- 172.21.15.84:0/1496623804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d8109df0 msgr2=0x7f28d819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d7400640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d8109df0 0x7f28d819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d7400640 1 -- 172.21.15.84:0/1496623804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28d81094a0 msgr2=0x7f28d819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d7400640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28d81094a0 0x7f28d819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d7400640 1 -- 172.21.15.84:0/1496623804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d81a0500 con 0x7f28d8103b60 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d6a00640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28d81094a0 0x7f28d819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.208+0000 7f28d7400640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 0x7f28d819a590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28c80314b0 tx=0x7f28c8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.209+0000 7f28cfe00640 1 -- 172.21.15.84:0/1496623804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c803f070 con 0x7f28d8103b60 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.209+0000 7f28de200640 1 -- 172.21.15.84:0/1496623804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d81a0790 con 0x7f28d8103b60 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.209+0000 7f28cfe00640 1 -- 172.21.15.84:0/1496623804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28c8031bf0 con 0x7f28d8103b60 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.209+0000 7f28cfe00640 1 -- 172.21.15.84:0/1496623804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8035030 con 0x7f28d8103b60 2024-09-21T02:40:14.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.209+0000 7f28de200640 1 -- 172.21.15.84:0/1496623804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d80755f0 con 0x7f28d8103b60 2024-09-21T02:40:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.212+0000 7f28e4ecc740 1 Processor -- start 2024-09-21T02:40:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.212+0000 7f28e4ecc740 1 -- start start 2024-09-21T02:40:14.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.212+0000 7f28cfe00640 1 -- 172.21.15.84:0/1496623804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f28c8042070 con 0x7f28d8103b60 2024-09-21T02:40:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff7ff60 0x562d50326490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d503269d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff5f280 0x562d50326f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d5029dd50 con 0x562d4ff7ff60 2024-09-21T02:40:14.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562d5028d180 con 0x562d4ff570a0 2024-09-21T02:40:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d50290f90 con 0x562d4ff5f280 2024-09-21T02:40:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28d7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff7ff60 0x562d50326490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28d7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d503269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28d7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff7ff60 0x562d50326490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47344/0 (socket says 172.21.15.84:47344) 2024-09-21T02:40:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28d7e00640 1 -- 172.21.15.84:0/3850922363 learned_addr learned my addr 172.21.15.84:0/3850922363 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:14.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.213+0000 7f28d6a00640 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff5f280 0x562d50326f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28d7400640 1 -- 172.21.15.84:0/3850922363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff5f280 msgr2=0x562d50326f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28d7400640 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff5f280 0x562d50326f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28d7400640 1 -- 172.21.15.84:0/3850922363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff7ff60 msgr2=0x562d50326490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28d7400640 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff7ff60 0x562d50326490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28d7400640 1 -- 172.21.15.84:0/3850922363 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d50257a70 con 0x562d4ff570a0 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28d7e00640 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff7ff60 0x562d50326490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28d7400640 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d503269d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f28c8105460 tx=0x7f28c810be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22058c302c57bc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28c3e00640 1 -- 172.21.15.84:0/3850922363 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8117070 con 0x562d4ff570a0 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28cfe00640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f28bc0b6590 0x7f28bc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28c3e00640 1 -- 172.21.15.84:0/3850922363 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28c80cd710 con 0x562d4ff570a0 2024-09-21T02:40:14.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.214+0000 7f28c3e00640 1 -- 172.21.15.84:0/3850922363 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c80cd370 con 0x562d4ff570a0 2024-09-21T02:40:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28cfe00640 1 -- 172.21.15.84:0/1496623804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f28c8107c60 con 0x7f28d8103b60 2024-09-21T02:40:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28d7e00640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f28bc0b6590 0x7f28bc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28e4ecc740 1 -- 172.21.15.84:0/3850922363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 msgr2=0x562d503269d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28d7e00640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f28bc0b6590 0x7f28bc0b8aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009fd0 tx=0x7f28d0012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d503269d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f28c8105460 tx=0x7f28c810be20 comp rx=0 tx=0).stop 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28e4ecc740 1 -- 172.21.15.84:0/3850922363 shutdown_connections 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff5f280 0x562d50326f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d503269d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/3850922363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff7ff60 0x562d50326490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.215+0000 7f28e4ecc740 1 -- 172.21.15.84:0/3850922363 >> 172.21.15.84:0/3850922363 conn(0x562d4ff74350 msgr2=0x562d50324380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.216+0000 7f28e4ecc740 1 -- 172.21.15.84:0/3850922363 shutdown_connections 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.216+0000 7f28e4ecc740 1 -- 172.21.15.84:0/3850922363 wait complete. 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.216+0000 7f28e4ecc740 1 -- start start 2024-09-21T02:40:14.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.216+0000 7f28e4ecc740 1 Processor -- start 2024-09-21T02:40:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d50332060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff5f280 0x562d503325a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff7ff60 0x562d5033dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d500ee5f0 con 0x562d4ff5f280 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562d50228460 con 0x562d4ff570a0 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d50334a30 con 0x562d4ff7ff60 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28e4ecc740 10 client.0 _ll_register_callbacks cb 0x562d50238210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff5f280 0x562d503325a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff5f280 0x562d503325a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47346/0 (socket says 172.21.15.84:47346) 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28d6a00640 1 -- 172.21.15.84:0/2714847097 learned_addr learned my addr 172.21.15.84:0/2714847097 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28d7400640 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d50332060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.217+0000 7f28d7e00640 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff7ff60 0x562d5033dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28d6a00640 1 -- 172.21.15.84:0/2714847097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff7ff60 msgr2=0x562d5033dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28d6a00640 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff7ff60 0x562d5033dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28d6a00640 1 -- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 msgr2=0x562d50332060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28d6a00640 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d50332060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28d6a00640 1 -- 172.21.15.84:0/2714847097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d4ffeb540 con 0x562d4ff5f280 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28d7400640 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d50332060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28d6a00640 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff5f280 0x562d503325a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28c4011730 tx=0x7f28c4011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7935be1189cfb76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28c0c00640 1 -- 172.21.15.84:0/2714847097 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c4010c60 con 0x562d4ff5f280 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28c0c00640 1 -- 172.21.15.84:0/2714847097 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f28c4010e00 con 0x562d4ff5f280 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.218+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2714847097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d5022aa70 con 0x562d4ff5f280 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28c0c00640 1 -- 172.21.15.84:0/2714847097 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f28c4025050 con 0x562d4ff5f280 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28e4ecc740 10 client.14793 fetch_fsmap learned FSMap version 17 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2714847097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x562d502456f0 con 0x562d4ff5f280 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28c0c00640 1 -- 172.21.15.84:0/2714847097 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x562d5022aa70 con 0x562d4ff5f280 2024-09-21T02:40:14.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28c0c00640 1 -- 172.21.15.84:0/2714847097 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f28c400f580 con 0x562d4ff5f280 2024-09-21T02:40:14.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28e4ecc740 10 client.14793 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T02:40:14.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28e4ecc740 10 client.14793 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:40:14.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28e4ecc740 20 client.14793 populate_metadata read hostname 'smithi084' 2024-09-21T02:40:14.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562d4ff3e8e0 0x562d50344210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28e4ecc740 4 client.14793 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:40:14.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.219+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2714847097 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d5029fca0 con 0x562d4ff3e8e0 2024-09-21T02:40:14.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.220+0000 7f28d7400640 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562d4ff3e8e0 0x562d50344210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.220+0000 7f28d7400640 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562d4ff3e8e0 0x562d50344210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa50495470bf42d2 server_cookie=1682dcfe78ea75cf in_seq=0 out_seq=0 2024-09-21T02:40:14.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.220+0000 7f28c0c00640 10 client.14793 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:40:14.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.221+0000 7f28c0c00640 1 -- 172.21.15.84:0/2714847097 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d5029fca0 con 0x562d4ff3e8e0 2024-09-21T02:40:14.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.221+0000 7f28c0c00640 10 client.14793 handle_command_reply: tid=0 2024-09-21T02:40:14.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.221+0000 7f28e4ecc740 1 client.14793 shutdown 2024-09-21T02:40:14.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.221+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2714847097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff5f280 msgr2=0x562d503325a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.221+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff5f280 0x562d503325a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28c4011730 tx=0x7f28c4011bf0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2714847097 shutdown_connections 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff7ff60 0x562d5033dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562d4ff3e8e0 0x562d50344210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff5f280 0x562d503325a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28c0c00640 0 client.14793 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2714847097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff570a0 0x562d50332060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2714847097 >> 172.21.15.84:0/2714847097 conn(0x562d4ff74350 msgr2=0x562d50329670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2714847097 shutdown_connections 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2714847097 wait complete. 2024-09-21T02:40:14.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.222+0000 7f28e4ecc740 20 client.14793 trim_cache size 0 max 16384 2024-09-21T02:40:14.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28e4ecc740 1 Processor -- start 2024-09-21T02:40:14.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28e4ecc740 1 -- start start 2024-09-21T02:40:14.242 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:13 smithi084 ceph-mon[30747]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:14.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50332040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50332580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5032cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d50342550 con 0x562d4ff3e8e0 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562d50342c20 con 0x562d4ff5f280 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d503432f0 con 0x562d4ff570a0 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.241+0000 7f28d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50332040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50332040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47348/0 (socket says 172.21.15.84:47348) 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7400640 1 -- 172.21.15.84:0/2439040514 learned_addr learned my addr 172.21.15.84:0/2439040514 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7e00640 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5032cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d6a00640 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50332580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7400640 1 -- 172.21.15.84:0/2439040514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 msgr2=0x562d50332580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7400640 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50332580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7400640 1 -- 172.21.15.84:0/2439040514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 msgr2=0x562d5032cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7400640 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5032cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7400640 1 -- 172.21.15.84:0/2439040514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d50333120 con 0x562d4ff3e8e0 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7e00640 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5032cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:14.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.242+0000 7f28d7400640 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50332040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28c802a9d0 tx=0x7f28c80fe5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71acc9bfc7314e59 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:14.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.243+0000 7f28c3400640 1 -- 172.21.15.84:0/2439040514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8100990 con 0x562d4ff3e8e0 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.243+0000 7f28c3400640 1 -- 172.21.15.84:0/2439040514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28c80cd710 con 0x562d4ff3e8e0 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.243+0000 7f28c3400640 1 -- 172.21.15.84:0/2439040514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8100d10 con 0x562d4ff3e8e0 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2439040514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 msgr2=0x562d50332040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50332040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28c802a9d0 tx=0x7f28c80fe5f0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2439040514 shutdown_connections 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50332580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5032cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2439040514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50332040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2439040514 >> 172.21.15.84:0/2439040514 conn(0x562d4ff74350 msgr2=0x562d50341bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2439040514 shutdown_connections 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2439040514 wait complete. 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.244+0000 7f28e4ecc740 1 -- start start 2024-09-21T02:40:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28e4ecc740 1 Processor -- start 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50345a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50346000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28e4ecc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5034ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d50344090 con 0x562d4ff3e8e0 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562d503439c0 con 0x562d4ff5f280 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28e4ecc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d50344760 con 0x562d4ff570a0 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28e4ecc740 10 client.0 _ll_register_callbacks cb 0x7f28c400bef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50346000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28d7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50345a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28d6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50346000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:48206/0 (socket says 172.21.15.84:48206) 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.245+0000 7f28d6a00640 1 -- 172.21.15.84:0/2348551730 learned_addr learned my addr 172.21.15.84:0/2348551730 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28d7e00640 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5034ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28d7400640 1 -- 172.21.15.84:0/2348551730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 msgr2=0x562d50346000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28d7400640 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50346000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28d7400640 1 -- 172.21.15.84:0/2348551730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 msgr2=0x562d5034ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28d7400640 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5034ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28d7400640 1 -- 172.21.15.84:0/2348551730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d5034b4d0 con 0x562d4ff3e8e0 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28d6a00640 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50346000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28d7400640 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50345a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009340 tx=0x7f28c802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40237b5cb2c26b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.246+0000 7f28c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.247+0000 7f28c0c00640 1 -- 172.21.15.84:0/2348551730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8049030 con 0x562d4ff3e8e0 2024-09-21T02:40:14.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.247+0000 7f28c0c00640 1 -- 172.21.15.84:0/2348551730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f28c803b460 con 0x562d4ff3e8e0 2024-09-21T02:40:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.247+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2348551730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28c80cd710 con 0x562d4ff3e8e0 2024-09-21T02:40:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.247+0000 7f28c0c00640 1 -- 172.21.15.84:0/2348551730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f28c8117070 con 0x562d4ff3e8e0 2024-09-21T02:40:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.247+0000 7f28e4ecc740 10 client.14799 fetch_fsmap learned FSMap version 17 2024-09-21T02:40:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.247+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2348551730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x562d5034c890 con 0x562d4ff3e8e0 2024-09-21T02:40:14.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.247+0000 7f28c0c00640 1 -- 172.21.15.84:0/2348551730 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f28c80cd710 con 0x562d4ff3e8e0 2024-09-21T02:40:14.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.247+0000 7f28c0c00640 1 -- 172.21.15.84:0/2348551730 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f28c80c9e70 con 0x562d4ff3e8e0 2024-09-21T02:40:14.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.248+0000 7f28e4ecc740 10 client.14799 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.248+0000 7f28e4ecc740 10 client.14799 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.248+0000 7f28e4ecc740 20 client.14799 populate_metadata read hostname 'smithi084' 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.248+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562d4ff7ff60 0x562d503ba750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.248+0000 7f28e4ecc740 4 client.14799 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.248+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2348551730 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "status"}) -- 0x562d5029b750 con 0x562d4ff7ff60 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.248+0000 7f28d6a00640 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562d4ff7ff60 0x562d503ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28c0c00640 10 client.14799 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28d6a00640 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562d4ff7ff60 0x562d503ba750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6a158c5fb145778 server_cookie=2cb41b63161444c5 in_seq=0 out_seq=0 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28c0c00640 1 -- 172.21.15.84:0/2348551730 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562d5029b750 con 0x562d4ff7ff60 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28c0c00640 10 client.14799 handle_command_reply: tid=0 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 client.14799 shutdown 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2348551730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 msgr2=0x562d50345a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50345a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009340 tx=0x7f28c802a410 comp rx=0 tx=0).stop 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2348551730 shutdown_connections 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d4ff570a0 0x562d50346000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562d4ff7ff60 0x562d503ba750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d4ff5f280 0x562d5034ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 --2- 172.21.15.84:0/2348551730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d4ff3e8e0 0x562d50345a40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28c0c00640 0 client.14799 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.249+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2348551730 >> 172.21.15.84:0/2348551730 conn(0x562d4ff74350 msgr2=0x562d5032cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.250+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2348551730 shutdown_connections 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.250+0000 7f28e4ecc740 1 -- 172.21.15.84:0/2348551730 wait complete. 2024-09-21T02:40:14.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.250+0000 7f28e4ecc740 20 client.14799 trim_cache size 0 max 16384 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24704, 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 25.404437985000001, 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 17, 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 84, 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 84, 2024-09-21T02:40:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 39.956696121999997 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 -- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f28bc0b6590 msgr2=0x7f28bc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f28bc0b6590 0x7f28bc0b8aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009fd0 tx=0x7f28d0012040 comp rx=0 tx=0).stop 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 -- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 msgr2=0x7f28d819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 0x7f28d819a590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f28c80314b0 tx=0x7f28c8003c10 comp rx=0 tx=0).stop 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 -- 172.21.15.84:0/1496623804 shutdown_connections 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f28bc0b6590 0x7f28bc0b8aa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d8109df0 0x7f28d819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28d81094a0 0x7f28d819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 --2- 172.21.15.84:0/1496623804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d8103b60 0x7f28d819a590 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:14.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 -- 172.21.15.84:0/1496623804 >> 172.21.15.84:0/1496623804 conn(0x7f28d807b850 msgr2=0x7f28d8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:14.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 -- 172.21.15.84:0/1496623804 shutdown_connections 2024-09-21T02:40:14.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:14.251+0000 7f28de200640 1 -- 172.21.15.84:0/1496623804 wait complete. 2024-09-21T02:40:14.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:13 smithi172 ceph-mon[35067]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:14.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:13 smithi090 ceph-mon[34571]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:15.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T02:40:15.043 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:15.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T02:40:15.410 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:15.881 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:15 smithi084 ceph-mon[30747]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:15 smithi172 ceph-mon[35067]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:16.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:15 smithi090 ceph-mon[34571]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 -- 172.21.15.84:0/3664688583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 msgr2=0x7f3ba4106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 --2- 172.21.15.84:0/3664688583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 0x7f3ba4106190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009900 tx=0x7f3b9402a410 comp rx=0 tx=0).stop 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 -- 172.21.15.84:0/3664688583 shutdown_connections 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 --2- 172.21.15.84:0/3664688583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba410b6c0 0x7f3ba410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 --2- 172.21.15.84:0/3664688583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ba410c010 0x7f3ba4112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 --2- 172.21.15.84:0/3664688583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 0x7f3ba4106190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 -- 172.21.15.84:0/3664688583 >> 172.21.15.84:0/3664688583 conn(0x7f3ba4101810 msgr2=0x7f3ba4103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 -- 172.21.15.84:0/3664688583 shutdown_connections 2024-09-21T02:40:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.050+0000 7f3baae00640 1 -- 172.21.15.84:0/3664688583 wait complete. 2024-09-21T02:40:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.051+0000 7f3baae00640 1 Processor -- start 2024-09-21T02:40:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3baae00640 1 -- start start 2024-09-21T02:40:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3baae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 0x7f3ba419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3baae00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba410b6c0 0x7f3ba419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3baae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ba410c010 0x7f3ba41a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3baae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba4115e10 con 0x7f3ba4105d80 2024-09-21T02:40:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3baae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba4115c90 con 0x7f3ba410c010 2024-09-21T02:40:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3baae00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba4115f90 con 0x7f3ba410b6c0 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3ba3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 0x7f3ba419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3b9b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba410b6c0 0x7f3ba419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3ba3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 0x7f3ba419c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47370/0 (socket says 172.21.15.84:47370) 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.052+0000 7f3ba3e00640 1 -- 172.21.15.84:0/4041748241 learned_addr learned my addr 172.21.15.84:0/4041748241 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3ba8e00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ba410c010 0x7f3ba41a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3b9b400640 1 -- 172.21.15.84:0/4041748241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ba410c010 msgr2=0x7f3ba41a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3b9b400640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ba410c010 0x7f3ba41a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3b9b400640 1 -- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 msgr2=0x7f3ba419c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3b9b400640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 0x7f3ba419c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3b9b400640 1 -- 172.21.15.84:0/4041748241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba41a2750 con 0x7f3ba410b6c0 2024-09-21T02:40:16.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3ba3e00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 0x7f3ba419c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3b9b400640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba410b6c0 0x7f3ba419cd80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ba406caa0 tx=0x7f3b8c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.053+0000 7f3ba1600640 1 -- 172.21.15.84:0/4041748241 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00cc40 con 0x7f3ba410b6c0 2024-09-21T02:40:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.054+0000 7f3ba1600640 1 -- 172.21.15.84:0/4041748241 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b8c00cde0 con 0x7f3ba410b6c0 2024-09-21T02:40:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.054+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba41a2a40 con 0x7f3ba410b6c0 2024-09-21T02:40:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.054+0000 7f3ba1600640 1 -- 172.21.15.84:0/4041748241 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c004a00 con 0x7f3ba410b6c0 2024-09-21T02:40:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.054+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba41a91a0 con 0x7f3ba410b6c0 2024-09-21T02:40:16.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.055+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba4106190 con 0x7f3ba410b6c0 2024-09-21T02:40:16.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.057+0000 7f3ba1600640 1 -- 172.21.15.84:0/4041748241 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f3b8c005140 con 0x7f3ba410b6c0 2024-09-21T02:40:16.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.059+0000 7f3ba1600640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3b880b6590 0x7f3b880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:16.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.059+0000 7f3ba1600640 1 -- 172.21.15.84:0/4041748241 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f3b8c0e7500 con 0x7f3ba410b6c0 2024-09-21T02:40:16.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.059+0000 7f3ba3e00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3b880b6590 0x7f3b880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:16.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.060+0000 7f3ba3e00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3b880b6590 0x7f3b880b8aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b940096c0 tx=0x7f3b94005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:16.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.061+0000 7f3ba1600640 1 -- 172.21.15.84:0/4041748241 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b8c0adb80 con 0x7f3ba410b6c0 2024-09-21T02:40:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.283+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3ba410de40 con 0x7f3ba410b6c0 2024-09-21T02:40:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.284+0000 7f3ba1600640 1 -- 172.21.15.84:0/4041748241 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f3b8c0b1f60 con 0x7f3ba410b6c0 2024-09-21T02:40:16.286 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T02:40:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3b880b6590 msgr2=0x7f3b880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3b880b6590 0x7f3b880b8aa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3b940096c0 tx=0x7f3b94005a20 comp rx=0 tx=0).stop 2024-09-21T02:40:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba410b6c0 msgr2=0x7f3ba419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba410b6c0 0x7f3ba419cd80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ba406caa0 tx=0x7f3b8c00ee50 comp rx=0 tx=0).stop 2024-09-21T02:40:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 shutdown_connections 2024-09-21T02:40:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3b880b6590 0x7f3b880b8aa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ba410b6c0 0x7f3ba419cd80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ba410c010 0x7f3ba41a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 --2- 172.21.15.84:0/4041748241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ba4105d80 0x7f3ba419c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 >> 172.21.15.84:0/4041748241 conn(0x7f3ba4101810 msgr2=0x7f3ba410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 shutdown_connections 2024-09-21T02:40:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:16.287+0000 7f3baae00640 1 -- 172.21.15.84:0/4041748241 wait complete. 2024-09-21T02:40:17.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:16 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4041748241' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:40:17.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:16 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4041748241' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:40:17.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:16 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4041748241' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:40:17.040 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T02:40:17.040 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T02:40:17.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-09-21T02:40:17.040 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T02:40:17.041 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:17.041 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T02:40:17.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T02:40:17.041 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T02:40:17.041 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T02:40:17.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:17.041 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-09-21T02:40:17.076 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42119sec preferred_lft 42119sec 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2024-09-21T02:40:17.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:40:17.078 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T02:40:17.078 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:40:17.078 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:40:17.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-09-21T02:40:17.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-09-21T02:40:17.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-09-21T02:40:17.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T02:40:17.079 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:40:17.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:40:17.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:40:17.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:17.491 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T02:40:17.547 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-09-21T02:40:17.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:17.550 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-09-21T02:40:17.599 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-09-21T02:40:17.599 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T02:40:17.599 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T02:40:17.599 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T02:40:17.599 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T02:40:17.600 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:40:17.600 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:40:17.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T02:40:17.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T02:40:17.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T02:40:17.600 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:40:17.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:40:17.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:17 smithi084 ceph-mon[30747]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:17 smithi172 ceph-mon[35067]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:18.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:17 smithi090 ceph-mon[34571]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:18.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:40:18.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:18.198 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T02:40:18.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:18.234 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-09-21T02:40:18.310 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:40:18.311 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:40:18.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:40:18.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T02:40:18.311 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:40:18.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:40:18.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:40:18.491 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T02:40:18.491 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:40:18.491 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:40:18.491 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T02:40:18.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T02:40:18.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T02:40:18.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T02:40:18.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T02:40:18.492 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:40:18.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:40:18.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:40:18.726 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:40:18.726 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:40:18.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-09-21T02:40:18.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T02:40:18.727 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:40:18.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:40:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:40:18.896 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T02:40:18.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:40:18.896 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:18.932 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T02:40:18.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:40:18.932 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:19.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-09-21T02:40:19.104 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T02:40:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-09-21T02:40:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-09-21T02:40:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-09-21T02:40:19.140 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-09-21T02:40:19.141 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/50f0d3dbce41bbaf96b61a3123c50c862b3d3b1630767cd1b57e5f5763219578/merged 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/a222b1a511e4d4ce6d63df02d39ce20901548722f1cb24e52cf6701f61990577/merged 2024-09-21T02:40:19.142 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/078a7a3969f7c6bf0efe57e9c068fd8cb13ec7cd9632c7d3dbe340942b9d12a2/merged 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/d3de7265723df183bf09461254e3d9f916b6f559b642739246957e311a68e13b/merged 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/502f5b73c44894bcdb191dabb053076a70a85ff4a9de3658ba2e6c8bc970a83b/merged 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/6725860a9c6d3b916be1174d1132d23ee964b38c5ffa73470d088d06f216f011/merged 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/905cca8574c7356c032192999c344cd04f107eebbd544c19a98b6b0a5b3134a9/merged 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/b46901b8aa24c7ae84d032f686d9463c22cc3ea9fd2a21091fa9609007837476/merged 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7481d1f310ab6c316fb4ae231eb69408672594f7c9e903304b3ef3b8d55bca0e/merged 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/af58c86c933f62e560865b9073ac1a8955a964f04efd74dd87bf7e06db245c20/merged 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:40:19.143 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:40:19.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:19.144 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-09-21T02:40:19.220 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T02:40:19.220 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T02:40:19.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-09-21T02:40:19.321 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T02:40:19.358 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-09-21T02:40:19.358 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-09-21T02:40:19.358 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-09-21T02:40:19.358 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-09-21T02:40:19.358 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-09-21T02:40:19.358 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-09-21T02:40:19.359 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/50f0d3dbce41bbaf96b61a3123c50c862b3d3b1630767cd1b57e5f5763219578/merged 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/a222b1a511e4d4ce6d63df02d39ce20901548722f1cb24e52cf6701f61990577/merged 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/078a7a3969f7c6bf0efe57e9c068fd8cb13ec7cd9632c7d3dbe340942b9d12a2/merged 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/d3de7265723df183bf09461254e3d9f916b6f559b642739246957e311a68e13b/merged 2024-09-21T02:40:19.360 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/502f5b73c44894bcdb191dabb053076a70a85ff4a9de3658ba2e6c8bc970a83b/merged 2024-09-21T02:40:19.361 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/6725860a9c6d3b916be1174d1132d23ee964b38c5ffa73470d088d06f216f011/merged 2024-09-21T02:40:19.361 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/905cca8574c7356c032192999c344cd04f107eebbd544c19a98b6b0a5b3134a9/merged 2024-09-21T02:40:19.361 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/b46901b8aa24c7ae84d032f686d9463c22cc3ea9fd2a21091fa9609007837476/merged 2024-09-21T02:40:19.361 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7481d1f310ab6c316fb4ae231eb69408672594f7c9e903304b3ef3b8d55bca0e/merged 2024-09-21T02:40:19.361 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/af58c86c933f62e560865b9073ac1a8955a964f04efd74dd87bf7e06db245c20/merged 2024-09-21T02:40:19.361 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-09-21T02:40:19.361 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:40:19.361 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:40:19.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:19.362 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-09-21T02:40:19.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:2024-09-21T02:40:19.499+0000 7f954fe4b480 -1 init, newargv = 0x7f953c004ba0 newargc=15 2024-09-21T02:40:19.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[74509]: starting ceph client 2024-09-21T02:40:19.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[74509]: starting fuse 2024-09-21T02:40:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:19 smithi172 ceph-mon[35067]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:20.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:19 smithi084 ceph-mon[30747]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:20.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:19 smithi090 ceph-mon[34571]: pgmap v333: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:20.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-09-21T02:40:20.599 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T02:40:20.635 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-09-21T02:40:20.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-09-21T02:40:20.636 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-09-21T02:40:20.637 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/50f0d3dbce41bbaf96b61a3123c50c862b3d3b1630767cd1b57e5f5763219578/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/a222b1a511e4d4ce6d63df02d39ce20901548722f1cb24e52cf6701f61990577/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/0 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/078a7a3969f7c6bf0efe57e9c068fd8cb13ec7cd9632c7d3dbe340942b9d12a2/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/d3de7265723df183bf09461254e3d9f916b6f559b642739246957e311a68e13b/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/502f5b73c44894bcdb191dabb053076a70a85ff4a9de3658ba2e6c8bc970a83b/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/6725860a9c6d3b916be1174d1132d23ee964b38c5ffa73470d088d06f216f011/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/905cca8574c7356c032192999c344cd04f107eebbd544c19a98b6b0a5b3134a9/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/b46901b8aa24c7ae84d032f686d9463c22cc3ea9fd2a21091fa9609007837476/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/7481d1f310ab6c316fb4ae231eb69408672594f7c9e903304b3ef3b8d55bca0e/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/containers/storage/overlay/af58c86c933f62e560865b9073ac1a8955a964f04efd74dd87bf7e06db245c20/merged 2024-09-21T02:40:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-09-21T02:40:20.639 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:40:20.639 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:40:20.639 INFO:teuthology.orchestra.run.smithi084.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:20.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:20.640 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-09-21T02:40:20.715 INFO:teuthology.orchestra.run.smithi084.stdout:120 2024-09-21T02:40:20.716 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> import re 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> import os 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T02:40:20.716 DEBUG:teuthology.orchestra.run.smithi084:> 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> return f 2024-09-21T02:40:20.717 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T02:40:20.718 DEBUG:teuthology.orchestra.run.smithi084:> 2024-09-21T02:40:20.718 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.admin")) 2024-09-21T02:40:20.718 DEBUG:teuthology.orchestra.run.smithi084:> ' 2024-09-21T02:40:20.878 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.admin.74509.asok 2024-09-21T02:40:20.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:40:20.892 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74509.asok 2024-09-21T02:40:20.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:20.893 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74509.asok status 2024-09-21T02:40:21.138 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:40:21.138 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2024-09-21T02:40:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T02:40:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T02:40:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "admin", 2024-09-21T02:40:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2024-09-21T02:40:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T02:40:21.139 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "74509", 2024-09-21T02:40:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2024-09-21T02:40:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:40:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2024-09-21T02:40:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2024-09-21T02:40:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 14811, 2024-09-21T02:40:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2024-09-21T02:40:21.140 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2024-09-21T02:40:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2024-09-21T02:40:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 14811 2024-09-21T02:40:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:40:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2024-09-21T02:40:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-09-21T02:40:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2024-09-21T02:40:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2137761749 2024-09-21T02:40:21.141 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:40:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:40:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2024-09-21T02:40:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-09-21T02:40:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2024-09-21T02:40:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2137761749 2024-09-21T02:40:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:40:21.142 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.14811 192.168.0.1:0/2137761749", 2024-09-21T02:40:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2137761749", 2024-09-21T02:40:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2024-09-21T02:40:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 17, 2024-09-21T02:40:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 84, 2024-09-21T02:40:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2024-09-21T02:40:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2024-09-21T02:40:21.143 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2024-09-21T02:40:21.144 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:40:21.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:21.157 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2024-09-21T02:40:21.157 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:21.193 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2024-09-21T02:40:21.193 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:21.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:21.193 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:21.291 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T02:40:21.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:40:21.394 INFO:teuthology.orchestra.run.smithi084.stdout:# file: . 2024-09-21T02:40:21.394 INFO:teuthology.orchestra.run.smithi084.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T02:40:21.394 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:21.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:40:21.402 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:40:21.402 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:40:21.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T02:40:21.851 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:21.990 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:21 smithi084 ceph-mon[30747]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:21 smithi172 ceph-mon[35067]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:22.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:21 smithi090 ceph-mon[34571]: pgmap v334: 129 pgs: 129 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:22.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.475+0000 7fba14800640 1 -- 172.21.15.84:0/852604547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 msgr2=0x7fba0c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:22.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.475+0000 7fba14800640 1 --2- 172.21.15.84:0/852604547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 0x7fba0c103f70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba00009900 tx=0x7fba0002a400 comp rx=0 tx=0).stop 2024-09-21T02:40:22.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.476+0000 7fba14800640 1 -- 172.21.15.84:0/852604547 shutdown_connections 2024-09-21T02:40:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.476+0000 7fba14800640 1 --2- 172.21.15.84:0/852604547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba0c109df0 0x7fba0c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.476+0000 7fba14800640 1 --2- 172.21.15.84:0/852604547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba0c1094a0 0x7fba0c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.476+0000 7fba14800640 1 --2- 172.21.15.84:0/852604547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 0x7fba0c103f70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.476+0000 7fba14800640 1 -- 172.21.15.84:0/852604547 >> 172.21.15.84:0/852604547 conn(0x7fba0c07b850 msgr2=0x7fba0c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.476+0000 7fba14800640 1 -- 172.21.15.84:0/852604547 shutdown_connections 2024-09-21T02:40:22.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.476+0000 7fba14800640 1 -- 172.21.15.84:0/852604547 wait complete. 2024-09-21T02:40:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba14800640 1 Processor -- start 2024-09-21T02:40:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba14800640 1 -- start start 2024-09-21T02:40:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba14800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 0x7fba0c19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba14800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba0c1094a0 0x7fba0c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:22.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba14800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba0c109df0 0x7fba0c1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba14800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c113bf0 con 0x7fba0c103b60 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba14800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c113a70 con 0x7fba0c109df0 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba14800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c113d70 con 0x7fba0c1094a0 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.477+0000 7fba11e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 0x7fba0c19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba11e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 0x7fba0c19c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48292/0 (socket says 172.21.15.84:48292) 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba11e00640 1 -- 172.21.15.84:0/1423478316 learned_addr learned my addr 172.21.15.84:0/1423478316 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba12800640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba0c109df0 0x7fba0c1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba11e00640 1 -- 172.21.15.84:0/1423478316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba0c1094a0 msgr2=0x7fba0c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba11e00640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba0c1094a0 0x7fba0c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba11e00640 1 -- 172.21.15.84:0/1423478316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba0c109df0 msgr2=0x7fba0c1a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba11e00640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba0c109df0 0x7fba0c1a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba11e00640 1 -- 172.21.15.84:0/1423478316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c1a26b0 con 0x7fba0c103b60 2024-09-21T02:40:22.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba12800640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba0c109df0 0x7fba0c1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:40:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.478+0000 7fba11e00640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 0x7fba0c19c740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba00005ab0 tx=0x7fba000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.479+0000 7fba06a00640 1 -- 172.21.15.84:0/1423478316 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0003f030 con 0x7fba0c103b60 2024-09-21T02:40:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.479+0000 7fba06a00640 1 -- 172.21.15.84:0/1423478316 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba00003cd0 con 0x7fba0c103b60 2024-09-21T02:40:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.479+0000 7fba06a00640 1 -- 172.21.15.84:0/1423478316 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00035070 con 0x7fba0c103b60 2024-09-21T02:40:22.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.479+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c1a2940 con 0x7fba0c103b60 2024-09-21T02:40:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.479+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0c1a9100 con 0x7fba0c103b60 2024-09-21T02:40:22.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.480+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba0c103f70 con 0x7fba0c103b60 2024-09-21T02:40:22.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.482+0000 7fba06a00640 1 -- 172.21.15.84:0/1423478316 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fba00042030 con 0x7fba0c103b60 2024-09-21T02:40:22.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.484+0000 7fba06a00640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb9f40b6510 0x7fb9f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:22.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.484+0000 7fba06a00640 1 -- 172.21.15.84:0/1423478316 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fba001080b0 con 0x7fba0c103b60 2024-09-21T02:40:22.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.484+0000 7fba11400640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb9f40b6510 0x7fb9f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:22.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.485+0000 7fba11400640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb9f40b6510 0x7fb9f40b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc005d00 tx=0x7fb9fc005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:22.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.486+0000 7fba06a00640 1 -- 172.21.15.84:0/1423478316 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fba000ce6a0 con 0x7fba0c103b60 2024-09-21T02:40:22.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.685+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba0c1a9430 con 0x7fba0c103b60 2024-09-21T02:40:22.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.686+0000 7fba06a00640 1 -- 172.21.15.84:0/1423478316 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+590 (secure 0 0 0) 0x7fba000d2a80 con 0x7fba0c103b60 2024-09-21T02:40:22.687 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3670733962 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3670733962 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3048700539 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1797182197 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2355445501 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/239259500 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/4193451827 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3180377571 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/950512595 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/4193451827 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:22.688 INFO:teuthology.orchestra.run.smithi084.stderr:listed 10 entries 2024-09-21T02:40:22.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb9f40b6510 msgr2=0x7fb9f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:22.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb9f40b6510 0x7fb9f40b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc005d00 tx=0x7fb9fc005c50 comp rx=0 tx=0).stop 2024-09-21T02:40:22.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 msgr2=0x7fba0c19c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:22.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 0x7fba0c19c740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba00005ab0 tx=0x7fba000042f0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 shutdown_connections 2024-09-21T02:40:22.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb9f40b6510 0x7fb9f40b8a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba0c1094a0 0x7fba0c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba0c109df0 0x7fba0c1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 --2- 172.21.15.84:0/1423478316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba0c103b60 0x7fba0c19c740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:22.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.688+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 >> 172.21.15.84:0/1423478316 conn(0x7fba0c07b850 msgr2=0x7fba0c1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:22.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.689+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 shutdown_connections 2024-09-21T02:40:22.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:22.689+0000 7fba14800640 1 -- 172.21.15.84:0/1423478316 wait complete. 2024-09-21T02:40:23.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:22 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1423478316' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:40:23.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:22 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1423478316' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:40:23.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:22 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1423478316' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:40:23.432 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:40:23.432 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:40:23.468 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T02:40:23.886 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:24.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:23 smithi172 ceph-mon[35067]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:23 smithi084 ceph-mon[30747]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:23 smithi090 ceph-mon[34571]: pgmap v335: 129 pgs: 129 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 -- 172.21.15.84:0/2179434819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c10de30 msgr2=0x7f542c110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 --2- 172.21.15.84:0/2179434819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c10de30 0x7f542c110320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5424009ca0 tx=0x7f542402a8b0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 -- 172.21.15.84:0/2179434819 shutdown_connections 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 --2- 172.21.15.84:0/2179434819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542c105320 0x7f542c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 --2- 172.21.15.84:0/2179434819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c10de30 0x7f542c110320 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 --2- 172.21.15.84:0/2179434819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f542c1049d0 0x7f542c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 -- 172.21.15.84:0/2179434819 >> 172.21.15.84:0/2179434819 conn(0x7f542c079740 msgr2=0x7f542c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 -- 172.21.15.84:0/2179434819 shutdown_connections 2024-09-21T02:40:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.708+0000 7f5432000640 1 -- 172.21.15.84:0/2179434819 wait complete. 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.709+0000 7f5432000640 1 Processor -- start 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.709+0000 7f5432000640 1 -- start start 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f5432000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542c1049d0 0x7f542c19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f5432000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c105320 0x7f542c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f5432000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f542c10de30 0x7f542c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f5432000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f542c113c20 con 0x7f542c105320 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f5432000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f542c113aa0 con 0x7f542c10de30 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f5432000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f542c113da0 con 0x7f542c1049d0 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f542b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542c1049d0 0x7f542c19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f542b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542c1049d0 0x7f542c19c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:39312/0 (socket says 172.21.15.84:39312) 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f542b400640 1 -- 172.21.15.84:0/219812741 learned_addr learned my addr 172.21.15.84:0/219812741 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f542be00640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f542c10de30 0x7f542c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.710+0000 7f542aa00640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c105320 0x7f542c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f542b400640 1 -- 172.21.15.84:0/219812741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f542c10de30 msgr2=0x7f542c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f542b400640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f542c10de30 0x7f542c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f542b400640 1 -- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c105320 msgr2=0x7f542c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f542b400640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c105320 0x7f542c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f542b400640 1 -- 172.21.15.84:0/219812741 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c1a26c0 con 0x7f542c1049d0 2024-09-21T02:40:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f542aa00640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c105320 0x7f542c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:40:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f542b400640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542c1049d0 0x7f542c19c750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f541c00e9c0 tx=0x7f541c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f5423e00640 1 -- 172.21.15.84:0/219812741 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c00cde0 con 0x7f542c1049d0 2024-09-21T02:40:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f5423e00640 1 -- 172.21.15.84:0/219812741 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f541c010900 con 0x7f542c1049d0 2024-09-21T02:40:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542c1a29b0 con 0x7f542c1049d0 2024-09-21T02:40:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.711+0000 7f5423e00640 1 -- 172.21.15.84:0/219812741 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c0189d0 con 0x7f542c1049d0 2024-09-21T02:40:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.712+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542c1a9110 con 0x7f542c1049d0 2024-09-21T02:40:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.713+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542c06c240 con 0x7f542c1049d0 2024-09-21T02:40:24.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.717+0000 7f5423e00640 1 -- 172.21.15.84:0/219812741 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f541c01f020 con 0x7f542c1049d0 2024-09-21T02:40:24.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.718+0000 7f5423e00640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f54100b6510 0x7f54100b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:24.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.719+0000 7f5423e00640 1 -- 172.21.15.84:0/219812741 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f541c0e7d70 con 0x7f542c1049d0 2024-09-21T02:40:24.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.719+0000 7f542aa00640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f54100b6510 0x7f54100b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:24.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.719+0000 7f5423e00640 1 -- 172.21.15.84:0/219812741 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f541c0ae360 con 0x7f542c1049d0 2024-09-21T02:40:24.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.720+0000 7f542aa00640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f54100b6510 0x7f54100b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f542c10f8d0 tx=0x7f5418005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:24.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.945+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f542c19d880 con 0x7f542c1049d0 2024-09-21T02:40:24.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.946+0000 7f5423e00640 1 -- 172.21.15.84:0/219812741 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+590 (secure 0 0 0) 0x7f541c0b2740 con 0x7f542c1049d0 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3670733962 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3670733962 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3048700539 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1797182197 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2355445501 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/239259500 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/4193451827 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3180377571 2024-09-22T02:31:41.471413+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/950512595 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:24.948 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/4193451827 2024-09-22T02:31:12.328817+0000 2024-09-21T02:40:24.949 INFO:teuthology.orchestra.run.smithi084.stderr:listed 10 entries 2024-09-21T02:40:24.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f54100b6510 msgr2=0x7f54100b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:24.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f54100b6510 0x7f54100b8a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f542c10f8d0 tx=0x7f5418005f90 comp rx=0 tx=0).stop 2024-09-21T02:40:24.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542c1049d0 msgr2=0x7f542c19c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:24.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542c1049d0 0x7f542c19c750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f541c00e9c0 tx=0x7f541c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:40:24.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 shutdown_connections 2024-09-21T02:40:24.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f542c10de30 0x7f542c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542c105320 0x7f542c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f54100b6510 0x7f54100b8a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 --2- 172.21.15.84:0/219812741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f542c1049d0 0x7f542c19c750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:24.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 >> 172.21.15.84:0/219812741 conn(0x7f542c079740 msgr2=0x7f542c103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:24.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 shutdown_connections 2024-09-21T02:40:24.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:24.949+0000 7f5432000640 1 -- 172.21.15.84:0/219812741 wait complete. 2024-09-21T02:40:25.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:24 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/219812741' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:40:25.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:24 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/219812741' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:40:25.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:25 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/219812741' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:40:25.739 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2024-09-21T02:40:25.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:25.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T02:40:25.796 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[74509]: fuse finished with error 0 and tester_r 0 2024-09-21T02:40:25.800 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T02:40:26.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:26 smithi084 ceph-mon[30747]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:26.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:26 smithi090 ceph-mon[34571]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:26.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:26 smithi172 ceph-mon[35067]: pgmap v336: 129 pgs: 129 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-21T02:40:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:27 smithi172 ceph-mon[35067]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:28.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:27 smithi084 ceph-mon[30747]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:27 smithi090 ceph-mon[34571]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:29 smithi172 ceph-mon[35067]: pgmap v338: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:29 smithi084 ceph-mon[30747]: pgmap v338: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:30.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:29 smithi090 ceph-mon[34571]: pgmap v338: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:31.902 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:40:31.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:40:31.902 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T02:40:31.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:40:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:31 smithi172 ceph-mon[35067]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:32.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:31 smithi084 ceph-mon[30747]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:32.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:31 smithi090 ceph-mon[34571]: pgmap v339: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-21T02:40:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.995+0000 7f1a6ac00640 1 -- 172.21.15.84:0/1577649809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 msgr2=0x7f1a64106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.995+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/1577649809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 0x7f1a64106190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009860 tx=0x7f1a5402a340 comp rx=0 tx=0).stop 2024-09-21T02:40:32.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.995+0000 7f1a6ac00640 1 -- 172.21.15.84:0/1577649809 shutdown_connections 2024-09-21T02:40:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.995+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/1577649809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6410c010 0x7f1a64112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.995+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/1577649809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a6410b6c0 0x7f1a6410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.995+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/1577649809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 0x7f1a64106190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.995+0000 7f1a6ac00640 1 -- 172.21.15.84:0/1577649809 >> 172.21.15.84:0/1577649809 conn(0x7f1a64101810 msgr2=0x7f1a64103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.996+0000 7f1a6ac00640 1 -- 172.21.15.84:0/1577649809 shutdown_connections 2024-09-21T02:40:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.996+0000 7f1a6ac00640 1 -- 172.21.15.84:0/1577649809 wait complete. 2024-09-21T02:40:32.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.997+0000 7f1a6ac00640 1 Processor -- start 2024-09-21T02:40:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.997+0000 7f1a6ac00640 1 -- start start 2024-09-21T02:40:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a6ac00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 0x7f1a6419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a6ac00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a6410b6c0 0x7f1a6419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:32.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a6ac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6410c010 0x7f1a641a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a6ac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64115e10 con 0x7f1a6410c010 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a6ac00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64115c90 con 0x7f1a6410b6c0 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a6ac00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64115f90 con 0x7f1a64105d80 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a68c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6410c010 0x7f1a641a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a63e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 0x7f1a6419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a63e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 0x7f1a6419c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54008/0 (socket says 172.21.15.84:54008) 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a63e00640 1 -- 172.21.15.84:0/3891238628 learned_addr learned my addr 172.21.15.84:0/3891238628 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.998+0000 7f1a5b400640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a6410b6c0 0x7f1a6419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a63e00640 1 -- 172.21.15.84:0/3891238628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a6410b6c0 msgr2=0x7f1a6419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a63e00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a6410b6c0 0x7f1a6419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a63e00640 1 -- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6410c010 msgr2=0x7f1a641a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a63e00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6410c010 0x7f1a641a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:33.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a63e00640 1 -- 172.21.15.84:0/3891238628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a641a2750 con 0x7f1a64105d80 2024-09-21T02:40:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a63e00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 0x7f1a6419c7e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a54035040 tx=0x7f1a5402af30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a61600640 1 -- 172.21.15.84:0/3891238628 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5403f020 con 0x7f1a64105d80 2024-09-21T02:40:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a641a29e0 con 0x7f1a64105d80 2024-09-21T02:40:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a61600640 1 -- 172.21.15.84:0/3891238628 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a54033e50 con 0x7f1a64105d80 2024-09-21T02:40:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a61600640 1 -- 172.21.15.84:0/3891238628 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54037040 con 0x7f1a64105d80 2024-09-21T02:40:33.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:32.999+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a641a91a0 con 0x7f1a64105d80 2024-09-21T02:40:33.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.000+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a64106190 con 0x7f1a64105d80 2024-09-21T02:40:33.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.003+0000 7f1a61600640 1 -- 172.21.15.84:0/3891238628 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1a54042020 con 0x7f1a64105d80 2024-09-21T02:40:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.005+0000 7f1a61600640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a480b6590 0x7f1a480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.005+0000 7f1a61600640 1 -- 172.21.15.84:0/3891238628 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f1a541074f0 con 0x7f1a64105d80 2024-09-21T02:40:33.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.005+0000 7f1a5b400640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a480b6590 0x7f1a480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:33.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.006+0000 7f1a5b400640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a480b6590 0x7f1a480b8aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1a64104ff0 tx=0x7f1a4c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:33.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.007+0000 7f1a61600640 1 -- 172.21.15.84:0/3891238628 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a54049020 con 0x7f1a64105d80 2024-09-21T02:40:33.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.193+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a6410dde0 con 0x7f1a64105d80 2024-09-21T02:40:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.195+0000 7f1a61600640 1 -- 172.21.15.84:0/3891238628 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24200 (secure 0 0 0) 0x7f1a540cdbc0 con 0x7f1a64105d80 2024-09-21T02:40:33.197 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:33.197 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:40:00.971518+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:40:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a480b6590 msgr2=0x7f1a480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a480b6590 0x7f1a480b8aa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1a64104ff0 tx=0x7f1a4c005f90 comp rx=0 tx=0).stop 2024-09-21T02:40:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 msgr2=0x7f1a6419c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 0x7f1a6419c7e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a54035040 tx=0x7f1a5402af30 comp rx=0 tx=0).stop 2024-09-21T02:40:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 shutdown_connections 2024-09-21T02:40:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a6410c010 0x7f1a641a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a6410b6c0 0x7f1a6419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:33.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a480b6590 0x7f1a480b8aa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.198+0000 7f1a6ac00640 1 --2- 172.21.15.84:0/3891238628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a64105d80 0x7f1a6419c7e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.199+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 >> 172.21.15.84:0/3891238628 conn(0x7f1a64101810 msgr2=0x7f1a6410ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.199+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 shutdown_connections 2024-09-21T02:40:33.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:33.199+0000 7f1a6ac00640 1 -- 172.21.15.84:0/3891238628 wait complete. 2024-09-21T02:40:33.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:33 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3891238628' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:33.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:33 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3891238628' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:33.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:33 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3891238628' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:33.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:40:34.347 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:34.508 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:34 smithi172 ceph-mon[35067]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:34.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:34 smithi084 ceph-mon[30747]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:34.519 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:34 smithi090 ceph-mon[34571]: pgmap v340: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:34.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 -- 172.21.15.84:0/2738692403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e810de30 msgr2=0x7ff2e8110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:34.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 --2- 172.21.15.84:0/2738692403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e810de30 0x7ff2e8110320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009ca0 tx=0x7ff2e002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:40:34.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 -- 172.21.15.84:0/2738692403 shutdown_connections 2024-09-21T02:40:34.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 --2- 172.21.15.84:0/2738692403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e810de30 0x7ff2e8110320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:34.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 --2- 172.21.15.84:0/2738692403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2e8105320 0x7ff2e810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:34.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 --2- 172.21.15.84:0/2738692403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e81049d0 0x7ff2e8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:34.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 -- 172.21.15.84:0/2738692403 >> 172.21.15.84:0/2738692403 conn(0x7ff2e8079740 msgr2=0x7ff2e8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:34.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 -- 172.21.15.84:0/2738692403 shutdown_connections 2024-09-21T02:40:35.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.997+0000 7ff2eee00640 1 -- 172.21.15.84:0/2738692403 wait complete. 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.998+0000 7ff2eee00640 1 Processor -- start 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2eee00640 1 -- start start 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2eee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2e81049d0 0x7ff2e819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2eee00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e8105320 0x7ff2e819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2eee00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e810de30 0x7ff2e819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2eee00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8113c70 con 0x7ff2e8105320 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2eee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8113af0 con 0x7ff2e81049d0 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2eee00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e8113df0 con 0x7ff2e810de30 2024-09-21T02:40:35.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2df400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e8105320 0x7ff2e819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2df400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e8105320 0x7ff2e819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40256/0 (socket says 172.21.15.84:40256) 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2df400640 1 -- 172.21.15.84:0/1014083936 learned_addr learned my addr 172.21.15.84:0/1014083936 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2ece00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e810de30 0x7ff2e819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:34.999+0000 7ff2e7e00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2e81049d0 0x7ff2e819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.000+0000 7ff2df400640 1 -- 172.21.15.84:0/1014083936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e810de30 msgr2=0x7ff2e819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.000+0000 7ff2df400640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e810de30 0x7ff2e819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.000+0000 7ff2df400640 1 -- 172.21.15.84:0/1014083936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2e81049d0 msgr2=0x7ff2e819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.000+0000 7ff2df400640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2e81049d0 0x7ff2e819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.000+0000 7ff2df400640 1 -- 172.21.15.84:0/1014083936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e81a0550 con 0x7ff2e8105320 2024-09-21T02:40:35.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.000+0000 7ff2df400640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e8105320 0x7ff2e819ab80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e970 tx=0x7ff2d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:35.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.001+0000 7ff2e5600640 1 -- 172.21.15.84:0/1014083936 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000ccc0 con 0x7ff2e8105320 2024-09-21T02:40:35.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.001+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e81a0840 con 0x7ff2e8105320 2024-09-21T02:40:35.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.001+0000 7ff2e5600640 1 -- 172.21.15.84:0/1014083936 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff2d00035f0 con 0x7ff2e8105320 2024-09-21T02:40:35.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.001+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e81a6fa0 con 0x7ff2e8105320 2024-09-21T02:40:35.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.001+0000 7ff2e5600640 1 -- 172.21.15.84:0/1014083936 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000ce60 con 0x7ff2e8105320 2024-09-21T02:40:35.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.002+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e806c240 con 0x7ff2e8105320 2024-09-21T02:40:35.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.004+0000 7ff2e5600640 1 -- 172.21.15.84:0/1014083936 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff2d00037a0 con 0x7ff2e8105320 2024-09-21T02:40:35.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.005+0000 7ff2e5600640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2cc0b6510 0x7ff2cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:35.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.006+0000 7ff2e5600640 1 -- 172.21.15.84:0/1014083936 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7ff2d00e79c0 con 0x7ff2e8105320 2024-09-21T02:40:35.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.006+0000 7ff2e7e00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2cc0b6510 0x7ff2cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:35.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.006+0000 7ff2e7e00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2cc0b6510 0x7ff2cc0b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2e806c940 tx=0x7ff2d8009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:35.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.008+0000 7ff2e5600640 1 -- 172.21.15.84:0/1014083936 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2d0056710 con 0x7ff2e8105320 2024-09-21T02:40:35.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.194+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2e819b710 con 0x7ff2e8105320 2024-09-21T02:40:35.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.195+0000 7ff2e5600640 1 -- 172.21.15.84:0/1014083936 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24200 (secure 0 0 0) 0x7ff2d00adfb0 con 0x7ff2e8105320 2024-09-21T02:40:35.197 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:35.197 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":84,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:40:00.971518+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:40:35.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2cc0b6510 msgr2=0x7ff2cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2cc0b6510 0x7ff2cc0b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2e806c940 tx=0x7ff2d8009110 comp rx=0 tx=0).stop 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e8105320 msgr2=0x7ff2e819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e8105320 0x7ff2e819ab80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e970 tx=0x7ff2d000ed70 comp rx=0 tx=0).stop 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 shutdown_connections 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2cc0b6510 0x7ff2cc0b8a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2e810de30 0x7ff2e819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2e8105320 0x7ff2e819ab80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 --2- 172.21.15.84:0/1014083936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2e81049d0 0x7ff2e819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 >> 172.21.15.84:0/1014083936 conn(0x7ff2e8079740 msgr2=0x7ff2e80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 shutdown_connections 2024-09-21T02:40:35.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:35.198+0000 7ff2eee00640 1 -- 172.21.15.84:0/1014083936 wait complete. 2024-09-21T02:40:35.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:35 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1014083936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:35.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:35 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1014083936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:35 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1014083936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:40:35.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T02:40:36.299 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:36.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:36 smithi090 ceph-mon[34571]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:36.608 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:36 smithi084 ceph-mon[30747]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:36.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:36 smithi172 ceph-mon[35067]: pgmap v341: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:36.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2824771769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810a1b0 msgr2=0x7f4f2810a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:36.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2824771769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810a1b0 0x7f4f2810a5c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009900 tx=0x7f4f1802a410 comp rx=0 tx=0).stop 2024-09-21T02:40:36.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2824771769 shutdown_connections 2024-09-21T02:40:36.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2824771769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2810faf0 0x7f4f2810ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:36.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2824771769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f28110440 0x7f4f28116c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:36.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2824771769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810a1b0 0x7f4f2810a5c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:36.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2824771769 >> 172.21.15.84:0/2824771769 conn(0x7f4f280780e0 msgr2=0x7f4f281081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:36.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2824771769 shutdown_connections 2024-09-21T02:40:36.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.960+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2824771769 wait complete. 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.961+0000 7f4f2ce00640 1 Processor -- start 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f2ce00640 1 -- start start 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f2ce00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2810a1b0 0x7f4f281a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f2ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810faf0 0x7f4f281a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f2ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f28110440 0x7f4f281a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f2ce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2811a240 con 0x7f4f2810faf0 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f2ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2811a0c0 con 0x7f4f28110440 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f2ce00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2811a3c0 con 0x7f4f2810a1b0 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f1d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810faf0 0x7f4f281a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:36.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f1d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810faf0 0x7f4f281a1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40280/0 (socket says 172.21.15.84:40280) 2024-09-21T02:40:36.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f1d400640 1 -- 172.21.15.84:0/2954643320 learned_addr learned my addr 172.21.15.84:0/2954643320 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:36.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f26800640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f28110440 0x7f4f281a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:36.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.962+0000 7f4f25e00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2810a1b0 0x7f4f281a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:36.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1d400640 1 -- 172.21.15.84:0/2954643320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2810a1b0 msgr2=0x7f4f281a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:36.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1d400640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2810a1b0 0x7f4f281a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:36.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1d400640 1 -- 172.21.15.84:0/2954643320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f28110440 msgr2=0x7f4f281a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:36.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1d400640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f28110440 0x7f4f281a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:36.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1d400640 1 -- 172.21.15.84:0/2954643320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f281a6c00 con 0x7f4f2810faf0 2024-09-21T02:40:36.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1d400640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810faf0 0x7f4f281a1230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000e9c0 tx=0x7f4f1000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:36.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1f400640 1 -- 172.21.15.84:0/2954643320 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000ccc0 con 0x7f4f2810faf0 2024-09-21T02:40:36.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f281a6ef0 con 0x7f4f2810faf0 2024-09-21T02:40:36.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1f400640 1 -- 172.21.15.84:0/2954643320 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f100054f0 con 0x7f4f2810faf0 2024-09-21T02:40:36.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.963+0000 7f4f1f400640 1 -- 172.21.15.84:0/2954643320 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10010430 con 0x7f4f2810faf0 2024-09-21T02:40:36.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.964+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f281ad650 con 0x7f4f2810faf0 2024-09-21T02:40:36.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.965+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2810a5c0 con 0x7f4f2810faf0 2024-09-21T02:40:36.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.967+0000 7f4f1f400640 1 -- 172.21.15.84:0/2954643320 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4f100046c0 con 0x7f4f2810faf0 2024-09-21T02:40:36.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.968+0000 7f4f1f400640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4f0c0b6510 0x7f4f0c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:36.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.969+0000 7f4f1f400640 1 -- 172.21.15.84:0/2954643320 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f4f100e7a70 con 0x7f4f2810faf0 2024-09-21T02:40:36.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.969+0000 7f4f25e00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4f0c0b6510 0x7f4f0c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:36.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.969+0000 7f4f25e00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4f0c0b6510 0x7f4f0c0b8a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009230 tx=0x7f4f180058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:36.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:36.971+0000 7f4f1f400640 1 -- 172.21.15.84:0/2954643320 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f10056710 con 0x7f4f2810faf0 2024-09-21T02:40:37.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.192+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4f281a1dc0 con 0x7f4f2810faf0 2024-09-21T02:40:37.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.270+0000 7f4f1f400640 1 -- 172.21.15.84:0/2954643320 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f4f281a1dc0 con 0x7f4f2810faf0 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4f0c0b6510 msgr2=0x7f4f0c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4f0c0b6510 0x7f4f0c0b8a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009230 tx=0x7f4f180058d0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810faf0 msgr2=0x7f4f281a1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810faf0 0x7f4f281a1230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000e9c0 tx=0x7f4f1000ee80 comp rx=0 tx=0).stop 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 shutdown_connections 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f28110440 0x7f4f281a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2810faf0 0x7f4f281a1230 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4f0c0b6510 0x7f4f0c0b8a20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 --2- 172.21.15.84:0/2954643320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f2810a1b0 0x7f4f281a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.272+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 >> 172.21.15.84:0/2954643320 conn(0x7f4f280780e0 msgr2=0x7f4f28108510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.273+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 shutdown_connections 2024-09-21T02:40:37.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:37.273+0000 7f4f2ce00640 1 -- 172.21.15.84:0/2954643320 wait complete. 2024-09-21T02:40:37.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:37 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2954643320' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:40:37.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:37 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2954643320' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:40:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:37 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2954643320' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T02:40:38.001 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-21T02:40:38.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T02:40:38.372 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:38.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:38 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2954643320' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:40:38.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:38 smithi084 ceph-mon[30747]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:38.562 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:38 smithi084 ceph-mon[30747]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:38 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2954643320' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:40:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:38 smithi172 ceph-mon[35067]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:38 smithi172 ceph-mon[35067]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:38 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2954643320' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T02:40:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:38 smithi090 ceph-mon[34571]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:38.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:38 smithi090 ceph-mon[34571]: pgmap v342: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T02:40:39.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 -- 172.21.15.84:0/1719000592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc105bb0 msgr2=0x7f9efc105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:39.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 --2- 172.21.15.84:0/1719000592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc105bb0 0x7f9efc105fc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009900 tx=0x7f9eec02a410 comp rx=0 tx=0).stop 2024-09-21T02:40:39.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 -- 172.21.15.84:0/1719000592 shutdown_connections 2024-09-21T02:40:39.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 --2- 172.21.15.84:0/1719000592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9efc10b4f0 0x7f9efc10b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 --2- 172.21.15.84:0/1719000592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9efc10be40 0x7f9efc112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 --2- 172.21.15.84:0/1719000592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc105bb0 0x7f9efc105fc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 -- 172.21.15.84:0/1719000592 >> 172.21.15.84:0/1719000592 conn(0x7f9efc101680 msgr2=0x7f9efc103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:39.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 -- 172.21.15.84:0/1719000592 shutdown_connections 2024-09-21T02:40:39.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.065+0000 7f9efb200640 1 -- 172.21.15.84:0/1719000592 wait complete. 2024-09-21T02:40:39.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.066+0000 7f9efb200640 1 Processor -- start 2024-09-21T02:40:39.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.066+0000 7f9efb200640 1 -- start start 2024-09-21T02:40:39.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efb200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9efc105bb0 0x7f9efc19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:39.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efb200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9efc10b4f0 0x7f9efc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc10be40 0x7f9efc1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc115c40 con 0x7f9efc10be40 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efb200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc115ac0 con 0x7f9efc10b4f0 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efb200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc115dc0 con 0x7f9efc105bb0 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efa800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc10be40 0x7f9efc1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9ef1400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9efc10b4f0 0x7f9efc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9ef9e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9efc105bb0 0x7f9efc19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efa800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc10be40 0x7f9efc1a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40302/0 (socket says 172.21.15.84:40302) 2024-09-21T02:40:39.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.067+0000 7f9efa800640 1 -- 172.21.15.84:0/3946072134 learned_addr learned my addr 172.21.15.84:0/3946072134 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:39.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef1400640 1 -- 172.21.15.84:0/3946072134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9efc105bb0 msgr2=0x7f9efc19c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:39.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef1400640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9efc105bb0 0x7f9efc19c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef1400640 1 -- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc10be40 msgr2=0x7f9efc1a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:39.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef1400640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc10be40 0x7f9efc1a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef1400640 1 -- 172.21.15.84:0/3946072134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9efc1a25a0 con 0x7f9efc10b4f0 2024-09-21T02:40:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef1400640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9efc10b4f0 0x7f9efc19cbd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9efc06c8c0 tx=0x7f9ee400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef3400640 1 -- 172.21.15.84:0/3946072134 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400cc40 con 0x7f9efc10b4f0 2024-09-21T02:40:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9efc1a2890 con 0x7f9efc10b4f0 2024-09-21T02:40:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef3400640 1 -- 172.21.15.84:0/3946072134 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ee400cde0 con 0x7f9efc10b4f0 2024-09-21T02:40:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9ef3400640 1 -- 172.21.15.84:0/3946072134 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4004a00 con 0x7f9efc10b4f0 2024-09-21T02:40:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.068+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9efc1a8ff0 con 0x7f9efc10b4f0 2024-09-21T02:40:39.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.069+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9efc105fc0 con 0x7f9efc10b4f0 2024-09-21T02:40:39.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.072+0000 7f9ef3400640 1 -- 172.21.15.84:0/3946072134 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9ee4005140 con 0x7f9efc10b4f0 2024-09-21T02:40:39.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.074+0000 7f9ef3400640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ee00b6510 0x7f9ee00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:39.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.074+0000 7f9ef3400640 1 -- 172.21.15.84:0/3946072134 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f9ee40e7560 con 0x7f9efc10b4f0 2024-09-21T02:40:39.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.074+0000 7f9ef9e00640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ee00b6510 0x7f9ee00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:39.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.075+0000 7f9ef9e00640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ee00b6510 0x7f9ee00b8a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009230 tx=0x7f9eec0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:39.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.075+0000 7f9ef3400640 1 -- 172.21.15.84:0/3946072134 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ee40adbe0 con 0x7f9efc10b4f0 2024-09-21T02:40:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.301+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f9efc10d680 con 0x7f9efc10b4f0 2024-09-21T02:40:39.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.359+0000 7f9ef3400640 1 -- 172.21.15.84:0/3946072134 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f9ee40b1fc0 con 0x7f9efc10b4f0 2024-09-21T02:40:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.362+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ee00b6510 msgr2=0x7f9ee00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.362+0000 7f9efb200640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ee00b6510 0x7f9ee00b8a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009230 tx=0x7f9eec0058d0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.362+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9efc10b4f0 msgr2=0x7f9efc19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.362+0000 7f9efb200640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9efc10b4f0 0x7f9efc19cbd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9efc06c8c0 tx=0x7f9ee400ee50 comp rx=0 tx=0).stop 2024-09-21T02:40:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.363+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 shutdown_connections 2024-09-21T02:40:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.363+0000 7f9efb200640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9efc10be40 0x7f9efc1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.363+0000 7f9efb200640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9efc10b4f0 0x7f9efc19cbd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.363+0000 7f9efb200640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ee00b6510 0x7f9ee00b8a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.363+0000 7f9efb200640 1 --2- 172.21.15.84:0/3946072134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9efc105bb0 0x7f9efc19c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.363+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 >> 172.21.15.84:0/3946072134 conn(0x7f9efc101680 msgr2=0x7f9efc103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.363+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 shutdown_connections 2024-09-21T02:40:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:39.363+0000 7f9efb200640 1 -- 172.21.15.84:0/3946072134 wait complete. 2024-09-21T02:40:39.702 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:39 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3946072134' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:40:39.702 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:39 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:40:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:39 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3946072134' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:40:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:39 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:40:39.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:39 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3946072134' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:40:39.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:39 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T02:40:40.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T02:40:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:40.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:40 smithi084 ceph-mon[30747]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T02:40:40.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:40 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T02:40:40.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:40 smithi084 ceph-mon[30747]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T02:40:40.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:40 smithi084 ceph-mon[30747]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:40.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:40 smithi084 ceph-mon[30747]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T02:40:40.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:40 smithi084 ceph-mon[30747]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T02:40:40.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:40 smithi084 ceph-mon[30747]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:40.636 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:40 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:40:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:40 smithi172 ceph-mon[35067]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T02:40:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:40 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T02:40:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:40 smithi172 ceph-mon[35067]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T02:40:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:40 smithi172 ceph-mon[35067]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:40 smithi172 ceph-mon[35067]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T02:40:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:40 smithi172 ceph-mon[35067]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T02:40:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:40 smithi172 ceph-mon[35067]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:40 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:40:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:40 smithi090 ceph-mon[34571]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T02:40:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:40 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T02:40:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:40 smithi090 ceph-mon[34571]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T02:40:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:40 smithi090 ceph-mon[34571]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T02:40:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:40 smithi090 ceph-mon[34571]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T02:40:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:40 smithi090 ceph-mon[34571]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T02:40:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:40 smithi090 ceph-mon[34571]: pgmap v343: 129 pgs: 129 active+clean; 581 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:40:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:40 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:40:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 -- 172.21.15.84:0/4217738208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac103990 msgr2=0x7fbbac103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 --2- 172.21.15.84:0/4217738208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac103990 0x7fbbac103da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009900 tx=0x7fbb9c02a410 comp rx=0 tx=0).stop 2024-09-21T02:40:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 -- 172.21.15.84:0/4217738208 shutdown_connections 2024-09-21T02:40:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 --2- 172.21.15.84:0/4217738208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbac1092d0 0x7fbbac1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 --2- 172.21.15.84:0/4217738208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac109c20 0x7fbbac110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 --2- 172.21.15.84:0/4217738208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac103990 0x7fbbac103da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 -- 172.21.15.84:0/4217738208 >> 172.21.15.84:0/4217738208 conn(0x7fbbac0ff440 msgr2=0x7fbbac101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 -- 172.21.15.84:0/4217738208 shutdown_connections 2024-09-21T02:40:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.144+0000 7fbbab200640 1 -- 172.21.15.84:0/4217738208 wait complete. 2024-09-21T02:40:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.145+0000 7fbbab200640 1 Processor -- start 2024-09-21T02:40:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.145+0000 7fbbab200640 1 -- start start 2024-09-21T02:40:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.145+0000 7fbbab200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac103990 0x7fbbac19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.145+0000 7fbbab200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac1092d0 0x7fbbac19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.145+0000 7fbbab200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbac109c20 0x7fbbac1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbbab200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac113a50 con 0x7fbbac103990 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbbab200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac1138d0 con 0x7fbbac1092d0 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbbab200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac113bd0 con 0x7fbbac109c20 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac103990 0x7fbbac19c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac1092d0 0x7fbbac19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac1092d0 0x7fbbac19cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:57306/0 (socket says 172.21.15.84:57306) 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9400640 1 -- 172.21.15.84:0/2841821170 learned_addr learned my addr 172.21.15.84:0/2841821170 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbbaa800640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbac109c20 0x7fbbac1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9400640 1 -- 172.21.15.84:0/2841821170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbac109c20 msgr2=0x7fbbac1a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9400640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbac109c20 0x7fbbac1a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9400640 1 -- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac103990 msgr2=0x7fbbac19c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9400640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac103990 0x7fbbac19c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:41.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.146+0000 7fbba9400640 1 -- 172.21.15.84:0/2841821170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac1a25b0 con 0x7fbbac1092d0 2024-09-21T02:40:41.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.147+0000 7fbba9400640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac1092d0 0x7fbbac19cbe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800d740 tx=0x7fbb9800dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:41.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.147+0000 7fbba2a00640 1 -- 172.21.15.84:0/2841821170 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98017070 con 0x7fbbac1092d0 2024-09-21T02:40:41.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.147+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac1a28a0 con 0x7fbbac1092d0 2024-09-21T02:40:41.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.147+0000 7fbba2a00640 1 -- 172.21.15.84:0/2841821170 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb9800de50 con 0x7fbbac1092d0 2024-09-21T02:40:41.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.147+0000 7fbba2a00640 1 -- 172.21.15.84:0/2841821170 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800f620 con 0x7fbbac1092d0 2024-09-21T02:40:41.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.147+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac1a9000 con 0x7fbbac1092d0 2024-09-21T02:40:41.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.149+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbac103da0 con 0x7fbbac1092d0 2024-09-21T02:40:41.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.151+0000 7fbba2a00640 1 -- 172.21.15.84:0/2841821170 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbb9801a070 con 0x7fbbac1092d0 2024-09-21T02:40:41.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.153+0000 7fbba2a00640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb900b6590 0x7fbb900b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:41.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.153+0000 7fbba2a00640 1 -- 172.21.15.84:0/2841821170 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fbb980e6e20 con 0x7fbbac1092d0 2024-09-21T02:40:41.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.153+0000 7fbba9e00640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb900b6590 0x7fbb900b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.154+0000 7fbba9e00640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb900b6590 0x7fbb900b8aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c006010 tx=0x7fbb9c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:41.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.157+0000 7fbba2a00640 1 -- 172.21.15.84:0/2841821170 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb980b17f0 con 0x7fbbac1092d0 2024-09-21T02:40:41.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:41.406+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fbbac1a92e0 con 0x7fbbac1092d0 2024-09-21T02:40:41.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:41 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] up:active 2024-09-21T02:40:41.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:41 smithi084 ceph-mon[30747]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T02:40:41.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:41 smithi084 ceph-mon[30747]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T02:40:41.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:41 smithi084 ceph-mon[30747]: Cluster is now healthy 2024-09-21T02:40:41.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:41 smithi084 ceph-mon[30747]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T02:40:41.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:41 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T02:40:41.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:41 smithi084 ceph-mon[30747]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T02:40:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:41 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] up:active 2024-09-21T02:40:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:41 smithi172 ceph-mon[35067]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T02:40:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:41 smithi172 ceph-mon[35067]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T02:40:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:41 smithi172 ceph-mon[35067]: Cluster is now healthy 2024-09-21T02:40:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:41 smithi172 ceph-mon[35067]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T02:40:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:41 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T02:40:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:41 smithi172 ceph-mon[35067]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T02:40:41.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:41 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] up:active 2024-09-21T02:40:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:41 smithi090 ceph-mon[34571]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T02:40:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:41 smithi090 ceph-mon[34571]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T02:40:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:41 smithi090 ceph-mon[34571]: Cluster is now healthy 2024-09-21T02:40:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:41 smithi090 ceph-mon[34571]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T02:40:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:41 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T02:40:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:41 smithi090 ceph-mon[34571]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T02:40:42.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.395+0000 7fbba2a00640 1 -- 172.21.15.84:0/2841821170 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fbb980b6730 con 0x7fbbac1092d0 2024-09-21T02:40:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.402+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb900b6590 msgr2=0x7fbb900b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.402+0000 7fbbab200640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb900b6590 0x7fbb900b8aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c006010 tx=0x7fbb9c000bc0 comp rx=0 tx=0).stop 2024-09-21T02:40:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.402+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac1092d0 msgr2=0x7fbbac19cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:42.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.402+0000 7fbbab200640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac1092d0 0x7fbbac19cbe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800d740 tx=0x7fbb9800dc00 comp rx=0 tx=0).stop 2024-09-21T02:40:42.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.404+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 shutdown_connections 2024-09-21T02:40:42.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.404+0000 7fbbab200640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb900b6590 0x7fbb900b8aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:42.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.404+0000 7fbbab200640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbac109c20 0x7fbbac1a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:42.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.404+0000 7fbbab200640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbbac1092d0 0x7fbbac19cbe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:42.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.404+0000 7fbbab200640 1 --2- 172.21.15.84:0/2841821170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbac103990 0x7fbbac19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:42.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.404+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 >> 172.21.15.84:0/2841821170 conn(0x7fbbac0ff440 msgr2=0x7fbbac1088e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:42.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.404+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 shutdown_connections 2024-09-21T02:40:42.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:42.404+0000 7fbbab200640 1 -- 172.21.15.84:0/2841821170 wait complete. 2024-09-21T02:40:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] up:active 2024-09-21T02:40:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T02:40:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2841821170' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:40:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: pgmap v344: 129 pgs: 129 active+clean; 583 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:42 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] up:active 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2841821170' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-09-21T02:40:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-21T02:40:42.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-09-21T02:40:42.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: pgmap v344: 129 pgs: 129 active+clean; 583 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-21T02:40:42.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:42 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] up:active 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2841821170' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-09-21T02:40:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]} : dispatch 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: pgmap v344: 129 pgs: 129 active+clean; 583 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:42.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:42 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:43.219 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T02:40:43.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:40:43.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T02:40:43.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-21T02:40:43.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-21T02:40:43.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-21T02:40:43.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T02:40:43.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T02:40:43.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T02:40:43.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-21T02:40:43.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-21T02:40:43.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-21T02:40:43.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T02:40:43.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T02:40:43.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:43 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:40:43.630 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-21T02:40:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T02:40:43.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T02:40:43.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:43 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2024-09-21T02:40:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T02:40:43.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T02:40:43.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:43 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.247+0000 7f87d2e00640 1 -- 172.21.15.84:0/4069658719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87cc076100 msgr2=0x7f87cc10fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.247+0000 7f87d2e00640 1 --2- 172.21.15.84:0/4069658719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87cc076100 0x7f87cc10fb90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009900 tx=0x7f87b402a410 comp rx=0 tx=0).stop 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.248+0000 7f87d2e00640 1 -- 172.21.15.84:0/4069658719 shutdown_connections 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.248+0000 7f87d2e00640 1 --2- 172.21.15.84:0/4069658719 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87cc1100d0 0x7f87cc112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.248+0000 7f87d2e00640 1 --2- 172.21.15.84:0/4069658719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87cc076100 0x7f87cc10fb90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.248+0000 7f87d2e00640 1 --2- 172.21.15.84:0/4069658719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87cc0757b0 0x7f87cc075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.248+0000 7f87d2e00640 1 -- 172.21.15.84:0/4069658719 >> 172.21.15.84:0/4069658719 conn(0x7f87cc0ff5e0 msgr2=0x7f87cc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.248+0000 7f87d2e00640 1 -- 172.21.15.84:0/4069658719 shutdown_connections 2024-09-21T02:40:44.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.248+0000 7f87d2e00640 1 -- 172.21.15.84:0/4069658719 wait complete. 2024-09-21T02:40:44.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.249+0000 7f87d2e00640 1 Processor -- start 2024-09-21T02:40:44.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.249+0000 7f87d2e00640 1 -- start start 2024-09-21T02:40:44.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87d2e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87cc0757b0 0x7f87cc19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87d2e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87cc076100 0x7f87cc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87d2e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87cc1100d0 0x7f87cc1a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87d2e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc115df0 con 0x7f87cc1100d0 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87d2e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc115c70 con 0x7f87cc0757b0 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87d2e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc115f70 con 0x7f87cc076100 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87cc0757b0 0x7f87cc19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87d0e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87cc1100d0 0x7f87cc1a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87cbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87cc0757b0 0x7f87cc19c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:57332/0 (socket says 172.21.15.84:57332) 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87cbe00640 1 -- 172.21.15.84:0/1227071961 learned_addr learned my addr 172.21.15.84:0/1227071961 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:44.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87c3e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87cc076100 0x7f87cc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.250+0000 7f87cbe00640 1 -- 172.21.15.84:0/1227071961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87cc076100 msgr2=0x7f87cc19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.251+0000 7f87cbe00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87cc076100 0x7f87cc19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.251+0000 7f87cbe00640 1 -- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87cc1100d0 msgr2=0x7f87cc1a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.251+0000 7f87cbe00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87cc1100d0 0x7f87cc1a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.251+0000 7f87cbe00640 1 -- 172.21.15.84:0/1227071961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc1a2730 con 0x7f87cc0757b0 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.251+0000 7f87cbe00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87cc0757b0 0x7f87cc19c7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00e9f0 tx=0x7f87bc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.251+0000 7f87c9600640 1 -- 172.21.15.84:0/1227071961 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00ccc0 con 0x7f87cc0757b0 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.251+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87cc1a2a20 con 0x7f87cc0757b0 2024-09-21T02:40:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.252+0000 7f87c9600640 1 -- 172.21.15.84:0/1227071961 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f87bc00ce60 con 0x7f87cc0757b0 2024-09-21T02:40:44.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.252+0000 7f87c9600640 1 -- 172.21.15.84:0/1227071961 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc010690 con 0x7f87cc0757b0 2024-09-21T02:40:44.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.252+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87cc1a9180 con 0x7f87cc0757b0 2024-09-21T02:40:44.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.253+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87cc075bc0 con 0x7f87cc0757b0 2024-09-21T02:40:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.255+0000 7f87c9600640 1 -- 172.21.15.84:0/1227071961 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f87bc0046c0 con 0x7f87cc0757b0 2024-09-21T02:40:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.257+0000 7f87c9600640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f87b00b6590 0x7f87b00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.257+0000 7f87c9600640 1 -- 172.21.15.84:0/1227071961 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f87bc0e7bd0 con 0x7f87cc0757b0 2024-09-21T02:40:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.257+0000 7f87c3e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f87b00b6590 0x7f87b00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.258+0000 7f87c3e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f87b00b6590 0x7f87b00b8aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f87b4004770 tx=0x7f87b4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.259+0000 7f87c9600640 1 -- 172.21.15.84:0/1227071961 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87bc0ae0a0 con 0x7f87cc0757b0 2024-09-21T02:40:44.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:44.514+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f87cc1a9460 con 0x7f87cc0757b0 2024-09-21T02:40:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:44 smithi172 ceph-mon[35067]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T02:40:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:44.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:44.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:44 smithi172 ceph-mon[35067]: pgmap v347: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 8 op/s 2024-09-21T02:40:44.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:40:44.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:40:44.759 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:44 smithi084 ceph-mon[30747]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T02:40:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:44 smithi084 ceph-mon[30747]: pgmap v347: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 8 op/s 2024-09-21T02:40:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:40:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:40:44.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:44 smithi090 ceph-mon[34571]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T02:40:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:44 smithi090 ceph-mon[34571]: pgmap v347: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 8 op/s 2024-09-21T02:40:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:40:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:40:44.768 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:40:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.476+0000 7f87c9600640 1 -- 172.21.15.84:0/1227071961 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f87bc0b2480 con 0x7f87cc0757b0 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f87b00b6590 msgr2=0x7f87b00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f87b00b6590 0x7f87b00b8aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f87b4004770 tx=0x7f87b4000bc0 comp rx=0 tx=0).stop 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87cc0757b0 msgr2=0x7f87cc19c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87cc0757b0 0x7f87cc19c7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00e9f0 tx=0x7f87bc00edf0 comp rx=0 tx=0).stop 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 shutdown_connections 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f87b00b6590 0x7f87b00b8aa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87cc076100 0x7f87cc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87cc1100d0 0x7f87cc1a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 --2- 172.21.15.84:0/1227071961 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87cc0757b0 0x7f87cc19c7c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.479+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 >> 172.21.15.84:0/1227071961 conn(0x7f87cc0ff5e0 msgr2=0x7f87cc109be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:45.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.480+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 shutdown_connections 2024-09-21T02:40:45.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:45.480+0000 7f87d2e00640 1 -- 172.21.15.84:0/1227071961 wait complete. 2024-09-21T02:40:45.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:45 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1227071961' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:40:45.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:45 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:40:45.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:45 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1227071961' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:40:45.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:45 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:40:45.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:45 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1227071961' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:40:45.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:45 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T02:40:46.287 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-21T02:40:46.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T02:40:46.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:46 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:40:46.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:46 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:40:46.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:46 smithi084 ceph-mon[30747]: pgmap v348: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:46.659 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:46.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:46 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:40:46.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:46 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:40:46.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:46 smithi172 ceph-mon[35067]: pgmap v348: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:46 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T02:40:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:46 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:40:46.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:46 smithi090 ceph-mon[34571]: pgmap v348: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 -- 172.21.15.84:0/71400387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 msgr2=0x7fe9300761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 --2- 172.21.15.84:0/71400387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 0x7fe9300761e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe918009900 tx=0x7fe91802a410 comp rx=0 tx=0).stop 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 -- 172.21.15.84:0/71400387 shutdown_connections 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 --2- 172.21.15.84:0/71400387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe930114430 0x7fe930116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 --2- 172.21.15.84:0/71400387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 0x7fe9300761e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 --2- 172.21.15.84:0/71400387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe930077380 0x7fe9300757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 -- 172.21.15.84:0/71400387 >> 172.21.15.84:0/71400387 conn(0x7fe93007b850 msgr2=0x7fe93007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 -- 172.21.15.84:0/71400387 shutdown_connections 2024-09-21T02:40:47.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.256+0000 7fe937000640 1 -- 172.21.15.84:0/71400387 wait complete. 2024-09-21T02:40:47.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.257+0000 7fe937000640 1 Processor -- start 2024-09-21T02:40:47.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.257+0000 7fe937000640 1 -- start start 2024-09-21T02:40:47.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe937000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 0x7fe9301a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:47.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe937000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe930077380 0x7fe9301a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe937000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe930114430 0x7fe9301a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe937000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe93011a190 con 0x7fe930075dd0 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe937000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe93011a010 con 0x7fe930114430 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe937000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe93011a310 con 0x7fe930077380 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe92fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 0x7fe9301a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe92fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 0x7fe9301a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39040/0 (socket says 172.21.15.84:39040) 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe92fe00640 1 -- 172.21.15.84:0/1016636892 learned_addr learned my addr 172.21.15.84:0/1016636892 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe927400640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe930077380 0x7fe9301a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe935000640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe930114430 0x7fe9301a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:47.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe92fe00640 1 -- 172.21.15.84:0/1016636892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe930077380 msgr2=0x7fe9301a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe92fe00640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe930077380 0x7fe9301a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe92fe00640 1 -- 172.21.15.84:0/1016636892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe930114430 msgr2=0x7fe9301a6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.258+0000 7fe92fe00640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe930114430 0x7fe9301a6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.259+0000 7fe92fe00640 1 -- 172.21.15.84:0/1016636892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9301a6b30 con 0x7fe930075dd0 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.259+0000 7fe927400640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe930077380 0x7fe9301a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.259+0000 7fe92fe00640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 0x7fe9301a0bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe92000e9f0 tx=0x7fe92000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.259+0000 7fe92d600640 1 -- 172.21.15.84:0/1016636892 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92000cd80 con 0x7fe930075dd0 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.259+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9301a6e20 con 0x7fe930075dd0 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.259+0000 7fe92d600640 1 -- 172.21.15.84:0/1016636892 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9200054f0 con 0x7fe930075dd0 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.259+0000 7fe92d600640 1 -- 172.21.15.84:0/1016636892 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920010690 con 0x7fe930075dd0 2024-09-21T02:40:47.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.259+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9301ad580 con 0x7fe930075dd0 2024-09-21T02:40:47.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.260+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9300761e0 con 0x7fe930075dd0 2024-09-21T02:40:47.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.264+0000 7fe92d600640 1 -- 172.21.15.84:0/1016636892 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe9200046c0 con 0x7fe930075dd0 2024-09-21T02:40:47.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.266+0000 7fe92d600640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe9140b6590 0x7fe9140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:47.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.266+0000 7fe92d600640 1 -- 172.21.15.84:0/1016636892 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fe9200e7c40 con 0x7fe930075dd0 2024-09-21T02:40:47.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.266+0000 7fe927400640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe9140b6590 0x7fe9140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:47.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.267+0000 7fe927400640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe9140b6590 0x7fe9140b8aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe918000c00 tx=0x7fe918005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:47.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.268+0000 7fe92d600640 1 -- 172.21.15.84:0/1016636892 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe920056710 con 0x7fe930075dd0 2024-09-21T02:40:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.480+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe9301137b0 con 0x7fe9140b6590 2024-09-21T02:40:47.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.512+0000 7fe92d600640 1 -- 172.21.15.84:0/1016636892 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe9301137b0 con 0x7fe9140b6590 2024-09-21T02:40:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe9140b6590 msgr2=0x7fe9140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe9140b6590 0x7fe9140b8aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe918000c00 tx=0x7fe918005a20 comp rx=0 tx=0).stop 2024-09-21T02:40:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 msgr2=0x7fe9301a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 0x7fe9301a0bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe92000e9f0 tx=0x7fe92000edf0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 shutdown_connections 2024-09-21T02:40:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe9140b6590 0x7fe9140b8aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe930077380 0x7fe9301a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe930114430 0x7fe9301a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 --2- 172.21.15.84:0/1016636892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe930075dd0 0x7fe9301a0bc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:47.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 >> 172.21.15.84:0/1016636892 conn(0x7fe93007b850 msgr2=0x7fe9301130a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:47.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.515+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 shutdown_connections 2024-09-21T02:40:47.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:47.516+0000 7fe937000640 1 -- 172.21.15.84:0/1016636892 wait complete. 2024-09-21T02:40:47.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:47 smithi084 ceph-mon[30747]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:47.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:47 smithi084 ceph-mon[30747]: pgmap v349: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.0 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:47.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:40:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:40:47.487+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:40:47.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:40:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:40:47.487+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:40:47.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:40:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:40:47.487+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:40:47.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:40:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:40:47.487+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:40:47.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:40:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:40:47.487+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:40:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:47 smithi172 ceph-mon[35067]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:47 smithi172 ceph-mon[35067]: pgmap v349: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.0 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:48.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:47 smithi090 ceph-mon[34571]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:47 smithi090 ceph-mon[34571]: pgmap v349: 129 pgs: 1 peering, 128 active+clean; 584 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.0 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:48.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T02:40:48.642 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 -- 172.21.15.84:0/688663156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494810b4f0 msgr2=0x7f494810b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 --2- 172.21.15.84:0/688663156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494810b4f0 0x7f494810b900 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4930009900 tx=0x7f493002a410 comp rx=0 tx=0).stop 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 -- 172.21.15.84:0/688663156 shutdown_connections 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 --2- 172.21.15.84:0/688663156 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f494810be40 0x7f4948112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 --2- 172.21.15.84:0/688663156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f494810b4f0 0x7f494810b900 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 --2- 172.21.15.84:0/688663156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4948105bb0 0x7f4948105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 -- 172.21.15.84:0/688663156 >> 172.21.15.84:0/688663156 conn(0x7f4948101680 msgr2=0x7f4948103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 -- 172.21.15.84:0/688663156 shutdown_connections 2024-09-21T02:40:49.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.259+0000 7f4947200640 1 -- 172.21.15.84:0/688663156 wait complete. 2024-09-21T02:40:49.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.260+0000 7f4947200640 1 Processor -- start 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.260+0000 7f4947200640 1 -- start start 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f4947200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4948105bb0 0x7f494819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f4947200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494810b4f0 0x7f494819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f4947200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f494810be40 0x7f49481a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f4947200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4948115c70 con 0x7f4948105bb0 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f4947200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4948115af0 con 0x7f494810be40 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f4947200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4948115df0 con 0x7f494810b4f0 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f493d400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494810b4f0 0x7f494819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f4945e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4948105bb0 0x7f494819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f493d400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494810b4f0 0x7f494819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:33620/0 (socket says 172.21.15.84:33620) 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f493d400640 1 -- 172.21.15.84:0/859627115 learned_addr learned my addr 172.21.15.84:0/859627115 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:49.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.261+0000 7f4946800640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f494810be40 0x7f49481a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:49.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f4945e00640 1 -- 172.21.15.84:0/859627115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494810b4f0 msgr2=0x7f494819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:49.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f4945e00640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494810b4f0 0x7f494819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f4945e00640 1 -- 172.21.15.84:0/859627115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f494810be40 msgr2=0x7f49481a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:49.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f4945e00640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f494810be40 0x7f49481a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f4945e00640 1 -- 172.21.15.84:0/859627115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49481a2570 con 0x7f4948105bb0 2024-09-21T02:40:49.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f4945e00640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4948105bb0 0x7f494819c600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f493800e9f0 tx=0x7f493800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:49.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f493f400640 1 -- 172.21.15.84:0/859627115 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493800ccc0 con 0x7f4948105bb0 2024-09-21T02:40:49.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f493f400640 1 -- 172.21.15.84:0/859627115 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4938005020 con 0x7f4948105bb0 2024-09-21T02:40:49.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49481a2860 con 0x7f4948105bb0 2024-09-21T02:40:49.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f493f400640 1 -- 172.21.15.84:0/859627115 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49380049c0 con 0x7f4948105bb0 2024-09-21T02:40:49.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.262+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49481a8fc0 con 0x7f4948105bb0 2024-09-21T02:40:49.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.264+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4948105fc0 con 0x7f4948105bb0 2024-09-21T02:40:49.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.268+0000 7f493f400640 1 -- 172.21.15.84:0/859627115 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f49380051d0 con 0x7f4948105bb0 2024-09-21T02:40:49.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.269+0000 7f493f400640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f492c0b6620 0x7f492c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:49.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.269+0000 7f493f400640 1 -- 172.21.15.84:0/859627115 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f49380e77b0 con 0x7f4948105bb0 2024-09-21T02:40:49.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.269+0000 7f493d400640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f492c0b6620 0x7f492c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:49.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.270+0000 7f493d400640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f492c0b6620 0x7f492c0b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4948104f40 tx=0x7f4930009660 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:49.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.271+0000 7f493f400640 1 -- 172.21.15.84:0/859627115 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49380adc10 con 0x7f4948105bb0 2024-09-21T02:40:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.483+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4948063800 con 0x7f492c0b6620 2024-09-21T02:40:49.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.518+0000 7f493f400640 1 -- 172.21.15.84:0/859627115 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4948063800 con 0x7f492c0b6620 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f492c0b6620 msgr2=0x7f492c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f492c0b6620 0x7f492c0b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4948104f40 tx=0x7f4930009660 comp rx=0 tx=0).stop 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4948105bb0 msgr2=0x7f494819c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4948105bb0 0x7f494819c600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f493800e9f0 tx=0x7f493800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 shutdown_connections 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f492c0b6620 0x7f492c0b8b30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494810b4f0 0x7f494819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f494810be40 0x7f49481a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 --2- 172.21.15.84:0/859627115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4948105bb0 0x7f494819c600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 >> 172.21.15.84:0/859627115 conn(0x7f4948101680 msgr2=0x7f494810ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 shutdown_connections 2024-09-21T02:40:49.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:49.520+0000 7f4947200640 1 -- 172.21.15.84:0/859627115 wait complete. 2024-09-21T02:40:49.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:49 smithi084 ceph-mon[30747]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-09-21T02:40:49.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:49 smithi084 ceph-mon[30747]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:49.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:49 smithi084 ceph-mon[30747]: pgmap v350: 129 pgs: 129 active+clean; 584 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:50.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:49 smithi172 ceph-mon[35067]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-09-21T02:40:50.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:49 smithi172 ceph-mon[35067]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:50.009 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:49 smithi172 ceph-mon[35067]: pgmap v350: 129 pgs: 129 active+clean; 584 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:50.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:49 smithi090 ceph-mon[34571]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-09-21T02:40:50.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:49 smithi090 ceph-mon[34571]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:50.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:49 smithi090 ceph-mon[34571]: pgmap v350: 129 pgs: 129 active+clean; 584 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:50.294 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T02:40:50.662 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:51.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 -- 172.21.15.84:0/2229020334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f995410b6c0 msgr2=0x7f995410bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 --2- 172.21.15.84:0/2229020334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f995410b6c0 0x7f995410bad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9940009900 tx=0x7f994002a410 comp rx=0 tx=0).stop 2024-09-21T02:40:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 -- 172.21.15.84:0/2229020334 shutdown_connections 2024-09-21T02:40:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 --2- 172.21.15.84:0/2229020334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f995410c010 0x7f9954112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 --2- 172.21.15.84:0/2229020334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f995410b6c0 0x7f995410bad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 --2- 172.21.15.84:0/2229020334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9954105d80 0x7f9954106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 -- 172.21.15.84:0/2229020334 >> 172.21.15.84:0/2229020334 conn(0x7f9954101810 msgr2=0x7f9954103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:51.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 -- 172.21.15.84:0/2229020334 shutdown_connections 2024-09-21T02:40:51.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.292+0000 7f995c600640 1 -- 172.21.15.84:0/2229020334 wait complete. 2024-09-21T02:40:51.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.293+0000 7f995c600640 1 Processor -- start 2024-09-21T02:40:51.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.293+0000 7f995c600640 1 -- start start 2024-09-21T02:40:51.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995c600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9954105d80 0x7f995419c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:51.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f995410b6c0 0x7f995419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:51.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995c600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995410c010 0x7f99541a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:51.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9954115df0 con 0x7f995410b6c0 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995c600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9954115c70 con 0x7f995410c010 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995c600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9954115f70 con 0x7f9954105d80 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f9959200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f995410b6c0 0x7f995419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995a600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995410c010 0x7f99541a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995a600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995410c010 0x7f99541a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:55312/0 (socket says 172.21.15.84:55312) 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995a600640 1 -- 172.21.15.84:0/681333745 learned_addr learned my addr 172.21.15.84:0/681333745 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f9959c00640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9954105d80 0x7f995419c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995a600640 1 -- 172.21.15.84:0/681333745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9954105d80 msgr2=0x7f995419c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995a600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9954105d80 0x7f995419c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995a600640 1 -- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f995410b6c0 msgr2=0x7f995419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995a600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f995410b6c0 0x7f995419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.294+0000 7f995a600640 1 -- 172.21.15.84:0/681333745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99541a2710 con 0x7f995410c010 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.295+0000 7f995a600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995410c010 0x7f99541a1fe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f994c00e970 tx=0x7f994c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.295+0000 7f9952000640 1 -- 172.21.15.84:0/681333745 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c00ccc0 con 0x7f995410c010 2024-09-21T02:40:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.295+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99541a2a00 con 0x7f995410c010 2024-09-21T02:40:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.295+0000 7f9952000640 1 -- 172.21.15.84:0/681333745 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f994c00ce60 con 0x7f995410c010 2024-09-21T02:40:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.295+0000 7f9952000640 1 -- 172.21.15.84:0/681333745 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c010430 con 0x7f995410c010 2024-09-21T02:40:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.295+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99541a9160 con 0x7f995410c010 2024-09-21T02:40:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.296+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9954106190 con 0x7f995410c010 2024-09-21T02:40:51.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.300+0000 7f9952000640 1 -- 172.21.15.84:0/681333745 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f994c005000 con 0x7f995410c010 2024-09-21T02:40:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.302+0000 7f9952000640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f993c0b65a0 0x7f993c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.302+0000 7f9959c00640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f993c0b65a0 0x7f993c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.302+0000 7f9952000640 1 -- 172.21.15.84:0/681333745 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f994c0e7e20 con 0x7f995410c010 2024-09-21T02:40:51.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.302+0000 7f9952000640 1 -- 172.21.15.84:0/681333745 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f994c0ae190 con 0x7f995410c010 2024-09-21T02:40:51.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.303+0000 7f9959c00640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f993c0b65a0 0x7f993c0b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99480099a0 tx=0x7f9948009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:51.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.518+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f9954063800 con 0x7f993c0b65a0 2024-09-21T02:40:51.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.525+0000 7f9952000640 1 -- 172.21.15.84:0/681333745 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9954063800 con 0x7f993c0b65a0 2024-09-21T02:40:51.528 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/qa/sv_0/7a67f660-57b4-45d0-9c98-fe716441c512 2024-09-21T02:40:51.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f993c0b65a0 msgr2=0x7f993c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:51.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f993c0b65a0 0x7f993c0b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99480099a0 tx=0x7f9948009500 comp rx=0 tx=0).stop 2024-09-21T02:40:51.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995410c010 msgr2=0x7f99541a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:51.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995410c010 0x7f99541a1fe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f994c00e970 tx=0x7f994c00ed70 comp rx=0 tx=0).stop 2024-09-21T02:40:51.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 shutdown_connections 2024-09-21T02:40:51.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f995410c010 0x7f99541a1fe0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f995410b6c0 0x7f995419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f993c0b65a0 0x7f993c0b8ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 --2- 172.21.15.84:0/681333745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9954105d80 0x7f995419c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:51.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 >> 172.21.15.84:0/681333745 conn(0x7f9954101810 msgr2=0x7f9954108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:51.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 shutdown_connections 2024-09-21T02:40:51.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:51.528+0000 7f995c600640 1 -- 172.21.15.84:0/681333745 wait complete. 2024-09-21T02:40:51.887 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:51 smithi084 ceph-mon[30747]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:51.887 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:51 smithi084 ceph-mon[30747]: pgmap v351: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:51 smithi172 ceph-mon[35067]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:51 smithi172 ceph-mon[35067]: pgmap v351: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:52.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:51 smithi090 ceph-mon[34571]: from='client.24890 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:52.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:51 smithi090 ceph-mon[34571]: pgmap v351: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.2 KiB/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:52.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T02:40:52.611 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 -- 172.21.15.84:0/278280287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 msgr2=0x7fca8c10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 --2- 172.21.15.84:0/278280287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 0x7fca8c10d670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca78009900 tx=0x7fca7802a410 comp rx=0 tx=0).stop 2024-09-21T02:40:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 -- 172.21.15.84:0/278280287 shutdown_connections 2024-09-21T02:40:53.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 --2- 172.21.15.84:0/278280287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca8c10dc30 0x7fca8c110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 --2- 172.21.15.84:0/278280287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 0x7fca8c10d670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 --2- 172.21.15.84:0/278280287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca8c1047d0 0x7fca8c104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 -- 172.21.15.84:0/278280287 >> 172.21.15.84:0/278280287 conn(0x7fca8c0fe2d0 msgr2=0x7fca8c100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 -- 172.21.15.84:0/278280287 shutdown_connections 2024-09-21T02:40:53.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.217+0000 7fca8be00640 1 -- 172.21.15.84:0/278280287 wait complete. 2024-09-21T02:40:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.218+0000 7fca8be00640 1 Processor -- start 2024-09-21T02:40:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.218+0000 7fca8be00640 1 -- start start 2024-09-21T02:40:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.218+0000 7fca8be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca8c1047d0 0x7fca8c102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 0x7fca8c102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca8c10dc30 0x7fca8c102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c113a00 con 0x7fca8c105120 2024-09-21T02:40:53.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c113880 con 0x7fca8c10dc30 2024-09-21T02:40:53.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c113b80 con 0x7fca8c1047d0 2024-09-21T02:40:53.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 0x7fca8c102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:53.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 0x7fca8c102a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54538/0 (socket says 172.21.15.84:54538) 2024-09-21T02:40:53.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8a000640 1 -- 172.21.15.84:0/731619346 learned_addr learned my addr 172.21.15.84:0/731619346 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:53.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8aa00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca8c1047d0 0x7fca8c102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:53.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8b400640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca8c10dc30 0x7fca8c102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8a000640 1 -- 172.21.15.84:0/731619346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca8c1047d0 msgr2=0x7fca8c102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8a000640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca8c1047d0 0x7fca8c102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8a000640 1 -- 172.21.15.84:0/731619346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca8c10dc30 msgr2=0x7fca8c102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8a000640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca8c10dc30 0x7fca8c102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.219+0000 7fca8a000640 1 -- 172.21.15.84:0/731619346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c1a86d0 con 0x7fca8c105120 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.220+0000 7fca8a000640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 0x7fca8c102a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca7802aa00 tx=0x7fca78003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.220+0000 7fca83400640 1 -- 172.21.15.84:0/731619346 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7803f070 con 0x7fca8c105120 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.220+0000 7fca83400640 1 -- 172.21.15.84:0/731619346 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fca78031be0 con 0x7fca8c105120 2024-09-21T02:40:53.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.220+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c1a8960 con 0x7fca8c105120 2024-09-21T02:40:53.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.220+0000 7fca83400640 1 -- 172.21.15.84:0/731619346 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78035030 con 0x7fca8c105120 2024-09-21T02:40:53.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.220+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c1a8e40 con 0x7fca8c105120 2024-09-21T02:40:53.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.221+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca8c104be0 con 0x7fca8c105120 2024-09-21T02:40:53.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.224+0000 7fca83400640 1 -- 172.21.15.84:0/731619346 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fca78042070 con 0x7fca8c105120 2024-09-21T02:40:53.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.225+0000 7fca83400640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fca700b65a0 0x7fca700b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:53.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.225+0000 7fca83400640 1 -- 172.21.15.84:0/731619346 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fca781085f0 con 0x7fca8c105120 2024-09-21T02:40:53.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.225+0000 7fca8aa00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fca700b65a0 0x7fca700b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:53.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.226+0000 7fca8aa00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fca700b65a0 0x7fca700b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca8c103f60 tx=0x7fca7c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:53.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.227+0000 7fca83400640 1 -- 172.21.15.84:0/731619346 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca780d2d40 con 0x7fca8c105120 2024-09-21T02:40:53.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.439+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fca8c107e60 con 0x7fca700b65a0 2024-09-21T02:40:53.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.473+0000 7fca83400640 1 -- 172.21.15.84:0/731619346 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fca8c107e60 con 0x7fca700b65a0 2024-09-21T02:40:53.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.475+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fca700b65a0 msgr2=0x7fca700b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:53.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.475+0000 7fca8be00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fca700b65a0 0x7fca700b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca8c103f60 tx=0x7fca7c005f90 comp rx=0 tx=0).stop 2024-09-21T02:40:53.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 msgr2=0x7fca8c102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:53.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 0x7fca8c102a50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca7802aa00 tx=0x7fca78003b90 comp rx=0 tx=0).stop 2024-09-21T02:40:53.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 shutdown_connections 2024-09-21T02:40:53.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca8c10dc30 0x7fca8c102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c105120 0x7fca8c102a50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fca700b65a0 0x7fca700b8ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 --2- 172.21.15.84:0/731619346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca8c1047d0 0x7fca8c102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:53.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 >> 172.21.15.84:0/731619346 conn(0x7fca8c0fe2d0 msgr2=0x7fca8c107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:53.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 shutdown_connections 2024-09-21T02:40:53.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:53.476+0000 7fca8be00640 1 -- 172.21.15.84:0/731619346 wait complete. 2024-09-21T02:40:53.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:53 smithi084 ceph-mon[30747]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:53.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:53 smithi084 ceph-mon[30747]: pgmap v352: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.8 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:53 smithi172 ceph-mon[35067]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:53 smithi172 ceph-mon[35067]: pgmap v352: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.8 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:54.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:53 smithi090 ceph-mon[34571]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:54.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:53 smithi090 ceph-mon[34571]: pgmap v352: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.8 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:54.176 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T02:40:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.184+0000 7f9e5ce00640 1 -- 172.21.15.84:0/3097529587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58109e10 msgr2=0x7f9e58110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.184+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/3097529587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58109e10 0x7f9e58110640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009ca0 tx=0x7f9e5002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.184+0000 7f9e5ce00640 1 -- 172.21.15.84:0/3097529587 shutdown_connections 2024-09-21T02:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.184+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/3097529587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58109e10 0x7f9e58110640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.184+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/3097529587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e581094c0 0x7f9e581098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.184+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/3097529587 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e58103b80 0x7f9e58103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.184+0000 7f9e5ce00640 1 -- 172.21.15.84:0/3097529587 >> 172.21.15.84:0/3097529587 conn(0x7f9e580ff5d0 msgr2=0x7f9e58101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:55.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.185+0000 7f9e5ce00640 1 -- 172.21.15.84:0/3097529587 shutdown_connections 2024-09-21T02:40:55.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.185+0000 7f9e5ce00640 1 -- 172.21.15.84:0/3097529587 wait complete. 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.186+0000 7f9e5ce00640 1 Processor -- start 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.186+0000 7f9e5ce00640 1 -- start start 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.186+0000 7f9e5ce00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58103b80 0x7f9e58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.186+0000 7f9e5ce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e581094c0 0x7f9e58075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.186+0000 7f9e5ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e58109e10 0x7f9e58076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.186+0000 7f9e5ce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58113c10 con 0x7f9e58109e10 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.186+0000 7f9e5ce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58113a90 con 0x7f9e581094c0 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.186+0000 7f9e5ce00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58113d90 con 0x7f9e58103b80 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e55e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58103b80 0x7f9e58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e55e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58103b80 0x7f9e58075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:45774/0 (socket says 172.21.15.84:45774) 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e55e00640 1 -- 172.21.15.84:0/2607321854 learned_addr learned my addr 172.21.15.84:0/2607321854 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:55.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e56800640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e58109e10 0x7f9e58076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:55.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e4d400640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e581094c0 0x7f9e58075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e55e00640 1 -- 172.21.15.84:0/2607321854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e581094c0 msgr2=0x7f9e58075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e55e00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e581094c0 0x7f9e58075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e55e00640 1 -- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e58109e10 msgr2=0x7f9e58076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e55e00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e58109e10 0x7f9e58076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.187+0000 7f9e55e00640 1 -- 172.21.15.84:0/2607321854 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e581a8820 con 0x7f9e58103b80 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.188+0000 7f9e55e00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58103b80 0x7f9e58075710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800e9f0 tx=0x7f9e4800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.188+0000 7f9e4f400640 1 -- 172.21.15.84:0/2607321854 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800cd80 con 0x7f9e58103b80 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.188+0000 7f9e4f400640 1 -- 172.21.15.84:0/2607321854 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e480054f0 con 0x7f9e58103b80 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.188+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e581a8b10 con 0x7f9e58103b80 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.188+0000 7f9e4f400640 1 -- 172.21.15.84:0/2607321854 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48010690 con 0x7f9e58103b80 2024-09-21T02:40:55.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.188+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e581a9000 con 0x7f9e58103b80 2024-09-21T02:40:55.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.189+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e58103f90 con 0x7f9e58103b80 2024-09-21T02:40:55.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.192+0000 7f9e4f400640 1 -- 172.21.15.84:0/2607321854 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9e480046c0 con 0x7f9e58103b80 2024-09-21T02:40:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.193+0000 7f9e4f400640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e3c0b65a0 0x7f9e3c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.193+0000 7f9e4f400640 1 -- 172.21.15.84:0/2607321854 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f9e480e7d80 con 0x7f9e58103b80 2024-09-21T02:40:55.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.193+0000 7f9e4d400640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e3c0b65a0 0x7f9e3c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:55.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.194+0000 7f9e4d400640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e3c0b65a0 0x7f9e3c0b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e58102e20 tx=0x7f9e40005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:55.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.195+0000 7f9e4f400640 1 -- 172.21.15.84:0/2607321854 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e480ae150 con 0x7f9e58103b80 2024-09-21T02:40:55.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.409+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f9e58063800 con 0x7f9e3c0b65a0 2024-09-21T02:40:55.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.415+0000 7f9e4f400640 1 -- 172.21.15.84:0/2607321854 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9e58063800 con 0x7f9e3c0b65a0 2024-09-21T02:40:55.416 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/qa/sv_1/5d55f446-c258-45c4-954d-801cc1d5889f 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e3c0b65a0 msgr2=0x7f9e3c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e3c0b65a0 0x7f9e3c0b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e58102e20 tx=0x7f9e40005f90 comp rx=0 tx=0).stop 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58103b80 msgr2=0x7f9e58075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58103b80 0x7f9e58075710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800e9f0 tx=0x7f9e4800edf0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 shutdown_connections 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e58109e10 0x7f9e58076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e581094c0 0x7f9e58075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e3c0b65a0 0x7f9e3c0b8ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 --2- 172.21.15.84:0/2607321854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e58103b80 0x7f9e58075710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:55.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.417+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 >> 172.21.15.84:0/2607321854 conn(0x7f9e580ff5d0 msgr2=0x7f9e58106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:55.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.418+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 shutdown_connections 2024-09-21T02:40:55.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:55.418+0000 7f9e5ce00640 1 -- 172.21.15.84:0/2607321854 wait complete. 2024-09-21T02:40:56.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:55 smithi172 ceph-mon[35067]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:56.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:55 smithi172 ceph-mon[35067]: pgmap v353: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:56.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:55 smithi084 ceph-mon[30747]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:56.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:55 smithi084 ceph-mon[30747]: pgmap v353: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:56.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:55 smithi090 ceph-mon[34571]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:40:56.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:55 smithi090 ceph-mon[34571]: pgmap v353: 129 pgs: 129 active+clean; 607 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:56.146 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:40:56.527 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 -- 172.21.15.84:0/4289664103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410b6c0 msgr2=0x7f04e410bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 --2- 172.21.15.84:0/4289664103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410b6c0 0x7f04e410bad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009900 tx=0x7f04cc02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 -- 172.21.15.84:0/4289664103 shutdown_connections 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 --2- 172.21.15.84:0/4289664103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e410c010 0x7f04e4112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 --2- 172.21.15.84:0/4289664103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410b6c0 0x7f04e410bad0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 --2- 172.21.15.84:0/4289664103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04e4105d80 0x7f04e4106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 -- 172.21.15.84:0/4289664103 >> 172.21.15.84:0/4289664103 conn(0x7f04e4101810 msgr2=0x7f04e4103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 -- 172.21.15.84:0/4289664103 shutdown_connections 2024-09-21T02:40:57.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.323+0000 7f04e9200640 1 -- 172.21.15.84:0/4289664103 wait complete. 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.324+0000 7f04e9200640 1 Processor -- start 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.324+0000 7f04e9200640 1 -- start start 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e9200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04e4105d80 0x7f04e419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e9200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e410b6c0 0x7f04e419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410c010 0x7f04e41a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e9200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f04e4115e40 con 0x7f04e410c010 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e9200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04e4115cc0 con 0x7f04e4105d80 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e9200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04e4115fc0 con 0x7f04e410b6c0 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04e4105d80 0x7f04e419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410c010 0x7f04e41a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04e4105d80 0x7f04e419c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:55366/0 (socket says 172.21.15.84:55366) 2024-09-21T02:40:57.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e1e00640 1 -- 172.21.15.84:0/2734947211 learned_addr learned my addr 172.21.15.84:0/2734947211 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04d9400640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e410b6c0 0x7f04e419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e1e00640 1 -- 172.21.15.84:0/2734947211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e410b6c0 msgr2=0x7f04e419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e1e00640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e410b6c0 0x7f04e419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e1e00640 1 -- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410c010 msgr2=0x7f04e41a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e1e00640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410c010 0x7f04e41a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e1e00640 1 -- 172.21.15.84:0/2734947211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e41a2720 con 0x7f04e4105d80 2024-09-21T02:40:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.325+0000 7f04e2800640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410c010 0x7f04e41a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:40:57.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.326+0000 7f04e1e00640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04e4105d80 0x7f04e419c7b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f04d400e9f0 tx=0x7f04d400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.326+0000 7f04db400640 1 -- 172.21.15.84:0/2734947211 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d400ccc0 con 0x7f04e4105d80 2024-09-21T02:40:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.326+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e41a2a10 con 0x7f04e4105d80 2024-09-21T02:40:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.326+0000 7f04db400640 1 -- 172.21.15.84:0/2734947211 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04d4010900 con 0x7f04e4105d80 2024-09-21T02:40:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.326+0000 7f04db400640 1 -- 172.21.15.84:0/2734947211 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4018860 con 0x7f04e4105d80 2024-09-21T02:40:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.326+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e41a9170 con 0x7f04e4105d80 2024-09-21T02:40:57.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.327+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e4106190 con 0x7f04e4105d80 2024-09-21T02:40:57.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.330+0000 7f04db400640 1 -- 172.21.15.84:0/2734947211 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f04d4010ab0 con 0x7f04e4105d80 2024-09-21T02:40:57.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.331+0000 7f04db400640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f04c80b65a0 0x7f04c80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:57.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.331+0000 7f04db400640 1 -- 172.21.15.84:0/2734947211 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f04d40e7fc0 con 0x7f04e4105d80 2024-09-21T02:40:57.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.331+0000 7f04d9400640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f04c80b65a0 0x7f04c80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:57.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.332+0000 7f04d9400640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f04c80b65a0 0x7f04c80b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f04cc02a9e0 tx=0x7f04cc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:57.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.333+0000 7f04db400640 1 -- 172.21.15.84:0/2734947211 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f04d40ae330 con 0x7f04e4105d80 2024-09-21T02:40:57.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.560+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04e419d8e0 con 0x7f04e4105d80 2024-09-21T02:40:57.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.562+0000 7f04db400640 1 -- 172.21.15.84:0/2734947211 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11909 (secure 0 0 0) 0x7f04e419d8e0 con 0x7f04e4105d80 2024-09-21T02:40:57.563 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:57.563 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"btime":"2024-09-21T02:40:45:465332+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:40:44.516130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:40:57.564 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-09-21T02:40:57.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f04c80b65a0 msgr2=0x7f04c80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f04c80b65a0 0x7f04c80b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f04cc02a9e0 tx=0x7f04cc000bc0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04e4105d80 msgr2=0x7f04e419c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04e4105d80 0x7f04e419c7b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f04d400e9f0 tx=0x7f04d400edf0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 shutdown_connections 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f04c80b65a0 0x7f04c80b8ab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e410b6c0 0x7f04e419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04e410c010 0x7f04e41a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 --2- 172.21.15.84:0/2734947211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04e4105d80 0x7f04e419c7b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.564+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 >> 172.21.15.84:0/2734947211 conn(0x7f04e4101810 msgr2=0x7f04e410ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.565+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 shutdown_connections 2024-09-21T02:40:57.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:57.565+0000 7f04e9200640 1 -- 172.21.15.84:0/2734947211 wait complete. 2024-09-21T02:40:57.927 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:57 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2734947211' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:57 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2734947211' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:58.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:57 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2734947211' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:40:58.296 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:40:58.666 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:40:58.917 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:58 smithi090 ceph-mon[34571]: pgmap v354: 129 pgs: 129 active+clean; 633 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:58.997 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:58 smithi084 ceph-mon[30747]: pgmap v354: 129 pgs: 129 active+clean; 633 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:59.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:58 smithi172 ceph-mon[35067]: pgmap v354: 129 pgs: 129 active+clean; 633 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 -- 172.21.15.84:0/30334867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54078290 msgr2=0x7f6f54114030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 --2- 172.21.15.84:0/30334867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54078290 0x7f6f54114030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009860 tx=0x7f6f3c02a340 comp rx=0 tx=0).stop 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 -- 172.21.15.84:0/30334867 shutdown_connections 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 --2- 172.21.15.84:0/30334867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54114570 0x7f6f54116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 --2- 172.21.15.84:0/30334867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54078290 0x7f6f54114030 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 --2- 172.21.15.84:0/30334867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f54077940 0x7f6f54077d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 -- 172.21.15.84:0/30334867 >> 172.21.15.84:0/30334867 conn(0x7f6f54101680 msgr2=0x7f6f54103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 -- 172.21.15.84:0/30334867 shutdown_connections 2024-09-21T02:40:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.338+0000 7f6f53e00640 1 -- 172.21.15.84:0/30334867 wait complete. 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.339+0000 7f6f53e00640 1 Processor -- start 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f53e00640 1 -- start start 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f53e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54077940 0x7f6f541a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f53e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f54078290 0x7f6f541a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f53e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54114570 0x7f6f541a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f53e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54119ff0 con 0x7f6f54078290 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f53e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54119e70 con 0x7f6f54114570 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f53e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5411a170 con 0x7f6f54077940 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f52a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54077940 0x7f6f541a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f52a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54077940 0x7f6f541a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:45796/0 (socket says 172.21.15.84:45796) 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.340+0000 7f6f52a00640 1 -- 172.21.15.84:0/901184102 learned_addr learned my addr 172.21.15.84:0/901184102 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:40:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f53400640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54114570 0x7f6f541a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f4a000640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f54078290 0x7f6f541a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f53400640 1 -- 172.21.15.84:0/901184102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54077940 msgr2=0x7f6f541a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f53400640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54077940 0x7f6f541a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f53400640 1 -- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f54078290 msgr2=0x7f6f541a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f53400640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f54078290 0x7f6f541a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f53400640 1 -- 172.21.15.84:0/901184102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f541a6930 con 0x7f6f54114570 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f53400640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54114570 0x7f6f541a6200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009fd0 tx=0x7f6f4c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.341+0000 7f6f4be00640 1 -- 172.21.15.84:0/901184102 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00ce20 con 0x7f6f54114570 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.342+0000 7f6f4be00640 1 -- 172.21.15.84:0/901184102 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6f4c005020 con 0x7f6f54114570 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.342+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f541a6c20 con 0x7f6f54114570 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.342+0000 7f6f4be00640 1 -- 172.21.15.84:0/901184102 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c010720 con 0x7f6f54114570 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.342+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f541ad380 con 0x7f6f54114570 2024-09-21T02:40:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.343+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f54077d50 con 0x7f6f54114570 2024-09-21T02:40:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.345+0000 7f6f4be00640 1 -- 172.21.15.84:0/901184102 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6f4c005560 con 0x7f6f54114570 2024-09-21T02:40:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.346+0000 7f6f4be00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f6f380b65a0 0x7f6f380b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:40:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.347+0000 7f6f4be00640 1 -- 172.21.15.84:0/901184102 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f6f4c0e7f00 con 0x7f6f54114570 2024-09-21T02:40:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.347+0000 7f6f52a00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f6f380b65a0 0x7f6f380b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:40:59.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.347+0000 7f6f52a00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f6f380b65a0 0x7f6f380b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f44005c80 tx=0x7f6f44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:40:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.353+0000 7f6f4be00640 1 -- 172.21.15.84:0/901184102 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f4c0ae270 con 0x7f6f54114570 2024-09-21T02:40:59.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.543+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f541a1af0 con 0x7f6f54114570 2024-09-21T02:40:59.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.544+0000 7f6f4be00640 1 -- 172.21.15.84:0/901184102 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24726 (secure 0 0 0) 0x7f6f541a1af0 con 0x7f6f54114570 2024-09-21T02:40:59.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:40:59.546 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:40:43.390340+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:40:59.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f6f380b65a0 msgr2=0x7f6f380b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:59.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f6f380b65a0 0x7f6f380b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f44005c80 tx=0x7f6f44009260 comp rx=0 tx=0).stop 2024-09-21T02:40:59.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54114570 msgr2=0x7f6f541a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:40:59.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54114570 0x7f6f541a6200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009fd0 tx=0x7f6f4c00ef10 comp rx=0 tx=0).stop 2024-09-21T02:40:59.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 shutdown_connections 2024-09-21T02:40:59.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f54114570 0x7f6f541a6200 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f54078290 0x7f6f541a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f6f380b65a0 0x7f6f380b8ab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 --2- 172.21.15.84:0/901184102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54077940 0x7f6f541a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:40:59.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 >> 172.21.15.84:0/901184102 conn(0x7f6f54101680 msgr2=0x7f6f54116620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:40:59.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.547+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 shutdown_connections 2024-09-21T02:40:59.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:40:59.548+0000 7f6f53e00640 1 -- 172.21.15.84:0/901184102 wait complete. 2024-09-21T02:40:59.908 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:40:59 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/901184102' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:40:59 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/901184102' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:00.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:40:59 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/901184102' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:00.320 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T02:41:00.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:41:00.690 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:01.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:00 smithi172 ceph-mon[35067]: pgmap v355: 129 pgs: 129 active+clean; 633 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 7 op/s 2024-09-21T02:41:01.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:00 smithi090 ceph-mon[34571]: pgmap v355: 129 pgs: 129 active+clean; 633 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 7 op/s 2024-09-21T02:41:01.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:00 smithi084 ceph-mon[30747]: pgmap v355: 129 pgs: 129 active+clean; 633 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 7 op/s 2024-09-21T02:41:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.405+0000 7f8f25800640 1 -- 172.21.15.84:0/3475633259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f201047c0 msgr2=0x7f8f20104bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.405+0000 7f8f25800640 1 --2- 172.21.15.84:0/3475633259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f201047c0 0x7f8f20104bd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009ca0 tx=0x7f8f1002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.406+0000 7f8f25800640 1 -- 172.21.15.84:0/3475633259 shutdown_connections 2024-09-21T02:41:01.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.406+0000 7f8f25800640 1 --2- 172.21.15.84:0/3475633259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f2010dc20 0x7f8f20110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.406+0000 7f8f25800640 1 --2- 172.21.15.84:0/3475633259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f20105110 0x7f8f2010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.406+0000 7f8f25800640 1 --2- 172.21.15.84:0/3475633259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f201047c0 0x7f8f20104bd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.406+0000 7f8f25800640 1 -- 172.21.15.84:0/3475633259 >> 172.21.15.84:0/3475633259 conn(0x7f8f200fe2c0 msgr2=0x7f8f20100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.406+0000 7f8f25800640 1 -- 172.21.15.84:0/3475633259 shutdown_connections 2024-09-21T02:41:01.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.406+0000 7f8f25800640 1 -- 172.21.15.84:0/3475633259 wait complete. 2024-09-21T02:41:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.407+0000 7f8f25800640 1 Processor -- start 2024-09-21T02:41:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.407+0000 7f8f25800640 1 -- start start 2024-09-21T02:41:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.407+0000 7f8f25800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f201047c0 0x7f8f2019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.407+0000 7f8f25800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f20105110 0x7f8f2019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.407+0000 7f8f25800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f2010dc20 0x7f8f201a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.407+0000 7f8f25800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8f201139e0 con 0x7f8f2010dc20 2024-09-21T02:41:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.407+0000 7f8f25800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20113860 con 0x7f8f201047c0 2024-09-21T02:41:01.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.407+0000 7f8f25800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20113b60 con 0x7f8f20105110 2024-09-21T02:41:01.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f24e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f2010dc20 0x7f8f201a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:01.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f1fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f201047c0 0x7f8f2019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:01.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f1fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f201047c0 0x7f8f2019c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:44764/0 (socket says 172.21.15.84:44764) 2024-09-21T02:41:01.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f17400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f20105110 0x7f8f2019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:01.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f1fe00640 1 -- 172.21.15.84:0/2596804053 learned_addr learned my addr 172.21.15.84:0/2596804053 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f24e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f2010dc20 0x7f8f201a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37832/0 (socket says 172.21.15.84:37832) 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f17400640 1 -- 172.21.15.84:0/2596804053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f201047c0 msgr2=0x7f8f2019c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f17400640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f201047c0 0x7f8f2019c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f17400640 1 -- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f2010dc20 msgr2=0x7f8f201a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f17400640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f2010dc20 0x7f8f201a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f17400640 1 -- 172.21.15.84:0/2596804053 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f201a2540 con 0x7f8f20105110 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f24e00640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f2010dc20 0x7f8f201a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f1fe00640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f201047c0 0x7f8f2019c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.408+0000 7f8f17400640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f20105110 0x7f8f2019cb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8f2006aa90 tx=0x7f8f0800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.409+0000 7f8f1d600640 1 -- 172.21.15.84:0/2596804053 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800cc40 con 0x7f8f20105110 2024-09-21T02:41:01.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.409+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f201a2830 con 0x7f8f20105110 2024-09-21T02:41:01.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.409+0000 7f8f1d600640 1 -- 172.21.15.84:0/2596804053 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8f0800cde0 con 0x7f8f20105110 2024-09-21T02:41:01.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.409+0000 7f8f1d600640 1 -- 172.21.15.84:0/2596804053 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08018820 con 0x7f8f20105110 2024-09-21T02:41:01.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.409+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f201a8f90 con 0x7f8f20105110 2024-09-21T02:41:01.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.410+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f20104bd0 con 0x7f8f20105110 2024-09-21T02:41:01.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.413+0000 7f8f1d600640 1 -- 172.21.15.84:0/2596804053 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8f08010b40 con 0x7f8f20105110 2024-09-21T02:41:01.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.414+0000 7f8f1d600640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8f040b65a0 0x7f8f040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:01.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.415+0000 7f8f1d600640 1 -- 172.21.15.84:0/2596804053 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f8f080e7fe0 con 0x7f8f20105110 2024-09-21T02:41:01.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.415+0000 7f8f1fe00640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8f040b65a0 0x7f8f040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:01.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.415+0000 7f8f1fe00640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8f040b65a0 0x7f8f040b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8f10004af0 tx=0x7f8f10009380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:01.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.416+0000 7f8f1d600640 1 -- 172.21.15.84:0/2596804053 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f080b2770 con 0x7f8f20105110 2024-09-21T02:41:01.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.602+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f20102af0 con 0x7f8f040b65a0 2024-09-21T02:41:01.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.610+0000 7f8f1d600640 1 -- 172.21.15.84:0/2596804053 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340348 (secure 0 0 0) 0x7f8f20102af0 con 0x7f8f040b65a0 2024-09-21T02:41:01.612 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:01.625 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T02:41:01.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8f040b65a0 msgr2=0x7f8f040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:01.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8f040b65a0 0x7f8f040b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8f10004af0 tx=0x7f8f10009380 comp rx=0 tx=0).stop 2024-09-21T02:41:01.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f20105110 msgr2=0x7f8f2019cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:01.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f20105110 0x7f8f2019cb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8f2006aa90 tx=0x7f8f0800ee50 comp rx=0 tx=0).stop 2024-09-21T02:41:01.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 shutdown_connections 2024-09-21T02:41:01.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8f040b65a0 0x7f8f040b8ab0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f20105110 0x7f8f2019cb70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f2010dc20 0x7f8f201a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 --2- 172.21.15.84:0/2596804053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f201047c0 0x7f8f2019c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:01.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.614+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 >> 172.21.15.84:0/2596804053 conn(0x7f8f200fe2c0 msgr2=0x7f8f201023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:01.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.615+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 shutdown_connections 2024-09-21T02:41:01.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:01.615+0000 7f8f25800640 1 -- 172.21.15.84:0/2596804053 wait complete. 2024-09-21T02:41:02.403 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-09-21T02:41:01.598645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655879,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":215,"num_read_kb":203,"num_write":287,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391972,"kb_used_data":13588,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549852,"statfs":{"total":1151940427776,"available":1151539048448,"internally_reserved":0,"allocated":13914112,"data_stored":7831437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":58059,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":104,"num_write":35,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003555"},"pg_stats":[{"pgid":"2.1f","version":"84'9","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413175+0000","last_change":"2024-09-21T02:39:43.823658+0000","last_active":"2024-09-21T02:40:43.413175+0000","last_peered":"2024-09-21T02:40:43.413175+0000","last_clean":"2024-09-21T02:40:43.413175+0000","last_became_active":"2024-09-21T02:39:43.823211+0000","last_became_peered":"2024-09-21T02:39:43.823211+0000","last_unstale":"2024-09-21T02:40:43.413175+0000","last_undegraded":"2024-09-21T02:40:43.413175+0000","last_fullsized":"2024-09-21T02:40:43.413175+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:00.505552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397896+0000","last_change":"2024-09-21T02:39:46.850819+0000","last_active":"2024-09-21T02:40:43.397896+0000","last_peered":"2024-09-21T02:40:43.397896+0000","last_clean":"2024-09-21T02:40:43.397896+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:40:43.397896+0000","last_undegraded":"2024-09-21T02:40:43.397896+0000","last_fullsized":"2024-09-21T02:40:43.397896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:21.280788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399113+0000","last_change":"2024-09-21T02:39:56.937452+0000","last_active":"2024-09-21T02:40:43.399113+0000","last_peered":"2024-09-21T02:40:43.399113+0000","last_clean":"2024-09-21T02:40:43.399113+0000","last_became_active":"2024-09-21T02:39:56.936985+0000","last_became_peered":"2024-09-21T02:39:56.936985+0000","last_unstale":"2024-09-21T02:40:43.399113+0000","last_undegraded":"2024-09-21T02:40:43.399113+0000","last_fullsized":"2024-09-21T02:40:43.399113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:39.614222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398131+0000","last_change":"2024-09-21T02:39:43.828030+0000","last_active":"2024-09-21T02:40:43.398131+0000","last_peered":"2024-09-21T02:40:43.398131+0000","last_clean":"2024-09-21T02:40:43.398131+0000","last_became_active":"2024-09-21T02:39:43.827692+0000","last_became_peered":"2024-09-21T02:39:43.827692+0000","last_unstale":"2024-09-21T02:40:43.398131+0000","last_undegraded":"2024-09-21T02:40:43.398131+0000","last_fullsized":"2024-09-21T02:40:43.398131+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:32.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400251+0000","last_change":"2024-09-21T02:39:46.854718+0000","last_active":"2024-09-21T02:40:43.400251+0000","last_peered":"2024-09-21T02:40:43.400251+0000","last_clean":"2024-09-21T02:40:43.400251+0000","last_became_active":"2024-09-21T02:39:46.854355+0000","last_became_peered":"2024-09-21T02:39:46.854355+0000","last_unstale":"2024-09-21T02:40:43.400251+0000","last_undegraded":"2024-09-21T02:40:43.400251+0000","last_fullsized":"2024-09-21T02:40:43.400251+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:58.894397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401281+0000","last_change":"2024-09-21T02:39:56.930764+0000","last_active":"2024-09-21T02:40:43.401281+0000","last_peered":"2024-09-21T02:40:43.401281+0000","last_clean":"2024-09-21T02:40:43.401281+0000","last_became_active":"2024-09-21T02:39:56.930243+0000","last_became_peered":"2024-09-21T02:39:56.930243+0000","last_unstale":"2024-09-21T02:40:43.401281+0000","last_undegraded":"2024-09-21T02:40:43.401281+0000","last_fullsized":"2024-09-21T02:40:43.401281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:20.283102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403364+0000","last_change":"2024-09-21T02:39:43.824749+0000","last_active":"2024-09-21T02:40:43.403364+0000","last_peered":"2024-09-21T02:40:43.403364+0000","last_clean":"2024-09-21T02:40:43.403364+0000","last_became_active":"2024-09-21T02:39:43.824385+0000","last_became_peered":"2024-09-21T02:39:43.824385+0000","last_unstale":"2024-09-21T02:40:43.403364+0000","last_undegraded":"2024-09-21T02:40:43.403364+0000","last_fullsized":"2024-09-21T02:40:43.403364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395265+0000","last_change":"2024-09-21T02:39:46.856048+0000","last_active":"2024-09-21T02:40:43.395265+0000","last_peered":"2024-09-21T02:40:43.395265+0000","last_clean":"2024-09-21T02:40:43.395265+0000","last_became_active":"2024-09-21T02:39:46.855687+0000","last_became_peered":"2024-09-21T02:39:46.855687+0000","last_unstale":"2024-09-21T02:40:43.395265+0000","last_undegraded":"2024-09-21T02:40:43.395265+0000","last_fullsized":"2024-09-21T02:40:43.395265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:11.708028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402440+0000","last_change":"2024-09-21T02:39:56.931495+0000","last_active":"2024-09-21T02:40:43.402440+0000","last_peered":"2024-09-21T02:40:43.402440+0000","last_clean":"2024-09-21T02:40:43.402440+0000","last_became_active":"2024-09-21T02:39:56.930586+0000","last_became_peered":"2024-09-21T02:39:56.930586+0000","last_unstale":"2024-09-21T02:40:43.402440+0000","last_undegraded":"2024-09-21T02:40:43.402440+0000","last_fullsized":"2024-09-21T02:40:43.402440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:56.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.409321+0000","last_change":"2024-09-21T02:40:43.408517+0000","last_active":"2024-09-21T02:40:43.409321+0000","last_peered":"2024-09-21T02:40:43.409321+0000","last_clean":"2024-09-21T02:40:43.409321+0000","last_became_active":"2024-09-21T02:40:43.402800+0000","last_became_peered":"2024-09-21T02:40:43.402800+0000","last_unstale":"2024-09-21T02:40:43.409321+0000","last_undegraded":"2024-09-21T02:40:43.409321+0000","last_fullsized":"2024-09-21T02:40:43.409321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:46.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395583+0000","last_change":"2024-09-21T02:39:46.855990+0000","last_active":"2024-09-21T02:40:43.395583+0000","last_peered":"2024-09-21T02:40:43.395583+0000","last_clean":"2024-09-21T02:40:43.395583+0000","last_became_active":"2024-09-21T02:39:46.855602+0000","last_became_peered":"2024-09-21T02:39:46.855602+0000","last_unstale":"2024-09-21T02:40:43.395583+0000","last_undegraded":"2024-09-21T02:40:43.395583+0000","last_fullsized":"2024-09-21T02:40:43.395583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:43.207141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401502+0000","last_change":"2024-09-21T02:39:56.924868+0000","last_active":"2024-09-21T02:40:43.401502+0000","last_peered":"2024-09-21T02:40:43.401502+0000","last_clean":"2024-09-21T02:40:43.401502+0000","last_became_active":"2024-09-21T02:39:56.924353+0000","last_became_peered":"2024-09-21T02:39:56.924353+0000","last_unstale":"2024-09-21T02:40:43.401502+0000","last_undegraded":"2024-09-21T02:40:43.401502+0000","last_fullsized":"2024-09-21T02:40:43.401502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:48.095244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401917+0000","last_change":"2024-09-21T02:39:46.853077+0000","last_active":"2024-09-21T02:40:43.401917+0000","last_peered":"2024-09-21T02:40:43.401917+0000","last_clean":"2024-09-21T02:40:43.401917+0000","last_became_active":"2024-09-21T02:39:46.852691+0000","last_became_peered":"2024-09-21T02:39:46.852691+0000","last_unstale":"2024-09-21T02:40:43.401917+0000","last_undegraded":"2024-09-21T02:40:43.401917+0000","last_fullsized":"2024-09-21T02:40:43.401917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:12.427934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":59,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411313+0000","last_change":"2024-09-21T02:40:43.411229+0000","last_active":"2024-09-21T02:40:43.411313+0000","last_peered":"2024-09-21T02:40:43.411313+0000","last_clean":"2024-09-21T02:40:43.411313+0000","last_became_active":"2024-09-21T02:40:43.404833+0000","last_became_peered":"2024-09-21T02:40:43.404833+0000","last_unstale":"2024-09-21T02:40:43.411313+0000","last_undegraded":"2024-09-21T02:40:43.411313+0000","last_fullsized":"2024-09-21T02:40:43.411313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:22.812239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402117+0000","last_change":"2024-09-21T02:39:56.922205+0000","last_active":"2024-09-21T02:40:43.402117+0000","last_peered":"2024-09-21T02:40:43.402117+0000","last_clean":"2024-09-21T02:40:43.402117+0000","last_became_active":"2024-09-21T02:39:56.921702+0000","last_became_peered":"2024-09-21T02:39:56.921702+0000","last_unstale":"2024-09-21T02:40:43.402117+0000","last_undegraded":"2024-09-21T02:40:43.402117+0000","last_fullsized":"2024-09-21T02:40:43.402117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:07.622691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397425+0000","last_change":"2024-09-21T02:39:46.846380+0000","last_active":"2024-09-21T02:40:43.397425+0000","last_peered":"2024-09-21T02:40:43.397425+0000","last_clean":"2024-09-21T02:40:43.397425+0000","last_became_active":"2024-09-21T02:39:46.845972+0000","last_became_peered":"2024-09-21T02:39:46.845972+0000","last_unstale":"2024-09-21T02:40:43.397425+0000","last_undegraded":"2024-09-21T02:40:43.397425+0000","last_fullsized":"2024-09-21T02:40:43.397425+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:44.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398145+0000","last_change":"2024-09-21T02:39:43.824394+0000","last_active":"2024-09-21T02:40:43.398145+0000","last_peered":"2024-09-21T02:40:43.398145+0000","last_clean":"2024-09-21T02:40:43.398145+0000","last_became_active":"2024-09-21T02:39:43.823947+0000","last_became_peered":"2024-09-21T02:39:43.823947+0000","last_unstale":"2024-09-21T02:40:43.398145+0000","last_undegraded":"2024-09-21T02:40:43.398145+0000","last_fullsized":"2024-09-21T02:40:43.398145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.083281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.414747+0000","last_change":"2024-09-21T02:40:43.413833+0000","last_active":"2024-09-21T02:40:43.414747+0000","last_peered":"2024-09-21T02:40:43.414747+0000","last_clean":"2024-09-21T02:40:43.414747+0000","last_became_active":"2024-09-21T02:40:43.413319+0000","last_became_peered":"2024-09-21T02:40:43.413319+0000","last_unstale":"2024-09-21T02:40:43.414747+0000","last_undegraded":"2024-09-21T02:40:43.414747+0000","last_fullsized":"2024-09-21T02:40:43.414747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:40.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400514+0000","last_change":"2024-09-21T02:39:46.845544+0000","last_active":"2024-09-21T02:40:43.400514+0000","last_peered":"2024-09-21T02:40:43.400514+0000","last_clean":"2024-09-21T02:40:43.400514+0000","last_became_active":"2024-09-21T02:39:46.845162+0000","last_became_peered":"2024-09-21T02:39:46.845162+0000","last_unstale":"2024-09-21T02:40:43.400514+0000","last_undegraded":"2024-09-21T02:40:43.400514+0000","last_fullsized":"2024-09-21T02:40:43.400514+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:46.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397239+0000","last_change":"2024-09-21T02:39:43.825182+0000","last_active":"2024-09-21T02:40:43.397239+0000","last_peered":"2024-09-21T02:40:43.397239+0000","last_clean":"2024-09-21T02:40:43.397239+0000","last_became_active":"2024-09-21T02:39:43.824774+0000","last_became_peered":"2024-09-21T02:39:43.824774+0000","last_unstale":"2024-09-21T02:40:43.397239+0000","last_undegraded":"2024-09-21T02:40:43.397239+0000","last_fullsized":"2024-09-21T02:40:43.397239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:41.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413181+0000","last_change":"2024-09-21T02:39:56.935765+0000","last_active":"2024-09-21T02:40:43.413181+0000","last_peered":"2024-09-21T02:40:43.413181+0000","last_clean":"2024-09-21T02:40:43.413181+0000","last_became_active":"2024-09-21T02:39:56.933218+0000","last_became_peered":"2024-09-21T02:39:56.933218+0000","last_unstale":"2024-09-21T02:40:43.413181+0000","last_undegraded":"2024-09-21T02:40:43.413181+0000","last_fullsized":"2024-09-21T02:40:43.413181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:28.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401745+0000","last_change":"2024-09-21T02:39:46.853769+0000","last_active":"2024-09-21T02:40:43.401745+0000","last_peered":"2024-09-21T02:40:43.401745+0000","last_clean":"2024-09-21T02:40:43.401745+0000","last_became_active":"2024-09-21T02:39:46.853347+0000","last_became_peered":"2024-09-21T02:39:46.853347+0000","last_unstale":"2024-09-21T02:40:43.401745+0000","last_undegraded":"2024-09-21T02:40:43.401745+0000","last_fullsized":"2024-09-21T02:40:43.401745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:01.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.408415+0000","last_change":"2024-09-21T02:40:43.408316+0000","last_active":"2024-09-21T02:40:43.408415+0000","last_peered":"2024-09-21T02:40:43.408415+0000","last_clean":"2024-09-21T02:40:43.408415+0000","last_became_active":"2024-09-21T02:40:43.402877+0000","last_became_peered":"2024-09-21T02:40:43.402877+0000","last_unstale":"2024-09-21T02:40:43.408415+0000","last_undegraded":"2024-09-21T02:40:43.408415+0000","last_fullsized":"2024-09-21T02:40:43.408415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.712477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402131+0000","last_change":"2024-09-21T02:39:56.928251+0000","last_active":"2024-09-21T02:40:43.402131+0000","last_peered":"2024-09-21T02:40:43.402131+0000","last_clean":"2024-09-21T02:40:43.402131+0000","last_became_active":"2024-09-21T02:39:56.927772+0000","last_became_peered":"2024-09-21T02:39:56.927772+0000","last_unstale":"2024-09-21T02:40:43.402131+0000","last_undegraded":"2024-09-21T02:40:43.402131+0000","last_fullsized":"2024-09-21T02:40:43.402131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:40.762245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.418346+0000","last_change":"2024-09-21T02:40:43.418238+0000","last_active":"2024-09-21T02:40:43.418346+0000","last_peered":"2024-09-21T02:40:43.418346+0000","last_clean":"2024-09-21T02:40:43.418346+0000","last_became_active":"2024-09-21T02:40:43.417728+0000","last_became_peered":"2024-09-21T02:40:43.417728+0000","last_unstale":"2024-09-21T02:40:43.418346+0000","last_undegraded":"2024-09-21T02:40:43.418346+0000","last_fullsized":"2024-09-21T02:40:43.418346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:35.244275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403172+0000","last_change":"2024-09-21T02:39:43.840567+0000","last_active":"2024-09-21T02:40:43.403172+0000","last_peered":"2024-09-21T02:40:43.403172+0000","last_clean":"2024-09-21T02:40:43.403172+0000","last_became_active":"2024-09-21T02:39:43.840279+0000","last_became_peered":"2024-09-21T02:39:43.840279+0000","last_unstale":"2024-09-21T02:40:43.403172+0000","last_undegraded":"2024-09-21T02:40:43.403172+0000","last_fullsized":"2024-09-21T02:40:43.403172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:42.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399752+0000","last_change":"2024-09-21T02:39:56.920425+0000","last_active":"2024-09-21T02:40:43.399752+0000","last_peered":"2024-09-21T02:40:43.399752+0000","last_clean":"2024-09-21T02:40:43.399752+0000","last_became_active":"2024-09-21T02:39:56.919610+0000","last_became_peered":"2024-09-21T02:39:56.919610+0000","last_unstale":"2024-09-21T02:40:43.399752+0000","last_undegraded":"2024-09-21T02:40:43.399752+0000","last_fullsized":"2024-09-21T02:40:43.399752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398383+0000","last_change":"2024-09-21T02:39:46.845188+0000","last_active":"2024-09-21T02:40:43.398383+0000","last_peered":"2024-09-21T02:40:43.398383+0000","last_clean":"2024-09-21T02:40:43.398383+0000","last_became_active":"2024-09-21T02:39:46.844818+0000","last_became_peered":"2024-09-21T02:39:46.844818+0000","last_unstale":"2024-09-21T02:40:43.398383+0000","last_undegraded":"2024-09-21T02:40:43.398383+0000","last_fullsized":"2024-09-21T02:40:43.398383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.853370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'10","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:57.862061+0000","last_change":"2024-09-21T02:39:43.822226+0000","last_active":"2024-09-21T02:40:57.862061+0000","last_peered":"2024-09-21T02:40:57.862061+0000","last_clean":"2024-09-21T02:40:57.862061+0000","last_became_active":"2024-09-21T02:39:43.821798+0000","last_became_peered":"2024-09-21T02:39:43.821798+0000","last_unstale":"2024-09-21T02:40:57.862061+0000","last_undegraded":"2024-09-21T02:40:57.862061+0000","last_fullsized":"2024-09-21T02:40:57.862061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:38.822330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.396683+0000","last_change":"2024-09-21T02:39:56.919521+0000","last_active":"2024-09-21T02:40:43.396683+0000","last_peered":"2024-09-21T02:40:43.396683+0000","last_clean":"2024-09-21T02:40:43.396683+0000","last_became_active":"2024-09-21T02:39:56.918042+0000","last_became_peered":"2024-09-21T02:39:56.918042+0000","last_unstale":"2024-09-21T02:40:43.396683+0000","last_undegraded":"2024-09-21T02:40:43.396683+0000","last_fullsized":"2024-09-21T02:40:43.396683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:21.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416234+0000","last_change":"2024-09-21T02:39:46.861856+0000","last_active":"2024-09-21T02:40:43.416234+0000","last_peered":"2024-09-21T02:40:43.416234+0000","last_clean":"2024-09-21T02:40:43.416234+0000","last_became_active":"2024-09-21T02:39:46.861416+0000","last_became_peered":"2024-09-21T02:39:46.861416+0000","last_unstale":"2024-09-21T02:40:43.416234+0000","last_undegraded":"2024-09-21T02:40:43.416234+0000","last_fullsized":"2024-09-21T02:40:43.416234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:46.547988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403495+0000","last_change":"2024-09-21T02:39:43.826232+0000","last_active":"2024-09-21T02:40:43.403495+0000","last_peered":"2024-09-21T02:40:43.403495+0000","last_clean":"2024-09-21T02:40:43.403495+0000","last_became_active":"2024-09-21T02:39:43.825789+0000","last_became_peered":"2024-09-21T02:39:43.825789+0000","last_unstale":"2024-09-21T02:40:43.403495+0000","last_undegraded":"2024-09-21T02:40:43.403495+0000","last_fullsized":"2024-09-21T02:40:43.403495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:19.465106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398765+0000","last_change":"2024-09-21T02:39:56.917802+0000","last_active":"2024-09-21T02:40:43.398765+0000","last_peered":"2024-09-21T02:40:43.398765+0000","last_clean":"2024-09-21T02:40:43.398765+0000","last_became_active":"2024-09-21T02:39:56.917286+0000","last_became_peered":"2024-09-21T02:39:56.917286+0000","last_unstale":"2024-09-21T02:40:43.398765+0000","last_undegraded":"2024-09-21T02:40:43.398765+0000","last_fullsized":"2024-09-21T02:40:43.398765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:19.055218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411876+0000","last_change":"2024-09-21T02:39:46.858829+0000","last_active":"2024-09-21T02:40:43.411876+0000","last_peered":"2024-09-21T02:40:43.411876+0000","last_clean":"2024-09-21T02:40:43.411876+0000","last_became_active":"2024-09-21T02:39:46.858392+0000","last_became_peered":"2024-09-21T02:39:46.858392+0000","last_unstale":"2024-09-21T02:40:43.411876+0000","last_undegraded":"2024-09-21T02:40:43.411876+0000","last_fullsized":"2024-09-21T02:40:43.411876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:29.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412401+0000","last_change":"2024-09-21T02:39:43.825129+0000","last_active":"2024-09-21T02:40:43.412401+0000","last_peered":"2024-09-21T02:40:43.412401+0000","last_clean":"2024-09-21T02:40:43.412401+0000","last_became_active":"2024-09-21T02:39:43.824756+0000","last_became_peered":"2024-09-21T02:39:43.824756+0000","last_unstale":"2024-09-21T02:40:43.412401+0000","last_undegraded":"2024-09-21T02:40:43.412401+0000","last_fullsized":"2024-09-21T02:40:43.412401+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:28.771033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401821+0000","last_change":"2024-09-21T02:39:56.929186+0000","last_active":"2024-09-21T02:40:43.401821+0000","last_peered":"2024-09-21T02:40:43.401821+0000","last_clean":"2024-09-21T02:40:43.401821+0000","last_became_active":"2024-09-21T02:39:56.928608+0000","last_became_peered":"2024-09-21T02:39:56.928608+0000","last_unstale":"2024-09-21T02:40:43.401821+0000","last_undegraded":"2024-09-21T02:40:43.401821+0000","last_fullsized":"2024-09-21T02:40:43.401821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:47.860230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412131+0000","last_change":"2024-09-21T02:39:46.860375+0000","last_active":"2024-09-21T02:40:43.412131+0000","last_peered":"2024-09-21T02:40:43.412131+0000","last_clean":"2024-09-21T02:40:43.412131+0000","last_became_active":"2024-09-21T02:39:46.860035+0000","last_became_peered":"2024-09-21T02:39:46.860035+0000","last_unstale":"2024-09-21T02:40:43.412131+0000","last_undegraded":"2024-09-21T02:40:43.412131+0000","last_fullsized":"2024-09-21T02:40:43.412131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:07.761203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402127+0000","last_change":"2024-09-21T02:39:43.827869+0000","last_active":"2024-09-21T02:40:43.402127+0000","last_peered":"2024-09-21T02:40:43.402127+0000","last_clean":"2024-09-21T02:40:43.402127+0000","last_became_active":"2024-09-21T02:39:43.827375+0000","last_became_peered":"2024-09-21T02:39:43.827375+0000","last_unstale":"2024-09-21T02:40:43.402127+0000","last_undegraded":"2024-09-21T02:40:43.402127+0000","last_fullsized":"2024-09-21T02:40:43.402127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:48.257387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416024+0000","last_change":"2024-09-21T02:39:56.917766+0000","last_active":"2024-09-21T02:40:43.416024+0000","last_peered":"2024-09-21T02:40:43.416024+0000","last_clean":"2024-09-21T02:40:43.416024+0000","last_became_active":"2024-09-21T02:39:56.917309+0000","last_became_peered":"2024-09-21T02:39:56.917309+0000","last_unstale":"2024-09-21T02:40:43.416024+0000","last_undegraded":"2024-09-21T02:40:43.416024+0000","last_fullsized":"2024-09-21T02:40:43.416024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:36.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395127+0000","last_change":"2024-09-21T02:39:46.851416+0000","last_active":"2024-09-21T02:40:43.395127+0000","last_peered":"2024-09-21T02:40:43.395127+0000","last_clean":"2024-09-21T02:40:43.395127+0000","last_became_active":"2024-09-21T02:39:46.851055+0000","last_became_peered":"2024-09-21T02:39:46.851055+0000","last_unstale":"2024-09-21T02:40:43.395127+0000","last_undegraded":"2024-09-21T02:40:43.395127+0000","last_fullsized":"2024-09-21T02:40:43.395127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:50.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":65,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:41:00.442344+0000","last_change":"2024-09-21T02:39:43.825162+0000","last_active":"2024-09-21T02:41:00.442344+0000","last_peered":"2024-09-21T02:41:00.442344+0000","last_clean":"2024-09-21T02:41:00.442344+0000","last_became_active":"2024-09-21T02:39:43.824811+0000","last_became_peered":"2024-09-21T02:39:43.824811+0000","last_unstale":"2024-09-21T02:41:00.442344+0000","last_undegraded":"2024-09-21T02:41:00.442344+0000","last_fullsized":"2024-09-21T02:41:00.442344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:10.020902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417125+0000","last_change":"2024-09-21T02:39:56.920750+0000","last_active":"2024-09-21T02:40:43.417125+0000","last_peered":"2024-09-21T02:40:43.417125+0000","last_clean":"2024-09-21T02:40:43.417125+0000","last_became_active":"2024-09-21T02:39:56.920245+0000","last_became_peered":"2024-09-21T02:39:56.920245+0000","last_unstale":"2024-09-21T02:40:43.417125+0000","last_undegraded":"2024-09-21T02:40:43.417125+0000","last_fullsized":"2024-09-21T02:40:43.417125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:53.718596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416626+0000","last_change":"2024-09-21T02:39:46.854202+0000","last_active":"2024-09-21T02:40:43.416626+0000","last_peered":"2024-09-21T02:40:43.416626+0000","last_clean":"2024-09-21T02:40:43.416626+0000","last_became_active":"2024-09-21T02:39:46.853076+0000","last_became_peered":"2024-09-21T02:39:46.853076+0000","last_unstale":"2024-09-21T02:40:43.416626+0000","last_undegraded":"2024-09-21T02:40:43.416626+0000","last_fullsized":"2024-09-21T02:40:43.416626+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:59.729777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401523+0000","last_change":"2024-09-21T02:39:43.826351+0000","last_active":"2024-09-21T02:40:43.401523+0000","last_peered":"2024-09-21T02:40:43.401523+0000","last_clean":"2024-09-21T02:40:43.401523+0000","last_became_active":"2024-09-21T02:39:43.825683+0000","last_became_peered":"2024-09-21T02:39:43.825683+0000","last_unstale":"2024-09-21T02:40:43.401523+0000","last_undegraded":"2024-09-21T02:40:43.401523+0000","last_fullsized":"2024-09-21T02:40:43.401523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:16.934280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395931+0000","last_change":"2024-09-21T02:39:56.937591+0000","last_active":"2024-09-21T02:40:43.395931+0000","last_peered":"2024-09-21T02:40:43.395931+0000","last_clean":"2024-09-21T02:40:43.395931+0000","last_became_active":"2024-09-21T02:39:56.937178+0000","last_became_peered":"2024-09-21T02:39:56.937178+0000","last_unstale":"2024-09-21T02:40:43.395931+0000","last_undegraded":"2024-09-21T02:40:43.395931+0000","last_fullsized":"2024-09-21T02:40:43.395931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:21.218393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397507+0000","last_change":"2024-09-21T02:39:46.858255+0000","last_active":"2024-09-21T02:40:43.397507+0000","last_peered":"2024-09-21T02:40:43.397507+0000","last_clean":"2024-09-21T02:40:43.397507+0000","last_became_active":"2024-09-21T02:39:46.856726+0000","last_became_peered":"2024-09-21T02:39:46.856726+0000","last_unstale":"2024-09-21T02:40:43.397507+0000","last_undegraded":"2024-09-21T02:40:43.397507+0000","last_fullsized":"2024-09-21T02:40:43.397507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:33.890538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403283+0000","last_change":"2024-09-21T02:39:43.823562+0000","last_active":"2024-09-21T02:40:43.403283+0000","last_peered":"2024-09-21T02:40:43.403283+0000","last_clean":"2024-09-21T02:40:43.403283+0000","last_became_active":"2024-09-21T02:39:43.823142+0000","last_became_peered":"2024-09-21T02:39:43.823142+0000","last_unstale":"2024-09-21T02:40:43.403283+0000","last_undegraded":"2024-09-21T02:40:43.403283+0000","last_fullsized":"2024-09-21T02:40:43.403283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:36.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":117,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401756+0000","last_change":"2024-09-21T02:38:27.972237+0000","last_active":"2024-09-21T02:40:43.401756+0000","last_peered":"2024-09-21T02:40:43.401756+0000","last_clean":"2024-09-21T02:40:43.401756+0000","last_became_active":"2024-09-21T02:38:27.966297+0000","last_became_peered":"2024-09-21T02:38:27.966297+0000","last_unstale":"2024-09-21T02:40:43.401756+0000","last_undegraded":"2024-09-21T02:40:43.401756+0000","last_fullsized":"2024-09-21T02:40:43.401756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_clean_scrub_stamp":"2024-09-21T02:34:42.292034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:24.592682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402820+0000","last_change":"2024-09-21T02:39:56.930418+0000","last_active":"2024-09-21T02:40:43.402820+0000","last_peered":"2024-09-21T02:40:43.402820+0000","last_clean":"2024-09-21T02:40:43.402820+0000","last_became_active":"2024-09-21T02:39:56.929920+0000","last_became_peered":"2024-09-21T02:39:56.929920+0000","last_unstale":"2024-09-21T02:40:43.402820+0000","last_undegraded":"2024-09-21T02:40:43.402820+0000","last_fullsized":"2024-09-21T02:40:43.402820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:15.195020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403073+0000","last_change":"2024-09-21T02:39:46.851466+0000","last_active":"2024-09-21T02:40:43.403073+0000","last_peered":"2024-09-21T02:40:43.403073+0000","last_clean":"2024-09-21T02:40:43.403073+0000","last_became_active":"2024-09-21T02:39:46.849945+0000","last_became_peered":"2024-09-21T02:39:46.849945+0000","last_unstale":"2024-09-21T02:40:43.403073+0000","last_undegraded":"2024-09-21T02:40:43.403073+0000","last_fullsized":"2024-09-21T02:40:43.403073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:07.424794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398775+0000","last_change":"2024-09-21T02:39:43.840894+0000","last_active":"2024-09-21T02:40:43.398775+0000","last_peered":"2024-09-21T02:40:43.398775+0000","last_clean":"2024-09-21T02:40:43.398775+0000","last_became_active":"2024-09-21T02:39:43.840437+0000","last_became_peered":"2024-09-21T02:39:43.840437+0000","last_unstale":"2024-09-21T02:40:43.398775+0000","last_undegraded":"2024-09-21T02:40:43.398775+0000","last_fullsized":"2024-09-21T02:40:43.398775+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:31.741218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395084+0000","last_change":"2024-09-21T02:39:56.924563+0000","last_active":"2024-09-21T02:40:43.395084+0000","last_peered":"2024-09-21T02:40:43.395084+0000","last_clean":"2024-09-21T02:40:43.395084+0000","last_became_active":"2024-09-21T02:39:56.923791+0000","last_became_peered":"2024-09-21T02:39:56.923791+0000","last_unstale":"2024-09-21T02:40:43.395084+0000","last_undegraded":"2024-09-21T02:40:43.395084+0000","last_fullsized":"2024-09-21T02:40:43.395084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:03.409737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402629+0000","last_change":"2024-09-21T02:39:46.858712+0000","last_active":"2024-09-21T02:40:43.402629+0000","last_peered":"2024-09-21T02:40:43.402629+0000","last_clean":"2024-09-21T02:40:43.402629+0000","last_became_active":"2024-09-21T02:39:46.858339+0000","last_became_peered":"2024-09-21T02:39:46.858339+0000","last_unstale":"2024-09-21T02:40:43.402629+0000","last_undegraded":"2024-09-21T02:40:43.402629+0000","last_fullsized":"2024-09-21T02:40:43.402629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.015904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395766+0000","last_change":"2024-09-21T02:39:43.829127+0000","last_active":"2024-09-21T02:40:43.395766+0000","last_peered":"2024-09-21T02:40:43.395766+0000","last_clean":"2024-09-21T02:40:43.395766+0000","last_became_active":"2024-09-21T02:39:43.828136+0000","last_became_peered":"2024-09-21T02:39:43.828136+0000","last_unstale":"2024-09-21T02:40:43.395766+0000","last_undegraded":"2024-09-21T02:40:43.395766+0000","last_fullsized":"2024-09-21T02:40:43.395766+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:39.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399781+0000","last_change":"2024-09-21T02:39:56.930823+0000","last_active":"2024-09-21T02:40:43.399781+0000","last_peered":"2024-09-21T02:40:43.399781+0000","last_clean":"2024-09-21T02:40:43.399781+0000","last_became_active":"2024-09-21T02:39:56.930379+0000","last_became_peered":"2024-09-21T02:39:56.930379+0000","last_unstale":"2024-09-21T02:40:43.399781+0000","last_undegraded":"2024-09-21T02:40:43.399781+0000","last_fullsized":"2024-09-21T02:40:43.399781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:01.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402678+0000","last_change":"2024-09-21T02:39:46.846873+0000","last_active":"2024-09-21T02:40:43.402678+0000","last_peered":"2024-09-21T02:40:43.402678+0000","last_clean":"2024-09-21T02:40:43.402678+0000","last_became_active":"2024-09-21T02:39:46.846502+0000","last_became_peered":"2024-09-21T02:39:46.846502+0000","last_unstale":"2024-09-21T02:40:43.402678+0000","last_undegraded":"2024-09-21T02:40:43.402678+0000","last_fullsized":"2024-09-21T02:40:43.402678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:20.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417234+0000","last_change":"2024-09-21T02:39:43.832273+0000","last_active":"2024-09-21T02:40:43.417234+0000","last_peered":"2024-09-21T02:40:43.417234+0000","last_clean":"2024-09-21T02:40:43.417234+0000","last_became_active":"2024-09-21T02:39:43.831705+0000","last_became_peered":"2024-09-21T02:39:43.831705+0000","last_unstale":"2024-09-21T02:40:43.417234+0000","last_undegraded":"2024-09-21T02:40:43.417234+0000","last_fullsized":"2024-09-21T02:40:43.417234+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:31.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395009+0000","last_change":"2024-09-21T02:39:56.920277+0000","last_active":"2024-09-21T02:40:43.395009+0000","last_peered":"2024-09-21T02:40:43.395009+0000","last_clean":"2024-09-21T02:40:43.395009+0000","last_became_active":"2024-09-21T02:39:56.919885+0000","last_became_peered":"2024-09-21T02:39:56.919885+0000","last_unstale":"2024-09-21T02:40:43.395009+0000","last_undegraded":"2024-09-21T02:40:43.395009+0000","last_fullsized":"2024-09-21T02:40:43.395009+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:32.750878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413604+0000","last_change":"2024-09-21T02:40:43.413459+0000","last_active":"2024-09-21T02:40:43.413604+0000","last_peered":"2024-09-21T02:40:43.413604+0000","last_clean":"2024-09-21T02:40:43.413604+0000","last_became_active":"2024-09-21T02:40:43.413012+0000","last_became_peered":"2024-09-21T02:40:43.413012+0000","last_unstale":"2024-09-21T02:40:43.413604+0000","last_undegraded":"2024-09-21T02:40:43.413604+0000","last_fullsized":"2024-09-21T02:40:43.413604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:23.971450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403135+0000","last_change":"2024-09-21T02:39:43.821955+0000","last_active":"2024-09-21T02:40:43.403135+0000","last_peered":"2024-09-21T02:40:43.403135+0000","last_clean":"2024-09-21T02:40:43.403135+0000","last_became_active":"2024-09-21T02:39:43.820480+0000","last_became_peered":"2024-09-21T02:39:43.820480+0000","last_unstale":"2024-09-21T02:40:43.403135+0000","last_undegraded":"2024-09-21T02:40:43.403135+0000","last_fullsized":"2024-09-21T02:40:43.403135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:51.201528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394840+0000","last_change":"2024-09-21T02:39:56.922017+0000","last_active":"2024-09-21T02:40:43.394840+0000","last_peered":"2024-09-21T02:40:43.394840+0000","last_clean":"2024-09-21T02:40:43.394840+0000","last_became_active":"2024-09-21T02:39:56.921616+0000","last_became_peered":"2024-09-21T02:39:56.921616+0000","last_unstale":"2024-09-21T02:40:43.394840+0000","last_undegraded":"2024-09-21T02:40:43.394840+0000","last_fullsized":"2024-09-21T02:40:43.394840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:38.499302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395072+0000","last_change":"2024-09-21T02:39:46.855445+0000","last_active":"2024-09-21T02:40:43.395072+0000","last_peered":"2024-09-21T02:40:43.395072+0000","last_clean":"2024-09-21T02:40:43.395072+0000","last_became_active":"2024-09-21T02:39:46.855053+0000","last_became_peered":"2024-09-21T02:39:46.855053+0000","last_unstale":"2024-09-21T02:40:43.395072+0000","last_undegraded":"2024-09-21T02:40:43.395072+0000","last_fullsized":"2024-09-21T02:40:43.395072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:19.122862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":57,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401763+0000","last_change":"2024-09-21T02:39:43.822744+0000","last_active":"2024-09-21T02:40:43.401763+0000","last_peered":"2024-09-21T02:40:43.401763+0000","last_clean":"2024-09-21T02:40:43.401763+0000","last_became_active":"2024-09-21T02:39:43.822339+0000","last_became_peered":"2024-09-21T02:39:43.822339+0000","last_unstale":"2024-09-21T02:40:43.401763+0000","last_undegraded":"2024-09-21T02:40:43.401763+0000","last_fullsized":"2024-09-21T02:40:43.401763+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:21.370224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417172+0000","last_change":"2024-09-21T02:39:56.929280+0000","last_active":"2024-09-21T02:40:43.417172+0000","last_peered":"2024-09-21T02:40:43.417172+0000","last_clean":"2024-09-21T02:40:43.417172+0000","last_became_active":"2024-09-21T02:39:56.928826+0000","last_became_peered":"2024-09-21T02:39:56.928826+0000","last_unstale":"2024-09-21T02:40:43.417172+0000","last_undegraded":"2024-09-21T02:40:43.417172+0000","last_fullsized":"2024-09-21T02:40:43.417172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:01.597772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401350+0000","last_change":"2024-09-21T02:39:46.852466+0000","last_active":"2024-09-21T02:40:43.401350+0000","last_peered":"2024-09-21T02:40:43.401350+0000","last_clean":"2024-09-21T02:40:43.401350+0000","last_became_active":"2024-09-21T02:39:46.852113+0000","last_became_peered":"2024-09-21T02:39:46.852113+0000","last_unstale":"2024-09-21T02:40:43.401350+0000","last_undegraded":"2024-09-21T02:40:43.401350+0000","last_fullsized":"2024-09-21T02:40:43.401350+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:26.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'4","reported_seq":66,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:59.441594+0000","last_change":"2024-09-21T02:39:43.822241+0000","last_active":"2024-09-21T02:40:59.441594+0000","last_peered":"2024-09-21T02:40:59.441594+0000","last_clean":"2024-09-21T02:40:59.441594+0000","last_became_active":"2024-09-21T02:39:43.820813+0000","last_became_peered":"2024-09-21T02:39:43.820813+0000","last_unstale":"2024-09-21T02:40:59.441594+0000","last_undegraded":"2024-09-21T02:40:59.441594+0000","last_fullsized":"2024-09-21T02:40:59.441594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:09.749207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.407227+0000","last_change":"2024-09-21T02:40:43.405942+0000","last_active":"2024-09-21T02:40:43.407227+0000","last_peered":"2024-09-21T02:40:43.407227+0000","last_clean":"2024-09-21T02:40:43.407227+0000","last_became_active":"2024-09-21T02:40:43.405455+0000","last_became_peered":"2024-09-21T02:40:43.405455+0000","last_unstale":"2024-09-21T02:40:43.407227+0000","last_undegraded":"2024-09-21T02:40:43.407227+0000","last_fullsized":"2024-09-21T02:40:43.407227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:28.594724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417584+0000","last_change":"2024-09-21T02:40:43.417498+0000","last_active":"2024-09-21T02:40:43.417584+0000","last_peered":"2024-09-21T02:40:43.417584+0000","last_clean":"2024-09-21T02:40:43.417584+0000","last_became_active":"2024-09-21T02:40:43.417203+0000","last_became_peered":"2024-09-21T02:40:43.417203+0000","last_unstale":"2024-09-21T02:40:43.417584+0000","last_undegraded":"2024-09-21T02:40:43.417584+0000","last_fullsized":"2024-09-21T02:40:43.417584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:43.618931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395287+0000","last_change":"2024-09-21T02:39:43.827493+0000","last_active":"2024-09-21T02:40:43.395287+0000","last_peered":"2024-09-21T02:40:43.395287+0000","last_clean":"2024-09-21T02:40:43.395287+0000","last_became_active":"2024-09-21T02:39:43.826824+0000","last_became_peered":"2024-09-21T02:39:43.826824+0000","last_unstale":"2024-09-21T02:40:43.395287+0000","last_undegraded":"2024-09-21T02:40:43.395287+0000","last_fullsized":"2024-09-21T02:40:43.395287+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:21.320101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399019+0000","last_change":"2024-09-21T02:39:56.929122+0000","last_active":"2024-09-21T02:40:43.399019+0000","last_peered":"2024-09-21T02:40:43.399019+0000","last_clean":"2024-09-21T02:40:43.399019+0000","last_became_active":"2024-09-21T02:39:56.928633+0000","last_became_peered":"2024-09-21T02:39:56.928633+0000","last_unstale":"2024-09-21T02:40:43.399019+0000","last_undegraded":"2024-09-21T02:40:43.399019+0000","last_fullsized":"2024-09-21T02:40:43.399019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:56.599982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.415668+0000","last_change":"2024-09-21T02:39:46.866922+0000","last_active":"2024-09-21T02:40:43.415668+0000","last_peered":"2024-09-21T02:40:43.415668+0000","last_clean":"2024-09-21T02:40:43.415668+0000","last_became_active":"2024-09-21T02:39:46.866061+0000","last_became_peered":"2024-09-21T02:39:46.866061+0000","last_unstale":"2024-09-21T02:40:43.415668+0000","last_undegraded":"2024-09-21T02:40:43.415668+0000","last_fullsized":"2024-09-21T02:40:43.415668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:02.707212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398542+0000","last_change":"2024-09-21T02:39:43.824188+0000","last_active":"2024-09-21T02:40:43.398542+0000","last_peered":"2024-09-21T02:40:43.398542+0000","last_clean":"2024-09-21T02:40:43.398542+0000","last_became_active":"2024-09-21T02:39:43.823760+0000","last_became_peered":"2024-09-21T02:39:43.823760+0000","last_unstale":"2024-09-21T02:40:43.398542+0000","last_undegraded":"2024-09-21T02:40:43.398542+0000","last_fullsized":"2024-09-21T02:40:43.398542+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:56.770947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395538+0000","last_change":"2024-09-21T02:39:56.920213+0000","last_active":"2024-09-21T02:40:43.395538+0000","last_peered":"2024-09-21T02:40:43.395538+0000","last_clean":"2024-09-21T02:40:43.395538+0000","last_became_active":"2024-09-21T02:39:56.919796+0000","last_became_peered":"2024-09-21T02:39:56.919796+0000","last_unstale":"2024-09-21T02:40:43.395538+0000","last_undegraded":"2024-09-21T02:40:43.395538+0000","last_fullsized":"2024-09-21T02:40:43.395538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:32.162844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403164+0000","last_change":"2024-09-21T02:39:46.846759+0000","last_active":"2024-09-21T02:40:43.403164+0000","last_peered":"2024-09-21T02:40:43.403164+0000","last_clean":"2024-09-21T02:40:43.403164+0000","last_became_active":"2024-09-21T02:39:46.846315+0000","last_became_peered":"2024-09-21T02:39:46.846315+0000","last_unstale":"2024-09-21T02:40:43.403164+0000","last_undegraded":"2024-09-21T02:40:43.403164+0000","last_fullsized":"2024-09-21T02:40:43.403164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:41.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'29","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:41:00.446493+0000","last_change":"2024-09-21T02:39:43.824564+0000","last_active":"2024-09-21T02:41:00.446493+0000","last_peered":"2024-09-21T02:41:00.446493+0000","last_clean":"2024-09-21T02:41:00.446493+0000","last_became_active":"2024-09-21T02:39:43.824190+0000","last_became_peered":"2024-09-21T02:39:43.824190+0000","last_unstale":"2024-09-21T02:41:00.446493+0000","last_undegraded":"2024-09-21T02:41:00.446493+0000","last_fullsized":"2024-09-21T02:41:00.446493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:45.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60885,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":80,"num_write":30,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412220+0000","last_change":"2024-09-21T02:39:56.928936+0000","last_active":"2024-09-21T02:40:43.412220+0000","last_peered":"2024-09-21T02:40:43.412220+0000","last_clean":"2024-09-21T02:40:43.412220+0000","last_became_active":"2024-09-21T02:39:56.927999+0000","last_became_peered":"2024-09-21T02:39:56.927999+0000","last_unstale":"2024-09-21T02:40:43.412220+0000","last_undegraded":"2024-09-21T02:40:43.412220+0000","last_fullsized":"2024-09-21T02:40:43.412220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:33.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395641+0000","last_change":"2024-09-21T02:39:46.860572+0000","last_active":"2024-09-21T02:40:43.395641+0000","last_peered":"2024-09-21T02:40:43.395641+0000","last_clean":"2024-09-21T02:40:43.395641+0000","last_became_active":"2024-09-21T02:39:46.860073+0000","last_became_peered":"2024-09-21T02:39:46.860073+0000","last_unstale":"2024-09-21T02:40:43.395641+0000","last_undegraded":"2024-09-21T02:40:43.395641+0000","last_fullsized":"2024-09-21T02:40:43.395641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:48.355107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395704+0000","last_change":"2024-09-21T02:39:43.828437+0000","last_active":"2024-09-21T02:40:43.395704+0000","last_peered":"2024-09-21T02:40:43.395704+0000","last_clean":"2024-09-21T02:40:43.395704+0000","last_became_active":"2024-09-21T02:39:43.828033+0000","last_became_peered":"2024-09-21T02:39:43.828033+0000","last_unstale":"2024-09-21T02:40:43.395704+0000","last_undegraded":"2024-09-21T02:40:43.395704+0000","last_fullsized":"2024-09-21T02:40:43.395704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:24.065773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401901+0000","last_change":"2024-09-21T02:39:56.937714+0000","last_active":"2024-09-21T02:40:43.401901+0000","last_peered":"2024-09-21T02:40:43.401901+0000","last_clean":"2024-09-21T02:40:43.401901+0000","last_became_active":"2024-09-21T02:39:56.937145+0000","last_became_peered":"2024-09-21T02:39:56.937145+0000","last_unstale":"2024-09-21T02:40:43.401901+0000","last_undegraded":"2024-09-21T02:40:43.401901+0000","last_fullsized":"2024-09-21T02:40:43.401901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:59.265795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400347+0000","last_change":"2024-09-21T02:39:46.864600+0000","last_active":"2024-09-21T02:40:43.400347+0000","last_peered":"2024-09-21T02:40:43.400347+0000","last_clean":"2024-09-21T02:40:43.400347+0000","last_became_active":"2024-09-21T02:39:46.862043+0000","last_became_peered":"2024-09-21T02:39:46.862043+0000","last_unstale":"2024-09-21T02:40:43.400347+0000","last_undegraded":"2024-09-21T02:40:43.400347+0000","last_fullsized":"2024-09-21T02:40:43.400347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.119974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402322+0000","last_change":"2024-09-21T02:39:43.825910+0000","last_active":"2024-09-21T02:40:43.402322+0000","last_peered":"2024-09-21T02:40:43.402322+0000","last_clean":"2024-09-21T02:40:43.402322+0000","last_became_active":"2024-09-21T02:39:43.825370+0000","last_became_peered":"2024-09-21T02:39:43.825370+0000","last_unstale":"2024-09-21T02:40:43.402322+0000","last_undegraded":"2024-09-21T02:40:43.402322+0000","last_fullsized":"2024-09-21T02:40:43.402322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:05.410114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411733+0000","last_change":"2024-09-21T02:39:56.935321+0000","last_active":"2024-09-21T02:40:43.411733+0000","last_peered":"2024-09-21T02:40:43.411733+0000","last_clean":"2024-09-21T02:40:43.411733+0000","last_became_active":"2024-09-21T02:39:56.931669+0000","last_became_peered":"2024-09-21T02:39:56.931669+0000","last_unstale":"2024-09-21T02:40:43.411733+0000","last_undegraded":"2024-09-21T02:40:43.411733+0000","last_fullsized":"2024-09-21T02:40:43.411733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:20.323574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395730+0000","last_change":"2024-09-21T02:39:46.853469+0000","last_active":"2024-09-21T02:40:43.395730+0000","last_peered":"2024-09-21T02:40:43.395730+0000","last_clean":"2024-09-21T02:40:43.395730+0000","last_became_active":"2024-09-21T02:39:46.853133+0000","last_became_peered":"2024-09-21T02:39:46.853133+0000","last_unstale":"2024-09-21T02:40:43.395730+0000","last_undegraded":"2024-09-21T02:40:43.395730+0000","last_fullsized":"2024-09-21T02:40:43.395730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.055341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:59.440064+0000","last_change":"2024-09-21T02:39:43.828678+0000","last_active":"2024-09-21T02:40:59.440064+0000","last_peered":"2024-09-21T02:40:59.440064+0000","last_clean":"2024-09-21T02:40:59.440064+0000","last_became_active":"2024-09-21T02:39:43.828281+0000","last_became_peered":"2024-09-21T02:39:43.828281+0000","last_unstale":"2024-09-21T02:40:59.440064+0000","last_undegraded":"2024-09-21T02:40:59.440064+0000","last_fullsized":"2024-09-21T02:40:59.440064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:42.678028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397054+0000","last_change":"2024-09-21T02:39:56.920489+0000","last_active":"2024-09-21T02:40:43.397054+0000","last_peered":"2024-09-21T02:40:43.397054+0000","last_clean":"2024-09-21T02:40:43.397054+0000","last_became_active":"2024-09-21T02:39:56.920031+0000","last_became_peered":"2024-09-21T02:39:56.920031+0000","last_unstale":"2024-09-21T02:40:43.397054+0000","last_undegraded":"2024-09-21T02:40:43.397054+0000","last_fullsized":"2024-09-21T02:40:43.397054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:56.576113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399754+0000","last_change":"2024-09-21T02:39:56.922470+0000","last_active":"2024-09-21T02:40:43.399754+0000","last_peered":"2024-09-21T02:40:43.399754+0000","last_clean":"2024-09-21T02:40:43.399754+0000","last_became_active":"2024-09-21T02:39:56.922014+0000","last_became_peered":"2024-09-21T02:39:56.922014+0000","last_unstale":"2024-09-21T02:40:43.399754+0000","last_undegraded":"2024-09-21T02:40:43.399754+0000","last_fullsized":"2024-09-21T02:40:43.399754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:25.307835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412133+0000","last_change":"2024-09-21T02:39:46.852869+0000","last_active":"2024-09-21T02:40:43.412133+0000","last_peered":"2024-09-21T02:40:43.412133+0000","last_clean":"2024-09-21T02:40:43.412133+0000","last_became_active":"2024-09-21T02:39:46.852237+0000","last_became_peered":"2024-09-21T02:39:46.852237+0000","last_unstale":"2024-09-21T02:40:43.412133+0000","last_undegraded":"2024-09-21T02:40:43.412133+0000","last_fullsized":"2024-09-21T02:40:43.412133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:10.729381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395550+0000","last_change":"2024-09-21T02:39:43.827358+0000","last_active":"2024-09-21T02:40:43.395550+0000","last_peered":"2024-09-21T02:40:43.395550+0000","last_clean":"2024-09-21T02:40:43.395550+0000","last_became_active":"2024-09-21T02:39:43.826910+0000","last_became_peered":"2024-09-21T02:39:43.826910+0000","last_unstale":"2024-09-21T02:40:43.395550+0000","last_undegraded":"2024-09-21T02:40:43.395550+0000","last_fullsized":"2024-09-21T02:40:43.395550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:48.528314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398573+0000","last_change":"2024-09-21T02:39:56.930809+0000","last_active":"2024-09-21T02:40:43.398573+0000","last_peered":"2024-09-21T02:40:43.398573+0000","last_clean":"2024-09-21T02:40:43.398573+0000","last_became_active":"2024-09-21T02:39:56.930355+0000","last_became_peered":"2024-09-21T02:39:56.930355+0000","last_unstale":"2024-09-21T02:40:43.398573+0000","last_undegraded":"2024-09-21T02:40:43.398573+0000","last_fullsized":"2024-09-21T02:40:43.398573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:41.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397031+0000","last_change":"2024-09-21T02:39:46.856046+0000","last_active":"2024-09-21T02:40:43.397031+0000","last_peered":"2024-09-21T02:40:43.397031+0000","last_clean":"2024-09-21T02:40:43.397031+0000","last_became_active":"2024-09-21T02:39:46.855675+0000","last_became_peered":"2024-09-21T02:39:46.855675+0000","last_unstale":"2024-09-21T02:40:43.397031+0000","last_undegraded":"2024-09-21T02:40:43.397031+0000","last_fullsized":"2024-09-21T02:40:43.397031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.547082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416633+0000","last_change":"2024-09-21T02:39:43.828888+0000","last_active":"2024-09-21T02:40:43.416633+0000","last_peered":"2024-09-21T02:40:43.416633+0000","last_clean":"2024-09-21T02:40:43.416633+0000","last_became_active":"2024-09-21T02:39:43.828340+0000","last_became_peered":"2024-09-21T02:39:43.828340+0000","last_unstale":"2024-09-21T02:40:43.416633+0000","last_undegraded":"2024-09-21T02:40:43.416633+0000","last_fullsized":"2024-09-21T02:40:43.416633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:09.017191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412206+0000","last_change":"2024-09-21T02:39:43.828957+0000","last_active":"2024-09-21T02:40:43.412206+0000","last_peered":"2024-09-21T02:40:43.412206+0000","last_clean":"2024-09-21T02:40:43.412206+0000","last_became_active":"2024-09-21T02:39:43.827899+0000","last_became_peered":"2024-09-21T02:39:43.827899+0000","last_unstale":"2024-09-21T02:40:43.412206+0000","last_undegraded":"2024-09-21T02:40:43.412206+0000","last_fullsized":"2024-09-21T02:40:43.412206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:36.727082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395361+0000","last_change":"2024-09-21T02:39:46.855278+0000","last_active":"2024-09-21T02:40:43.395361+0000","last_peered":"2024-09-21T02:40:43.395361+0000","last_clean":"2024-09-21T02:40:43.395361+0000","last_became_active":"2024-09-21T02:39:46.854905+0000","last_became_peered":"2024-09-21T02:39:46.854905+0000","last_unstale":"2024-09-21T02:40:43.395361+0000","last_undegraded":"2024-09-21T02:40:43.395361+0000","last_fullsized":"2024-09-21T02:40:43.395361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.244912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398327+0000","last_change":"2024-09-21T02:39:56.931183+0000","last_active":"2024-09-21T02:40:43.398327+0000","last_peered":"2024-09-21T02:40:43.398327+0000","last_clean":"2024-09-21T02:40:43.398327+0000","last_became_active":"2024-09-21T02:39:56.930776+0000","last_became_peered":"2024-09-21T02:39:56.930776+0000","last_unstale":"2024-09-21T02:40:43.398327+0000","last_undegraded":"2024-09-21T02:40:43.398327+0000","last_fullsized":"2024-09-21T02:40:43.398327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:56.272272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":69,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:59.440875+0000","last_change":"2024-09-21T02:39:43.823668+0000","last_active":"2024-09-21T02:40:59.440875+0000","last_peered":"2024-09-21T02:40:59.440875+0000","last_clean":"2024-09-21T02:40:59.440875+0000","last_became_active":"2024-09-21T02:39:43.823132+0000","last_became_peered":"2024-09-21T02:39:43.823132+0000","last_unstale":"2024-09-21T02:40:59.440875+0000","last_undegraded":"2024-09-21T02:40:59.440875+0000","last_fullsized":"2024-09-21T02:40:59.440875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:33.187554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402016+0000","last_change":"2024-09-21T02:39:46.845740+0000","last_active":"2024-09-21T02:40:43.402016+0000","last_peered":"2024-09-21T02:40:43.402016+0000","last_clean":"2024-09-21T02:40:43.402016+0000","last_became_active":"2024-09-21T02:39:46.845361+0000","last_became_peered":"2024-09-21T02:39:46.845361+0000","last_unstale":"2024-09-21T02:40:43.402016+0000","last_undegraded":"2024-09-21T02:40:43.402016+0000","last_fullsized":"2024-09-21T02:40:43.402016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.546769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399488+0000","last_change":"2024-09-21T02:39:56.919760+0000","last_active":"2024-09-21T02:40:43.399488+0000","last_peered":"2024-09-21T02:40:43.399488+0000","last_clean":"2024-09-21T02:40:43.399488+0000","last_became_active":"2024-09-21T02:39:56.919315+0000","last_became_peered":"2024-09-21T02:39:56.919315+0000","last_unstale":"2024-09-21T02:40:43.399488+0000","last_undegraded":"2024-09-21T02:40:43.399488+0000","last_fullsized":"2024-09-21T02:40:43.399488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:52.889707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400397+0000","last_change":"2024-09-21T02:39:46.848040+0000","last_active":"2024-09-21T02:40:43.400397+0000","last_peered":"2024-09-21T02:40:43.400397+0000","last_clean":"2024-09-21T02:40:43.400397+0000","last_became_active":"2024-09-21T02:39:46.847627+0000","last_became_peered":"2024-09-21T02:39:46.847627+0000","last_unstale":"2024-09-21T02:40:43.400397+0000","last_undegraded":"2024-09-21T02:40:43.400397+0000","last_fullsized":"2024-09-21T02:40:43.400397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:14.139156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399887+0000","last_change":"2024-09-21T02:39:46.853208+0000","last_active":"2024-09-21T02:40:43.399887+0000","last_peered":"2024-09-21T02:40:43.399887+0000","last_clean":"2024-09-21T02:40:43.399887+0000","last_became_active":"2024-09-21T02:39:46.852821+0000","last_became_peered":"2024-09-21T02:39:46.852821+0000","last_unstale":"2024-09-21T02:40:43.399887+0000","last_undegraded":"2024-09-21T02:40:43.399887+0000","last_fullsized":"2024-09-21T02:40:43.399887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:24.597702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398270+0000","last_change":"2024-09-21T02:39:46.866239+0000","last_active":"2024-09-21T02:40:43.398270+0000","last_peered":"2024-09-21T02:40:43.398270+0000","last_clean":"2024-09-21T02:40:43.398270+0000","last_became_active":"2024-09-21T02:39:46.865935+0000","last_became_peered":"2024-09-21T02:39:46.865935+0000","last_unstale":"2024-09-21T02:40:43.398270+0000","last_undegraded":"2024-09-21T02:40:43.398270+0000","last_fullsized":"2024-09-21T02:40:43.398270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.420521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399912+0000","last_change":"2024-09-21T02:39:46.861857+0000","last_active":"2024-09-21T02:40:43.399912+0000","last_peered":"2024-09-21T02:40:43.399912+0000","last_clean":"2024-09-21T02:40:43.399912+0000","last_became_active":"2024-09-21T02:39:46.861512+0000","last_became_peered":"2024-09-21T02:39:46.861512+0000","last_unstale":"2024-09-21T02:40:43.399912+0000","last_undegraded":"2024-09-21T02:40:43.399912+0000","last_fullsized":"2024-09-21T02:40:43.399912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.044159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416171+0000","last_change":"2024-09-21T02:39:46.858655+0000","last_active":"2024-09-21T02:40:43.416171+0000","last_peered":"2024-09-21T02:40:43.416171+0000","last_clean":"2024-09-21T02:40:43.416171+0000","last_became_active":"2024-09-21T02:39:46.858376+0000","last_became_peered":"2024-09-21T02:39:46.858376+0000","last_unstale":"2024-09-21T02:40:43.416171+0000","last_undegraded":"2024-09-21T02:40:43.416171+0000","last_fullsized":"2024-09-21T02:40:43.416171+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:16.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398999+0000","last_change":"2024-09-21T02:39:46.847973+0000","last_active":"2024-09-21T02:40:43.398999+0000","last_peered":"2024-09-21T02:40:43.398999+0000","last_clean":"2024-09-21T02:40:43.398999+0000","last_became_active":"2024-09-21T02:39:46.846957+0000","last_became_peered":"2024-09-21T02:39:46.846957+0000","last_unstale":"2024-09-21T02:40:43.398999+0000","last_undegraded":"2024-09-21T02:40:43.398999+0000","last_fullsized":"2024-09-21T02:40:43.398999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:44.077854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400226+0000","last_change":"2024-09-21T02:39:46.851310+0000","last_active":"2024-09-21T02:40:43.400226+0000","last_peered":"2024-09-21T02:40:43.400226+0000","last_clean":"2024-09-21T02:40:43.400226+0000","last_became_active":"2024-09-21T02:39:46.850666+0000","last_became_peered":"2024-09-21T02:39:46.850666+0000","last_unstale":"2024-09-21T02:40:43.400226+0000","last_undegraded":"2024-09-21T02:40:43.400226+0000","last_fullsized":"2024-09-21T02:40:43.400226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:48.354795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398248+0000","last_change":"2024-09-21T02:39:46.857409+0000","last_active":"2024-09-21T02:40:43.398248+0000","last_peered":"2024-09-21T02:40:43.398248+0000","last_clean":"2024-09-21T02:40:43.398248+0000","last_became_active":"2024-09-21T02:39:46.856974+0000","last_became_peered":"2024-09-21T02:39:46.856974+0000","last_unstale":"2024-09-21T02:40:43.398248+0000","last_undegraded":"2024-09-21T02:40:43.398248+0000","last_fullsized":"2024-09-21T02:40:43.398248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.140154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394920+0000","last_change":"2024-09-21T02:39:46.844168+0000","last_active":"2024-09-21T02:40:43.394920+0000","last_peered":"2024-09-21T02:40:43.394920+0000","last_clean":"2024-09-21T02:40:43.394920+0000","last_became_active":"2024-09-21T02:39:46.843509+0000","last_became_peered":"2024-09-21T02:39:46.843509+0000","last_unstale":"2024-09-21T02:40:43.394920+0000","last_undegraded":"2024-09-21T02:40:43.394920+0000","last_fullsized":"2024-09-21T02:40:43.394920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.899890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397174+0000","last_change":"2024-09-21T02:39:46.854805+0000","last_active":"2024-09-21T02:40:43.397174+0000","last_peered":"2024-09-21T02:40:43.397174+0000","last_clean":"2024-09-21T02:40:43.397174+0000","last_became_active":"2024-09-21T02:39:46.850248+0000","last_became_peered":"2024-09-21T02:39:46.850248+0000","last_unstale":"2024-09-21T02:40:43.397174+0000","last_undegraded":"2024-09-21T02:40:43.397174+0000","last_fullsized":"2024-09-21T02:40:43.397174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:45.628337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395405+0000","last_change":"2024-09-21T02:39:46.866278+0000","last_active":"2024-09-21T02:40:43.395405+0000","last_peered":"2024-09-21T02:40:43.395405+0000","last_clean":"2024-09-21T02:40:43.395405+0000","last_became_active":"2024-09-21T02:39:46.865810+0000","last_became_peered":"2024-09-21T02:39:46.865810+0000","last_unstale":"2024-09-21T02:40:43.395405+0000","last_undegraded":"2024-09-21T02:40:43.395405+0000","last_fullsized":"2024-09-21T02:40:43.395405+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.754340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416117+0000","last_change":"2024-09-21T02:39:46.857721+0000","last_active":"2024-09-21T02:40:43.416117+0000","last_peered":"2024-09-21T02:40:43.416117+0000","last_clean":"2024-09-21T02:40:43.416117+0000","last_became_active":"2024-09-21T02:39:46.853640+0000","last_became_peered":"2024-09-21T02:39:46.853640+0000","last_unstale":"2024-09-21T02:40:43.416117+0000","last_undegraded":"2024-09-21T02:40:43.416117+0000","last_fullsized":"2024-09-21T02:40:43.416117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:54.019607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413715+0000","last_change":"2024-09-21T02:40:43.413457+0000","last_active":"2024-09-21T02:40:43.413715+0000","last_peered":"2024-09-21T02:40:43.413715+0000","last_clean":"2024-09-21T02:40:43.413715+0000","last_became_active":"2024-09-21T02:40:43.413000+0000","last_became_peered":"2024-09-21T02:40:43.413000+0000","last_unstale":"2024-09-21T02:40:43.413715+0000","last_undegraded":"2024-09-21T02:40:43.413715+0000","last_fullsized":"2024-09-21T02:40:43.413715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:27.775410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398785+0000","last_change":"2024-09-21T02:39:46.857169+0000","last_active":"2024-09-21T02:40:43.398785+0000","last_peered":"2024-09-21T02:40:43.398785+0000","last_clean":"2024-09-21T02:40:43.398785+0000","last_became_active":"2024-09-21T02:39:46.856757+0000","last_became_peered":"2024-09-21T02:39:46.856757+0000","last_unstale":"2024-09-21T02:40:43.398785+0000","last_undegraded":"2024-09-21T02:40:43.398785+0000","last_fullsized":"2024-09-21T02:40:43.398785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:36.729746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413017+0000","last_change":"2024-09-21T02:39:46.854162+0000","last_active":"2024-09-21T02:40:43.413017+0000","last_peered":"2024-09-21T02:40:43.413017+0000","last_clean":"2024-09-21T02:40:43.413017+0000","last_became_active":"2024-09-21T02:39:46.853697+0000","last_became_peered":"2024-09-21T02:39:46.853697+0000","last_unstale":"2024-09-21T02:40:43.413017+0000","last_undegraded":"2024-09-21T02:40:43.413017+0000","last_fullsized":"2024-09-21T02:40:43.413017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.605606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399434+0000","last_change":"2024-09-21T02:39:46.853570+0000","last_active":"2024-09-21T02:40:43.399434+0000","last_peered":"2024-09-21T02:40:43.399434+0000","last_clean":"2024-09-21T02:40:43.399434+0000","last_became_active":"2024-09-21T02:39:46.853074+0000","last_became_peered":"2024-09-21T02:39:46.853074+0000","last_unstale":"2024-09-21T02:40:43.399434+0000","last_undegraded":"2024-09-21T02:40:43.399434+0000","last_fullsized":"2024-09-21T02:40:43.399434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:02.642887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394962+0000","last_change":"2024-09-21T02:39:46.850070+0000","last_active":"2024-09-21T02:40:43.394962+0000","last_peered":"2024-09-21T02:40:43.394962+0000","last_clean":"2024-09-21T02:40:43.394962+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:40:43.394962+0000","last_undegraded":"2024-09-21T02:40:43.394962+0000","last_fullsized":"2024-09-21T02:40:43.394962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:59.185574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403838+0000","last_change":"2024-09-21T02:40:43.403735+0000","last_active":"2024-09-21T02:40:43.403838+0000","last_peered":"2024-09-21T02:40:43.403838+0000","last_clean":"2024-09-21T02:40:43.403838+0000","last_became_active":"2024-09-21T02:40:43.403330+0000","last_became_peered":"2024-09-21T02:40:43.403330+0000","last_unstale":"2024-09-21T02:40:43.403838+0000","last_undegraded":"2024-09-21T02:40:43.403838+0000","last_fullsized":"2024-09-21T02:40:43.403838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:35.043475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399591+0000","last_change":"2024-09-21T02:39:46.850811+0000","last_active":"2024-09-21T02:40:43.399591+0000","last_peered":"2024-09-21T02:40:43.399591+0000","last_clean":"2024-09-21T02:40:43.399591+0000","last_became_active":"2024-09-21T02:39:46.850423+0000","last_became_peered":"2024-09-21T02:39:46.850423+0000","last_unstale":"2024-09-21T02:40:43.399591+0000","last_undegraded":"2024-09-21T02:40:43.399591+0000","last_fullsized":"2024-09-21T02:40:43.399591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:47.343607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416003+0000","last_change":"2024-09-21T02:39:46.851169+0000","last_active":"2024-09-21T02:40:43.416003+0000","last_peered":"2024-09-21T02:40:43.416003+0000","last_clean":"2024-09-21T02:40:43.416003+0000","last_became_active":"2024-09-21T02:39:46.850258+0000","last_became_peered":"2024-09-21T02:39:46.850258+0000","last_unstale":"2024-09-21T02:40:43.416003+0000","last_undegraded":"2024-09-21T02:40:43.416003+0000","last_fullsized":"2024-09-21T02:40:43.416003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:02.588325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402907+0000","last_change":"2024-09-21T02:39:46.854082+0000","last_active":"2024-09-21T02:40:43.402907+0000","last_peered":"2024-09-21T02:40:43.402907+0000","last_clean":"2024-09-21T02:40:43.402907+0000","last_became_active":"2024-09-21T02:39:46.852226+0000","last_became_peered":"2024-09-21T02:39:46.852226+0000","last_unstale":"2024-09-21T02:40:43.402907+0000","last_undegraded":"2024-09-21T02:40:43.402907+0000","last_fullsized":"2024-09-21T02:40:43.402907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:41.960472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402990+0000","last_change":"2024-09-21T02:39:46.856222+0000","last_active":"2024-09-21T02:40:43.402990+0000","last_peered":"2024-09-21T02:40:43.402990+0000","last_clean":"2024-09-21T02:40:43.402990+0000","last_became_active":"2024-09-21T02:39:46.855868+0000","last_became_peered":"2024-09-21T02:39:46.855868+0000","last_unstale":"2024-09-21T02:40:43.402990+0000","last_undegraded":"2024-09-21T02:40:43.402990+0000","last_fullsized":"2024-09-21T02:40:43.402990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:31.396030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412359+0000","last_change":"2024-09-21T02:39:46.862312+0000","last_active":"2024-09-21T02:40:43.412359+0000","last_peered":"2024-09-21T02:40:43.412359+0000","last_clean":"2024-09-21T02:40:43.412359+0000","last_became_active":"2024-09-21T02:39:46.861921+0000","last_became_peered":"2024-09-21T02:39:46.861921+0000","last_unstale":"2024-09-21T02:40:43.412359+0000","last_undegraded":"2024-09-21T02:40:43.412359+0000","last_fullsized":"2024-09-21T02:40:43.412359+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:33.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395777+0000","last_change":"2024-09-21T02:39:46.851155+0000","last_active":"2024-09-21T02:40:43.395777+0000","last_peered":"2024-09-21T02:40:43.395777+0000","last_clean":"2024-09-21T02:40:43.395777+0000","last_became_active":"2024-09-21T02:39:46.850809+0000","last_became_peered":"2024-09-21T02:39:46.850809+0000","last_unstale":"2024-09-21T02:40:43.395777+0000","last_undegraded":"2024-09-21T02:40:43.395777+0000","last_fullsized":"2024-09-21T02:40:43.395777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.396921+0000","last_change":"2024-09-21T02:39:46.850585+0000","last_active":"2024-09-21T02:40:43.396921+0000","last_peered":"2024-09-21T02:40:43.396921+0000","last_clean":"2024-09-21T02:40:43.396921+0000","last_became_active":"2024-09-21T02:39:46.850114+0000","last_became_peered":"2024-09-21T02:39:46.850114+0000","last_unstale":"2024-09-21T02:40:43.396921+0000","last_undegraded":"2024-09-21T02:40:43.396921+0000","last_fullsized":"2024-09-21T02:40:43.396921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:04.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402958+0000","last_change":"2024-09-21T02:39:46.850416+0000","last_active":"2024-09-21T02:40:43.402958+0000","last_peered":"2024-09-21T02:40:43.402958+0000","last_clean":"2024-09-21T02:40:43.402958+0000","last_became_active":"2024-09-21T02:39:46.850035+0000","last_became_peered":"2024-09-21T02:39:46.850035+0000","last_unstale":"2024-09-21T02:40:43.402958+0000","last_undegraded":"2024-09-21T02:40:43.402958+0000","last_fullsized":"2024-09-21T02:40:43.402958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:09.139331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411802+0000","last_change":"2024-09-21T02:39:46.861376+0000","last_active":"2024-09-21T02:40:43.411802+0000","last_peered":"2024-09-21T02:40:43.411802+0000","last_clean":"2024-09-21T02:40:43.411802+0000","last_became_active":"2024-09-21T02:39:46.861011+0000","last_became_peered":"2024-09-21T02:39:46.861011+0000","last_unstale":"2024-09-21T02:40:43.411802+0000","last_undegraded":"2024-09-21T02:40:43.411802+0000","last_fullsized":"2024-09-21T02:40:43.411802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:45.123705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402046+0000","last_change":"2024-09-21T02:39:46.846135+0000","last_active":"2024-09-21T02:40:43.402046+0000","last_peered":"2024-09-21T02:40:43.402046+0000","last_clean":"2024-09-21T02:40:43.402046+0000","last_became_active":"2024-09-21T02:39:46.845693+0000","last_became_peered":"2024-09-21T02:39:46.845693+0000","last_unstale":"2024-09-21T02:40:43.402046+0000","last_undegraded":"2024-09-21T02:40:43.402046+0000","last_fullsized":"2024-09-21T02:40:43.402046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:55.830932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402612+0000","last_change":"2024-09-21T02:39:46.853300+0000","last_active":"2024-09-21T02:40:43.402612+0000","last_peered":"2024-09-21T02:40:43.402612+0000","last_clean":"2024-09-21T02:40:43.402612+0000","last_became_active":"2024-09-21T02:39:46.852953+0000","last_became_peered":"2024-09-21T02:39:46.852953+0000","last_unstale":"2024-09-21T02:40:43.402612+0000","last_undegraded":"2024-09-21T02:40:43.402612+0000","last_fullsized":"2024-09-21T02:40:43.402612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:04.475743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400076+0000","last_change":"2024-09-21T02:39:46.854976+0000","last_active":"2024-09-21T02:40:43.400076+0000","last_peered":"2024-09-21T02:40:43.400076+0000","last_clean":"2024-09-21T02:40:43.400076+0000","last_became_active":"2024-09-21T02:39:46.852970+0000","last_became_peered":"2024-09-21T02:39:46.852970+0000","last_unstale":"2024-09-21T02:40:43.400076+0000","last_undegraded":"2024-09-21T02:40:43.400076+0000","last_fullsized":"2024-09-21T02:40:43.400076+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:54.654967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399898+0000","last_change":"2024-09-21T02:39:46.848698+0000","last_active":"2024-09-21T02:40:43.399898+0000","last_peered":"2024-09-21T02:40:43.399898+0000","last_clean":"2024-09-21T02:40:43.399898+0000","last_became_active":"2024-09-21T02:39:46.848374+0000","last_became_peered":"2024-09-21T02:39:46.848374+0000","last_unstale":"2024-09-21T02:40:43.399898+0000","last_undegraded":"2024-09-21T02:40:43.399898+0000","last_fullsized":"2024-09-21T02:40:43.399898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:59.589062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399265+0000","last_change":"2024-09-21T02:39:46.851850+0000","last_active":"2024-09-21T02:40:43.399265+0000","last_peered":"2024-09-21T02:40:43.399265+0000","last_clean":"2024-09-21T02:40:43.399265+0000","last_became_active":"2024-09-21T02:39:46.851408+0000","last_became_peered":"2024-09-21T02:39:46.851408+0000","last_unstale":"2024-09-21T02:40:43.399265+0000","last_undegraded":"2024-09-21T02:40:43.399265+0000","last_fullsized":"2024-09-21T02:40:43.399265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:27.831504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65277,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":162,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":180529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743452,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":491931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939681,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1675264,"data_stored":1144571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103206,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":492167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299437,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":492087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495665,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1593344,"data_stored":1088387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659192,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":487343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1601536,"data_stored":1083584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986242,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":492384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182472,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":487537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708772,"statfs":{"total":95995035648,"available":95957782528,"internally_reserved":0,"allocated":1060864,"data_stored":542228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":540487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":488731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":54975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:41:02.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:41:02.816 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:02.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:02 smithi084 ceph-mon[30747]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T02:41:02.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:02 smithi084 ceph-mon[30747]: from='client.24934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:03.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:02 smithi172 ceph-mon[35067]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T02:41:03.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:02 smithi172 ceph-mon[35067]: from='client.24934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:02 smithi090 ceph-mon[34571]: pgmap v356: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-21T02:41:03.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:02 smithi090 ceph-mon[34571]: from='client.24934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 -- 172.21.15.84:0/4056692769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614103b60 msgr2=0x7fe614103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 --2- 172.21.15.84:0/4056692769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614103b60 0x7fe614103f70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe604009900 tx=0x7fe60402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 -- 172.21.15.84:0/4056692769 shutdown_connections 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 --2- 172.21.15.84:0/4056692769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe614109df0 0x7fe614110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 --2- 172.21.15.84:0/4056692769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6141094a0 0x7fe6141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 --2- 172.21.15.84:0/4056692769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe614103b60 0x7fe614103f70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 -- 172.21.15.84:0/4056692769 >> 172.21.15.84:0/4056692769 conn(0x7fe61407b850 msgr2=0x7fe61407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 -- 172.21.15.84:0/4056692769 shutdown_connections 2024-09-21T02:41:03.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.474+0000 7fe618a00640 1 -- 172.21.15.84:0/4056692769 wait complete. 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.475+0000 7fe618a00640 1 Processor -- start 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.475+0000 7fe618a00640 1 -- start start 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe618a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe614103b60 0x7fe61419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe618a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6141094a0 0x7fe61419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe618a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe614109df0 0x7fe6141a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe618a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe614113bf0 con 0x7fe6141094a0 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe618a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe614113a70 con 0x7fe614109df0 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe618a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe614113d70 con 0x7fe614103b60 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe609400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6141094a0 0x7fe61419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe609400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6141094a0 0x7fe61419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37846/0 (socket says 172.21.15.84:37846) 2024-09-21T02:41:03.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe612800640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe614109df0 0x7fe6141a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe609400640 1 -- 172.21.15.84:0/4080638224 learned_addr learned my addr 172.21.15.84:0/4080638224 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe611e00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe614103b60 0x7fe61419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe612800640 1 -- 172.21.15.84:0/4080638224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe614103b60 msgr2=0x7fe61419c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe612800640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe614103b60 0x7fe61419c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe612800640 1 -- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6141094a0 msgr2=0x7fe61419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe612800640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6141094a0 0x7fe61419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe612800640 1 -- 172.21.15.84:0/4080638224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6141a2730 con 0x7fe614109df0 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.476+0000 7fe609400640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6141094a0 0x7fe61419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:03.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.477+0000 7fe612800640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe614109df0 0x7fe6141a2000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009fd0 tx=0x7fe60c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:03.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.477+0000 7fe60b400640 1 -- 172.21.15.84:0/4080638224 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00ce20 con 0x7fe614109df0 2024-09-21T02:41:03.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.477+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6141a2a20 con 0x7fe614109df0 2024-09-21T02:41:03.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.477+0000 7fe60b400640 1 -- 172.21.15.84:0/4080638224 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe60c005020 con 0x7fe614109df0 2024-09-21T02:41:03.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.477+0000 7fe60b400640 1 -- 172.21.15.84:0/4080638224 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c010720 con 0x7fe614109df0 2024-09-21T02:41:03.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.477+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6141a9180 con 0x7fe614109df0 2024-09-21T02:41:03.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.478+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe614103f70 con 0x7fe614109df0 2024-09-21T02:41:03.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.481+0000 7fe60b400640 1 -- 172.21.15.84:0/4080638224 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe60c005560 con 0x7fe614109df0 2024-09-21T02:41:03.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.482+0000 7fe60b400640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5f80b65a0 0x7fe5f80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:03.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.482+0000 7fe60b400640 1 -- 172.21.15.84:0/4080638224 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fe60c0e7e90 con 0x7fe614109df0 2024-09-21T02:41:03.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.482+0000 7fe611e00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5f80b65a0 0x7fe5f80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:03.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.483+0000 7fe611e00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5f80b65a0 0x7fe5f80b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe604009230 tx=0x7fe6040058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:03.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.484+0000 7fe60b400640 1 -- 172.21.15.84:0/4080638224 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe60c0ae200 con 0x7fe614109df0 2024-09-21T02:41:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.669+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6141079c0 con 0x7fe5f80b65a0 2024-09-21T02:41:03.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.676+0000 7fe60b400640 1 -- 172.21.15.84:0/4080638224 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340347 (secure 0 0 0) 0x7fe6141079c0 con 0x7fe5f80b65a0 2024-09-21T02:41:03.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:03.682 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T02:41:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5f80b65a0 msgr2=0x7fe5f80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5f80b65a0 0x7fe5f80b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe604009230 tx=0x7fe6040058d0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe614109df0 msgr2=0x7fe6141a2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe614109df0 0x7fe6141a2000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009fd0 tx=0x7fe60c00ef10 comp rx=0 tx=0).stop 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 shutdown_connections 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe614109df0 0x7fe6141a2000 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6141094a0 0x7fe61419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe5f80b65a0 0x7fe5f80b8ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 --2- 172.21.15.84:0/4080638224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe614103b60 0x7fe61419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 >> 172.21.15.84:0/4080638224 conn(0x7fe61407b850 msgr2=0x7fe6141072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 shutdown_connections 2024-09-21T02:41:03.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:03.682+0000 7fe618a00640 1 -- 172.21.15.84:0/4080638224 wait complete. 2024-09-21T02:41:04.561 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-09-21T02:41:03.599285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655879,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":215,"num_read_kb":203,"num_write":287,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391988,"kb_used_data":13604,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549836,"statfs":{"total":1151940427776,"available":1151539032064,"internally_reserved":0,"allocated":13930496,"data_stored":7846739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34473,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":64,"num_write":21,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003643"},"pg_stats":[{"pgid":"2.1f","version":"84'9","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413175+0000","last_change":"2024-09-21T02:39:43.823658+0000","last_active":"2024-09-21T02:40:43.413175+0000","last_peered":"2024-09-21T02:40:43.413175+0000","last_clean":"2024-09-21T02:40:43.413175+0000","last_became_active":"2024-09-21T02:39:43.823211+0000","last_became_peered":"2024-09-21T02:39:43.823211+0000","last_unstale":"2024-09-21T02:40:43.413175+0000","last_undegraded":"2024-09-21T02:40:43.413175+0000","last_fullsized":"2024-09-21T02:40:43.413175+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:00.505552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397896+0000","last_change":"2024-09-21T02:39:46.850819+0000","last_active":"2024-09-21T02:40:43.397896+0000","last_peered":"2024-09-21T02:40:43.397896+0000","last_clean":"2024-09-21T02:40:43.397896+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:40:43.397896+0000","last_undegraded":"2024-09-21T02:40:43.397896+0000","last_fullsized":"2024-09-21T02:40:43.397896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:21.280788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399113+0000","last_change":"2024-09-21T02:39:56.937452+0000","last_active":"2024-09-21T02:40:43.399113+0000","last_peered":"2024-09-21T02:40:43.399113+0000","last_clean":"2024-09-21T02:40:43.399113+0000","last_became_active":"2024-09-21T02:39:56.936985+0000","last_became_peered":"2024-09-21T02:39:56.936985+0000","last_unstale":"2024-09-21T02:40:43.399113+0000","last_undegraded":"2024-09-21T02:40:43.399113+0000","last_fullsized":"2024-09-21T02:40:43.399113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:39.614222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398131+0000","last_change":"2024-09-21T02:39:43.828030+0000","last_active":"2024-09-21T02:40:43.398131+0000","last_peered":"2024-09-21T02:40:43.398131+0000","last_clean":"2024-09-21T02:40:43.398131+0000","last_became_active":"2024-09-21T02:39:43.827692+0000","last_became_peered":"2024-09-21T02:39:43.827692+0000","last_unstale":"2024-09-21T02:40:43.398131+0000","last_undegraded":"2024-09-21T02:40:43.398131+0000","last_fullsized":"2024-09-21T02:40:43.398131+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:32.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400251+0000","last_change":"2024-09-21T02:39:46.854718+0000","last_active":"2024-09-21T02:40:43.400251+0000","last_peered":"2024-09-21T02:40:43.400251+0000","last_clean":"2024-09-21T02:40:43.400251+0000","last_became_active":"2024-09-21T02:39:46.854355+0000","last_became_peered":"2024-09-21T02:39:46.854355+0000","last_unstale":"2024-09-21T02:40:43.400251+0000","last_undegraded":"2024-09-21T02:40:43.400251+0000","last_fullsized":"2024-09-21T02:40:43.400251+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:58.894397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401281+0000","last_change":"2024-09-21T02:39:56.930764+0000","last_active":"2024-09-21T02:40:43.401281+0000","last_peered":"2024-09-21T02:40:43.401281+0000","last_clean":"2024-09-21T02:40:43.401281+0000","last_became_active":"2024-09-21T02:39:56.930243+0000","last_became_peered":"2024-09-21T02:39:56.930243+0000","last_unstale":"2024-09-21T02:40:43.401281+0000","last_undegraded":"2024-09-21T02:40:43.401281+0000","last_fullsized":"2024-09-21T02:40:43.401281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:20.283102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403364+0000","last_change":"2024-09-21T02:39:43.824749+0000","last_active":"2024-09-21T02:40:43.403364+0000","last_peered":"2024-09-21T02:40:43.403364+0000","last_clean":"2024-09-21T02:40:43.403364+0000","last_became_active":"2024-09-21T02:39:43.824385+0000","last_became_peered":"2024-09-21T02:39:43.824385+0000","last_unstale":"2024-09-21T02:40:43.403364+0000","last_undegraded":"2024-09-21T02:40:43.403364+0000","last_fullsized":"2024-09-21T02:40:43.403364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395265+0000","last_change":"2024-09-21T02:39:46.856048+0000","last_active":"2024-09-21T02:40:43.395265+0000","last_peered":"2024-09-21T02:40:43.395265+0000","last_clean":"2024-09-21T02:40:43.395265+0000","last_became_active":"2024-09-21T02:39:46.855687+0000","last_became_peered":"2024-09-21T02:39:46.855687+0000","last_unstale":"2024-09-21T02:40:43.395265+0000","last_undegraded":"2024-09-21T02:40:43.395265+0000","last_fullsized":"2024-09-21T02:40:43.395265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:11.708028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402440+0000","last_change":"2024-09-21T02:39:56.931495+0000","last_active":"2024-09-21T02:40:43.402440+0000","last_peered":"2024-09-21T02:40:43.402440+0000","last_clean":"2024-09-21T02:40:43.402440+0000","last_became_active":"2024-09-21T02:39:56.930586+0000","last_became_peered":"2024-09-21T02:39:56.930586+0000","last_unstale":"2024-09-21T02:40:43.402440+0000","last_undegraded":"2024-09-21T02:40:43.402440+0000","last_fullsized":"2024-09-21T02:40:43.402440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:56.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.409321+0000","last_change":"2024-09-21T02:40:43.408517+0000","last_active":"2024-09-21T02:40:43.409321+0000","last_peered":"2024-09-21T02:40:43.409321+0000","last_clean":"2024-09-21T02:40:43.409321+0000","last_became_active":"2024-09-21T02:40:43.402800+0000","last_became_peered":"2024-09-21T02:40:43.402800+0000","last_unstale":"2024-09-21T02:40:43.409321+0000","last_undegraded":"2024-09-21T02:40:43.409321+0000","last_fullsized":"2024-09-21T02:40:43.409321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:46.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395583+0000","last_change":"2024-09-21T02:39:46.855990+0000","last_active":"2024-09-21T02:40:43.395583+0000","last_peered":"2024-09-21T02:40:43.395583+0000","last_clean":"2024-09-21T02:40:43.395583+0000","last_became_active":"2024-09-21T02:39:46.855602+0000","last_became_peered":"2024-09-21T02:39:46.855602+0000","last_unstale":"2024-09-21T02:40:43.395583+0000","last_undegraded":"2024-09-21T02:40:43.395583+0000","last_fullsized":"2024-09-21T02:40:43.395583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:43.207141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401502+0000","last_change":"2024-09-21T02:39:56.924868+0000","last_active":"2024-09-21T02:40:43.401502+0000","last_peered":"2024-09-21T02:40:43.401502+0000","last_clean":"2024-09-21T02:40:43.401502+0000","last_became_active":"2024-09-21T02:39:56.924353+0000","last_became_peered":"2024-09-21T02:39:56.924353+0000","last_unstale":"2024-09-21T02:40:43.401502+0000","last_undegraded":"2024-09-21T02:40:43.401502+0000","last_fullsized":"2024-09-21T02:40:43.401502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:48.095244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401917+0000","last_change":"2024-09-21T02:39:46.853077+0000","last_active":"2024-09-21T02:40:43.401917+0000","last_peered":"2024-09-21T02:40:43.401917+0000","last_clean":"2024-09-21T02:40:43.401917+0000","last_became_active":"2024-09-21T02:39:46.852691+0000","last_became_peered":"2024-09-21T02:39:46.852691+0000","last_unstale":"2024-09-21T02:40:43.401917+0000","last_undegraded":"2024-09-21T02:40:43.401917+0000","last_fullsized":"2024-09-21T02:40:43.401917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:12.427934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":59,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411313+0000","last_change":"2024-09-21T02:40:43.411229+0000","last_active":"2024-09-21T02:40:43.411313+0000","last_peered":"2024-09-21T02:40:43.411313+0000","last_clean":"2024-09-21T02:40:43.411313+0000","last_became_active":"2024-09-21T02:40:43.404833+0000","last_became_peered":"2024-09-21T02:40:43.404833+0000","last_unstale":"2024-09-21T02:40:43.411313+0000","last_undegraded":"2024-09-21T02:40:43.411313+0000","last_fullsized":"2024-09-21T02:40:43.411313+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:22.812239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402117+0000","last_change":"2024-09-21T02:39:56.922205+0000","last_active":"2024-09-21T02:40:43.402117+0000","last_peered":"2024-09-21T02:40:43.402117+0000","last_clean":"2024-09-21T02:40:43.402117+0000","last_became_active":"2024-09-21T02:39:56.921702+0000","last_became_peered":"2024-09-21T02:39:56.921702+0000","last_unstale":"2024-09-21T02:40:43.402117+0000","last_undegraded":"2024-09-21T02:40:43.402117+0000","last_fullsized":"2024-09-21T02:40:43.402117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:07.622691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397425+0000","last_change":"2024-09-21T02:39:46.846380+0000","last_active":"2024-09-21T02:40:43.397425+0000","last_peered":"2024-09-21T02:40:43.397425+0000","last_clean":"2024-09-21T02:40:43.397425+0000","last_became_active":"2024-09-21T02:39:46.845972+0000","last_became_peered":"2024-09-21T02:39:46.845972+0000","last_unstale":"2024-09-21T02:40:43.397425+0000","last_undegraded":"2024-09-21T02:40:43.397425+0000","last_fullsized":"2024-09-21T02:40:43.397425+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:44.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398145+0000","last_change":"2024-09-21T02:39:43.824394+0000","last_active":"2024-09-21T02:40:43.398145+0000","last_peered":"2024-09-21T02:40:43.398145+0000","last_clean":"2024-09-21T02:40:43.398145+0000","last_became_active":"2024-09-21T02:39:43.823947+0000","last_became_peered":"2024-09-21T02:39:43.823947+0000","last_unstale":"2024-09-21T02:40:43.398145+0000","last_undegraded":"2024-09-21T02:40:43.398145+0000","last_fullsized":"2024-09-21T02:40:43.398145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.083281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.414747+0000","last_change":"2024-09-21T02:40:43.413833+0000","last_active":"2024-09-21T02:40:43.414747+0000","last_peered":"2024-09-21T02:40:43.414747+0000","last_clean":"2024-09-21T02:40:43.414747+0000","last_became_active":"2024-09-21T02:40:43.413319+0000","last_became_peered":"2024-09-21T02:40:43.413319+0000","last_unstale":"2024-09-21T02:40:43.414747+0000","last_undegraded":"2024-09-21T02:40:43.414747+0000","last_fullsized":"2024-09-21T02:40:43.414747+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:40.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400514+0000","last_change":"2024-09-21T02:39:46.845544+0000","last_active":"2024-09-21T02:40:43.400514+0000","last_peered":"2024-09-21T02:40:43.400514+0000","last_clean":"2024-09-21T02:40:43.400514+0000","last_became_active":"2024-09-21T02:39:46.845162+0000","last_became_peered":"2024-09-21T02:39:46.845162+0000","last_unstale":"2024-09-21T02:40:43.400514+0000","last_undegraded":"2024-09-21T02:40:43.400514+0000","last_fullsized":"2024-09-21T02:40:43.400514+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:46.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397239+0000","last_change":"2024-09-21T02:39:43.825182+0000","last_active":"2024-09-21T02:40:43.397239+0000","last_peered":"2024-09-21T02:40:43.397239+0000","last_clean":"2024-09-21T02:40:43.397239+0000","last_became_active":"2024-09-21T02:39:43.824774+0000","last_became_peered":"2024-09-21T02:39:43.824774+0000","last_unstale":"2024-09-21T02:40:43.397239+0000","last_undegraded":"2024-09-21T02:40:43.397239+0000","last_fullsized":"2024-09-21T02:40:43.397239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:41.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413181+0000","last_change":"2024-09-21T02:39:56.935765+0000","last_active":"2024-09-21T02:40:43.413181+0000","last_peered":"2024-09-21T02:40:43.413181+0000","last_clean":"2024-09-21T02:40:43.413181+0000","last_became_active":"2024-09-21T02:39:56.933218+0000","last_became_peered":"2024-09-21T02:39:56.933218+0000","last_unstale":"2024-09-21T02:40:43.413181+0000","last_undegraded":"2024-09-21T02:40:43.413181+0000","last_fullsized":"2024-09-21T02:40:43.413181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:28.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401745+0000","last_change":"2024-09-21T02:39:46.853769+0000","last_active":"2024-09-21T02:40:43.401745+0000","last_peered":"2024-09-21T02:40:43.401745+0000","last_clean":"2024-09-21T02:40:43.401745+0000","last_became_active":"2024-09-21T02:39:46.853347+0000","last_became_peered":"2024-09-21T02:39:46.853347+0000","last_unstale":"2024-09-21T02:40:43.401745+0000","last_undegraded":"2024-09-21T02:40:43.401745+0000","last_fullsized":"2024-09-21T02:40:43.401745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:01.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.408415+0000","last_change":"2024-09-21T02:40:43.408316+0000","last_active":"2024-09-21T02:40:43.408415+0000","last_peered":"2024-09-21T02:40:43.408415+0000","last_clean":"2024-09-21T02:40:43.408415+0000","last_became_active":"2024-09-21T02:40:43.402877+0000","last_became_peered":"2024-09-21T02:40:43.402877+0000","last_unstale":"2024-09-21T02:40:43.408415+0000","last_undegraded":"2024-09-21T02:40:43.408415+0000","last_fullsized":"2024-09-21T02:40:43.408415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.712477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402131+0000","last_change":"2024-09-21T02:39:56.928251+0000","last_active":"2024-09-21T02:40:43.402131+0000","last_peered":"2024-09-21T02:40:43.402131+0000","last_clean":"2024-09-21T02:40:43.402131+0000","last_became_active":"2024-09-21T02:39:56.927772+0000","last_became_peered":"2024-09-21T02:39:56.927772+0000","last_unstale":"2024-09-21T02:40:43.402131+0000","last_undegraded":"2024-09-21T02:40:43.402131+0000","last_fullsized":"2024-09-21T02:40:43.402131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:40.762245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.418346+0000","last_change":"2024-09-21T02:40:43.418238+0000","last_active":"2024-09-21T02:40:43.418346+0000","last_peered":"2024-09-21T02:40:43.418346+0000","last_clean":"2024-09-21T02:40:43.418346+0000","last_became_active":"2024-09-21T02:40:43.417728+0000","last_became_peered":"2024-09-21T02:40:43.417728+0000","last_unstale":"2024-09-21T02:40:43.418346+0000","last_undegraded":"2024-09-21T02:40:43.418346+0000","last_fullsized":"2024-09-21T02:40:43.418346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:35.244275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403172+0000","last_change":"2024-09-21T02:39:43.840567+0000","last_active":"2024-09-21T02:40:43.403172+0000","last_peered":"2024-09-21T02:40:43.403172+0000","last_clean":"2024-09-21T02:40:43.403172+0000","last_became_active":"2024-09-21T02:39:43.840279+0000","last_became_peered":"2024-09-21T02:39:43.840279+0000","last_unstale":"2024-09-21T02:40:43.403172+0000","last_undegraded":"2024-09-21T02:40:43.403172+0000","last_fullsized":"2024-09-21T02:40:43.403172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:42.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399752+0000","last_change":"2024-09-21T02:39:56.920425+0000","last_active":"2024-09-21T02:40:43.399752+0000","last_peered":"2024-09-21T02:40:43.399752+0000","last_clean":"2024-09-21T02:40:43.399752+0000","last_became_active":"2024-09-21T02:39:56.919610+0000","last_became_peered":"2024-09-21T02:39:56.919610+0000","last_unstale":"2024-09-21T02:40:43.399752+0000","last_undegraded":"2024-09-21T02:40:43.399752+0000","last_fullsized":"2024-09-21T02:40:43.399752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398383+0000","last_change":"2024-09-21T02:39:46.845188+0000","last_active":"2024-09-21T02:40:43.398383+0000","last_peered":"2024-09-21T02:40:43.398383+0000","last_clean":"2024-09-21T02:40:43.398383+0000","last_became_active":"2024-09-21T02:39:46.844818+0000","last_became_peered":"2024-09-21T02:39:46.844818+0000","last_unstale":"2024-09-21T02:40:43.398383+0000","last_undegraded":"2024-09-21T02:40:43.398383+0000","last_fullsized":"2024-09-21T02:40:43.398383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.853370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'10","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:57.862061+0000","last_change":"2024-09-21T02:39:43.822226+0000","last_active":"2024-09-21T02:40:57.862061+0000","last_peered":"2024-09-21T02:40:57.862061+0000","last_clean":"2024-09-21T02:40:57.862061+0000","last_became_active":"2024-09-21T02:39:43.821798+0000","last_became_peered":"2024-09-21T02:39:43.821798+0000","last_unstale":"2024-09-21T02:40:57.862061+0000","last_undegraded":"2024-09-21T02:40:57.862061+0000","last_fullsized":"2024-09-21T02:40:57.862061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:38.822330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.396683+0000","last_change":"2024-09-21T02:39:56.919521+0000","last_active":"2024-09-21T02:40:43.396683+0000","last_peered":"2024-09-21T02:40:43.396683+0000","last_clean":"2024-09-21T02:40:43.396683+0000","last_became_active":"2024-09-21T02:39:56.918042+0000","last_became_peered":"2024-09-21T02:39:56.918042+0000","last_unstale":"2024-09-21T02:40:43.396683+0000","last_undegraded":"2024-09-21T02:40:43.396683+0000","last_fullsized":"2024-09-21T02:40:43.396683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:21.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416234+0000","last_change":"2024-09-21T02:39:46.861856+0000","last_active":"2024-09-21T02:40:43.416234+0000","last_peered":"2024-09-21T02:40:43.416234+0000","last_clean":"2024-09-21T02:40:43.416234+0000","last_became_active":"2024-09-21T02:39:46.861416+0000","last_became_peered":"2024-09-21T02:39:46.861416+0000","last_unstale":"2024-09-21T02:40:43.416234+0000","last_undegraded":"2024-09-21T02:40:43.416234+0000","last_fullsized":"2024-09-21T02:40:43.416234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:46.547988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403495+0000","last_change":"2024-09-21T02:39:43.826232+0000","last_active":"2024-09-21T02:40:43.403495+0000","last_peered":"2024-09-21T02:40:43.403495+0000","last_clean":"2024-09-21T02:40:43.403495+0000","last_became_active":"2024-09-21T02:39:43.825789+0000","last_became_peered":"2024-09-21T02:39:43.825789+0000","last_unstale":"2024-09-21T02:40:43.403495+0000","last_undegraded":"2024-09-21T02:40:43.403495+0000","last_fullsized":"2024-09-21T02:40:43.403495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:19.465106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398765+0000","last_change":"2024-09-21T02:39:56.917802+0000","last_active":"2024-09-21T02:40:43.398765+0000","last_peered":"2024-09-21T02:40:43.398765+0000","last_clean":"2024-09-21T02:40:43.398765+0000","last_became_active":"2024-09-21T02:39:56.917286+0000","last_became_peered":"2024-09-21T02:39:56.917286+0000","last_unstale":"2024-09-21T02:40:43.398765+0000","last_undegraded":"2024-09-21T02:40:43.398765+0000","last_fullsized":"2024-09-21T02:40:43.398765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:19.055218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411876+0000","last_change":"2024-09-21T02:39:46.858829+0000","last_active":"2024-09-21T02:40:43.411876+0000","last_peered":"2024-09-21T02:40:43.411876+0000","last_clean":"2024-09-21T02:40:43.411876+0000","last_became_active":"2024-09-21T02:39:46.858392+0000","last_became_peered":"2024-09-21T02:39:46.858392+0000","last_unstale":"2024-09-21T02:40:43.411876+0000","last_undegraded":"2024-09-21T02:40:43.411876+0000","last_fullsized":"2024-09-21T02:40:43.411876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:29.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412401+0000","last_change":"2024-09-21T02:39:43.825129+0000","last_active":"2024-09-21T02:40:43.412401+0000","last_peered":"2024-09-21T02:40:43.412401+0000","last_clean":"2024-09-21T02:40:43.412401+0000","last_became_active":"2024-09-21T02:39:43.824756+0000","last_became_peered":"2024-09-21T02:39:43.824756+0000","last_unstale":"2024-09-21T02:40:43.412401+0000","last_undegraded":"2024-09-21T02:40:43.412401+0000","last_fullsized":"2024-09-21T02:40:43.412401+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:28.771033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401821+0000","last_change":"2024-09-21T02:39:56.929186+0000","last_active":"2024-09-21T02:40:43.401821+0000","last_peered":"2024-09-21T02:40:43.401821+0000","last_clean":"2024-09-21T02:40:43.401821+0000","last_became_active":"2024-09-21T02:39:56.928608+0000","last_became_peered":"2024-09-21T02:39:56.928608+0000","last_unstale":"2024-09-21T02:40:43.401821+0000","last_undegraded":"2024-09-21T02:40:43.401821+0000","last_fullsized":"2024-09-21T02:40:43.401821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:47.860230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412131+0000","last_change":"2024-09-21T02:39:46.860375+0000","last_active":"2024-09-21T02:40:43.412131+0000","last_peered":"2024-09-21T02:40:43.412131+0000","last_clean":"2024-09-21T02:40:43.412131+0000","last_became_active":"2024-09-21T02:39:46.860035+0000","last_became_peered":"2024-09-21T02:39:46.860035+0000","last_unstale":"2024-09-21T02:40:43.412131+0000","last_undegraded":"2024-09-21T02:40:43.412131+0000","last_fullsized":"2024-09-21T02:40:43.412131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:07.761203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402127+0000","last_change":"2024-09-21T02:39:43.827869+0000","last_active":"2024-09-21T02:40:43.402127+0000","last_peered":"2024-09-21T02:40:43.402127+0000","last_clean":"2024-09-21T02:40:43.402127+0000","last_became_active":"2024-09-21T02:39:43.827375+0000","last_became_peered":"2024-09-21T02:39:43.827375+0000","last_unstale":"2024-09-21T02:40:43.402127+0000","last_undegraded":"2024-09-21T02:40:43.402127+0000","last_fullsized":"2024-09-21T02:40:43.402127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:48.257387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416024+0000","last_change":"2024-09-21T02:39:56.917766+0000","last_active":"2024-09-21T02:40:43.416024+0000","last_peered":"2024-09-21T02:40:43.416024+0000","last_clean":"2024-09-21T02:40:43.416024+0000","last_became_active":"2024-09-21T02:39:56.917309+0000","last_became_peered":"2024-09-21T02:39:56.917309+0000","last_unstale":"2024-09-21T02:40:43.416024+0000","last_undegraded":"2024-09-21T02:40:43.416024+0000","last_fullsized":"2024-09-21T02:40:43.416024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:36.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395127+0000","last_change":"2024-09-21T02:39:46.851416+0000","last_active":"2024-09-21T02:40:43.395127+0000","last_peered":"2024-09-21T02:40:43.395127+0000","last_clean":"2024-09-21T02:40:43.395127+0000","last_became_active":"2024-09-21T02:39:46.851055+0000","last_became_peered":"2024-09-21T02:39:46.851055+0000","last_unstale":"2024-09-21T02:40:43.395127+0000","last_undegraded":"2024-09-21T02:40:43.395127+0000","last_fullsized":"2024-09-21T02:40:43.395127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:50.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":65,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:41:00.442344+0000","last_change":"2024-09-21T02:39:43.825162+0000","last_active":"2024-09-21T02:41:00.442344+0000","last_peered":"2024-09-21T02:41:00.442344+0000","last_clean":"2024-09-21T02:41:00.442344+0000","last_became_active":"2024-09-21T02:39:43.824811+0000","last_became_peered":"2024-09-21T02:39:43.824811+0000","last_unstale":"2024-09-21T02:41:00.442344+0000","last_undegraded":"2024-09-21T02:41:00.442344+0000","last_fullsized":"2024-09-21T02:41:00.442344+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:10.020902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417125+0000","last_change":"2024-09-21T02:39:56.920750+0000","last_active":"2024-09-21T02:40:43.417125+0000","last_peered":"2024-09-21T02:40:43.417125+0000","last_clean":"2024-09-21T02:40:43.417125+0000","last_became_active":"2024-09-21T02:39:56.920245+0000","last_became_peered":"2024-09-21T02:39:56.920245+0000","last_unstale":"2024-09-21T02:40:43.417125+0000","last_undegraded":"2024-09-21T02:40:43.417125+0000","last_fullsized":"2024-09-21T02:40:43.417125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:53.718596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416626+0000","last_change":"2024-09-21T02:39:46.854202+0000","last_active":"2024-09-21T02:40:43.416626+0000","last_peered":"2024-09-21T02:40:43.416626+0000","last_clean":"2024-09-21T02:40:43.416626+0000","last_became_active":"2024-09-21T02:39:46.853076+0000","last_became_peered":"2024-09-21T02:39:46.853076+0000","last_unstale":"2024-09-21T02:40:43.416626+0000","last_undegraded":"2024-09-21T02:40:43.416626+0000","last_fullsized":"2024-09-21T02:40:43.416626+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:59.729777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401523+0000","last_change":"2024-09-21T02:39:43.826351+0000","last_active":"2024-09-21T02:40:43.401523+0000","last_peered":"2024-09-21T02:40:43.401523+0000","last_clean":"2024-09-21T02:40:43.401523+0000","last_became_active":"2024-09-21T02:39:43.825683+0000","last_became_peered":"2024-09-21T02:39:43.825683+0000","last_unstale":"2024-09-21T02:40:43.401523+0000","last_undegraded":"2024-09-21T02:40:43.401523+0000","last_fullsized":"2024-09-21T02:40:43.401523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:16.934280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395931+0000","last_change":"2024-09-21T02:39:56.937591+0000","last_active":"2024-09-21T02:40:43.395931+0000","last_peered":"2024-09-21T02:40:43.395931+0000","last_clean":"2024-09-21T02:40:43.395931+0000","last_became_active":"2024-09-21T02:39:56.937178+0000","last_became_peered":"2024-09-21T02:39:56.937178+0000","last_unstale":"2024-09-21T02:40:43.395931+0000","last_undegraded":"2024-09-21T02:40:43.395931+0000","last_fullsized":"2024-09-21T02:40:43.395931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:21.218393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397507+0000","last_change":"2024-09-21T02:39:46.858255+0000","last_active":"2024-09-21T02:40:43.397507+0000","last_peered":"2024-09-21T02:40:43.397507+0000","last_clean":"2024-09-21T02:40:43.397507+0000","last_became_active":"2024-09-21T02:39:46.856726+0000","last_became_peered":"2024-09-21T02:39:46.856726+0000","last_unstale":"2024-09-21T02:40:43.397507+0000","last_undegraded":"2024-09-21T02:40:43.397507+0000","last_fullsized":"2024-09-21T02:40:43.397507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:33.890538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403283+0000","last_change":"2024-09-21T02:39:43.823562+0000","last_active":"2024-09-21T02:40:43.403283+0000","last_peered":"2024-09-21T02:40:43.403283+0000","last_clean":"2024-09-21T02:40:43.403283+0000","last_became_active":"2024-09-21T02:39:43.823142+0000","last_became_peered":"2024-09-21T02:39:43.823142+0000","last_unstale":"2024-09-21T02:40:43.403283+0000","last_undegraded":"2024-09-21T02:40:43.403283+0000","last_fullsized":"2024-09-21T02:40:43.403283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:36.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":117,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401756+0000","last_change":"2024-09-21T02:38:27.972237+0000","last_active":"2024-09-21T02:40:43.401756+0000","last_peered":"2024-09-21T02:40:43.401756+0000","last_clean":"2024-09-21T02:40:43.401756+0000","last_became_active":"2024-09-21T02:38:27.966297+0000","last_became_peered":"2024-09-21T02:38:27.966297+0000","last_unstale":"2024-09-21T02:40:43.401756+0000","last_undegraded":"2024-09-21T02:40:43.401756+0000","last_fullsized":"2024-09-21T02:40:43.401756+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_clean_scrub_stamp":"2024-09-21T02:34:42.292034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:24.592682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402820+0000","last_change":"2024-09-21T02:39:56.930418+0000","last_active":"2024-09-21T02:40:43.402820+0000","last_peered":"2024-09-21T02:40:43.402820+0000","last_clean":"2024-09-21T02:40:43.402820+0000","last_became_active":"2024-09-21T02:39:56.929920+0000","last_became_peered":"2024-09-21T02:39:56.929920+0000","last_unstale":"2024-09-21T02:40:43.402820+0000","last_undegraded":"2024-09-21T02:40:43.402820+0000","last_fullsized":"2024-09-21T02:40:43.402820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:15.195020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403073+0000","last_change":"2024-09-21T02:39:46.851466+0000","last_active":"2024-09-21T02:40:43.403073+0000","last_peered":"2024-09-21T02:40:43.403073+0000","last_clean":"2024-09-21T02:40:43.403073+0000","last_became_active":"2024-09-21T02:39:46.849945+0000","last_became_peered":"2024-09-21T02:39:46.849945+0000","last_unstale":"2024-09-21T02:40:43.403073+0000","last_undegraded":"2024-09-21T02:40:43.403073+0000","last_fullsized":"2024-09-21T02:40:43.403073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:07.424794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398775+0000","last_change":"2024-09-21T02:39:43.840894+0000","last_active":"2024-09-21T02:40:43.398775+0000","last_peered":"2024-09-21T02:40:43.398775+0000","last_clean":"2024-09-21T02:40:43.398775+0000","last_became_active":"2024-09-21T02:39:43.840437+0000","last_became_peered":"2024-09-21T02:39:43.840437+0000","last_unstale":"2024-09-21T02:40:43.398775+0000","last_undegraded":"2024-09-21T02:40:43.398775+0000","last_fullsized":"2024-09-21T02:40:43.398775+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:31.741218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395084+0000","last_change":"2024-09-21T02:39:56.924563+0000","last_active":"2024-09-21T02:40:43.395084+0000","last_peered":"2024-09-21T02:40:43.395084+0000","last_clean":"2024-09-21T02:40:43.395084+0000","last_became_active":"2024-09-21T02:39:56.923791+0000","last_became_peered":"2024-09-21T02:39:56.923791+0000","last_unstale":"2024-09-21T02:40:43.395084+0000","last_undegraded":"2024-09-21T02:40:43.395084+0000","last_fullsized":"2024-09-21T02:40:43.395084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:03.409737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402629+0000","last_change":"2024-09-21T02:39:46.858712+0000","last_active":"2024-09-21T02:40:43.402629+0000","last_peered":"2024-09-21T02:40:43.402629+0000","last_clean":"2024-09-21T02:40:43.402629+0000","last_became_active":"2024-09-21T02:39:46.858339+0000","last_became_peered":"2024-09-21T02:39:46.858339+0000","last_unstale":"2024-09-21T02:40:43.402629+0000","last_undegraded":"2024-09-21T02:40:43.402629+0000","last_fullsized":"2024-09-21T02:40:43.402629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.015904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395766+0000","last_change":"2024-09-21T02:39:43.829127+0000","last_active":"2024-09-21T02:40:43.395766+0000","last_peered":"2024-09-21T02:40:43.395766+0000","last_clean":"2024-09-21T02:40:43.395766+0000","last_became_active":"2024-09-21T02:39:43.828136+0000","last_became_peered":"2024-09-21T02:39:43.828136+0000","last_unstale":"2024-09-21T02:40:43.395766+0000","last_undegraded":"2024-09-21T02:40:43.395766+0000","last_fullsized":"2024-09-21T02:40:43.395766+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:39.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399781+0000","last_change":"2024-09-21T02:39:56.930823+0000","last_active":"2024-09-21T02:40:43.399781+0000","last_peered":"2024-09-21T02:40:43.399781+0000","last_clean":"2024-09-21T02:40:43.399781+0000","last_became_active":"2024-09-21T02:39:56.930379+0000","last_became_peered":"2024-09-21T02:39:56.930379+0000","last_unstale":"2024-09-21T02:40:43.399781+0000","last_undegraded":"2024-09-21T02:40:43.399781+0000","last_fullsized":"2024-09-21T02:40:43.399781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:01.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402678+0000","last_change":"2024-09-21T02:39:46.846873+0000","last_active":"2024-09-21T02:40:43.402678+0000","last_peered":"2024-09-21T02:40:43.402678+0000","last_clean":"2024-09-21T02:40:43.402678+0000","last_became_active":"2024-09-21T02:39:46.846502+0000","last_became_peered":"2024-09-21T02:39:46.846502+0000","last_unstale":"2024-09-21T02:40:43.402678+0000","last_undegraded":"2024-09-21T02:40:43.402678+0000","last_fullsized":"2024-09-21T02:40:43.402678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:20.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417234+0000","last_change":"2024-09-21T02:39:43.832273+0000","last_active":"2024-09-21T02:40:43.417234+0000","last_peered":"2024-09-21T02:40:43.417234+0000","last_clean":"2024-09-21T02:40:43.417234+0000","last_became_active":"2024-09-21T02:39:43.831705+0000","last_became_peered":"2024-09-21T02:39:43.831705+0000","last_unstale":"2024-09-21T02:40:43.417234+0000","last_undegraded":"2024-09-21T02:40:43.417234+0000","last_fullsized":"2024-09-21T02:40:43.417234+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:31.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395009+0000","last_change":"2024-09-21T02:39:56.920277+0000","last_active":"2024-09-21T02:40:43.395009+0000","last_peered":"2024-09-21T02:40:43.395009+0000","last_clean":"2024-09-21T02:40:43.395009+0000","last_became_active":"2024-09-21T02:39:56.919885+0000","last_became_peered":"2024-09-21T02:39:56.919885+0000","last_unstale":"2024-09-21T02:40:43.395009+0000","last_undegraded":"2024-09-21T02:40:43.395009+0000","last_fullsized":"2024-09-21T02:40:43.395009+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:32.750878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413604+0000","last_change":"2024-09-21T02:40:43.413459+0000","last_active":"2024-09-21T02:40:43.413604+0000","last_peered":"2024-09-21T02:40:43.413604+0000","last_clean":"2024-09-21T02:40:43.413604+0000","last_became_active":"2024-09-21T02:40:43.413012+0000","last_became_peered":"2024-09-21T02:40:43.413012+0000","last_unstale":"2024-09-21T02:40:43.413604+0000","last_undegraded":"2024-09-21T02:40:43.413604+0000","last_fullsized":"2024-09-21T02:40:43.413604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:23.971450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403135+0000","last_change":"2024-09-21T02:39:43.821955+0000","last_active":"2024-09-21T02:40:43.403135+0000","last_peered":"2024-09-21T02:40:43.403135+0000","last_clean":"2024-09-21T02:40:43.403135+0000","last_became_active":"2024-09-21T02:39:43.820480+0000","last_became_peered":"2024-09-21T02:39:43.820480+0000","last_unstale":"2024-09-21T02:40:43.403135+0000","last_undegraded":"2024-09-21T02:40:43.403135+0000","last_fullsized":"2024-09-21T02:40:43.403135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:51.201528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394840+0000","last_change":"2024-09-21T02:39:56.922017+0000","last_active":"2024-09-21T02:40:43.394840+0000","last_peered":"2024-09-21T02:40:43.394840+0000","last_clean":"2024-09-21T02:40:43.394840+0000","last_became_active":"2024-09-21T02:39:56.921616+0000","last_became_peered":"2024-09-21T02:39:56.921616+0000","last_unstale":"2024-09-21T02:40:43.394840+0000","last_undegraded":"2024-09-21T02:40:43.394840+0000","last_fullsized":"2024-09-21T02:40:43.394840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:38.499302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395072+0000","last_change":"2024-09-21T02:39:46.855445+0000","last_active":"2024-09-21T02:40:43.395072+0000","last_peered":"2024-09-21T02:40:43.395072+0000","last_clean":"2024-09-21T02:40:43.395072+0000","last_became_active":"2024-09-21T02:39:46.855053+0000","last_became_peered":"2024-09-21T02:39:46.855053+0000","last_unstale":"2024-09-21T02:40:43.395072+0000","last_undegraded":"2024-09-21T02:40:43.395072+0000","last_fullsized":"2024-09-21T02:40:43.395072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:19.122862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":57,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401763+0000","last_change":"2024-09-21T02:39:43.822744+0000","last_active":"2024-09-21T02:40:43.401763+0000","last_peered":"2024-09-21T02:40:43.401763+0000","last_clean":"2024-09-21T02:40:43.401763+0000","last_became_active":"2024-09-21T02:39:43.822339+0000","last_became_peered":"2024-09-21T02:39:43.822339+0000","last_unstale":"2024-09-21T02:40:43.401763+0000","last_undegraded":"2024-09-21T02:40:43.401763+0000","last_fullsized":"2024-09-21T02:40:43.401763+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:21.370224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417172+0000","last_change":"2024-09-21T02:39:56.929280+0000","last_active":"2024-09-21T02:40:43.417172+0000","last_peered":"2024-09-21T02:40:43.417172+0000","last_clean":"2024-09-21T02:40:43.417172+0000","last_became_active":"2024-09-21T02:39:56.928826+0000","last_became_peered":"2024-09-21T02:39:56.928826+0000","last_unstale":"2024-09-21T02:40:43.417172+0000","last_undegraded":"2024-09-21T02:40:43.417172+0000","last_fullsized":"2024-09-21T02:40:43.417172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:01.597772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401350+0000","last_change":"2024-09-21T02:39:46.852466+0000","last_active":"2024-09-21T02:40:43.401350+0000","last_peered":"2024-09-21T02:40:43.401350+0000","last_clean":"2024-09-21T02:40:43.401350+0000","last_became_active":"2024-09-21T02:39:46.852113+0000","last_became_peered":"2024-09-21T02:39:46.852113+0000","last_unstale":"2024-09-21T02:40:43.401350+0000","last_undegraded":"2024-09-21T02:40:43.401350+0000","last_fullsized":"2024-09-21T02:40:43.401350+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:26.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'4","reported_seq":66,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:59.441594+0000","last_change":"2024-09-21T02:39:43.822241+0000","last_active":"2024-09-21T02:40:59.441594+0000","last_peered":"2024-09-21T02:40:59.441594+0000","last_clean":"2024-09-21T02:40:59.441594+0000","last_became_active":"2024-09-21T02:39:43.820813+0000","last_became_peered":"2024-09-21T02:39:43.820813+0000","last_unstale":"2024-09-21T02:40:59.441594+0000","last_undegraded":"2024-09-21T02:40:59.441594+0000","last_fullsized":"2024-09-21T02:40:59.441594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:09.749207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.407227+0000","last_change":"2024-09-21T02:40:43.405942+0000","last_active":"2024-09-21T02:40:43.407227+0000","last_peered":"2024-09-21T02:40:43.407227+0000","last_clean":"2024-09-21T02:40:43.407227+0000","last_became_active":"2024-09-21T02:40:43.405455+0000","last_became_peered":"2024-09-21T02:40:43.405455+0000","last_unstale":"2024-09-21T02:40:43.407227+0000","last_undegraded":"2024-09-21T02:40:43.407227+0000","last_fullsized":"2024-09-21T02:40:43.407227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:28.594724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417584+0000","last_change":"2024-09-21T02:40:43.417498+0000","last_active":"2024-09-21T02:40:43.417584+0000","last_peered":"2024-09-21T02:40:43.417584+0000","last_clean":"2024-09-21T02:40:43.417584+0000","last_became_active":"2024-09-21T02:40:43.417203+0000","last_became_peered":"2024-09-21T02:40:43.417203+0000","last_unstale":"2024-09-21T02:40:43.417584+0000","last_undegraded":"2024-09-21T02:40:43.417584+0000","last_fullsized":"2024-09-21T02:40:43.417584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:43.618931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395287+0000","last_change":"2024-09-21T02:39:43.827493+0000","last_active":"2024-09-21T02:40:43.395287+0000","last_peered":"2024-09-21T02:40:43.395287+0000","last_clean":"2024-09-21T02:40:43.395287+0000","last_became_active":"2024-09-21T02:39:43.826824+0000","last_became_peered":"2024-09-21T02:39:43.826824+0000","last_unstale":"2024-09-21T02:40:43.395287+0000","last_undegraded":"2024-09-21T02:40:43.395287+0000","last_fullsized":"2024-09-21T02:40:43.395287+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:21.320101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399019+0000","last_change":"2024-09-21T02:39:56.929122+0000","last_active":"2024-09-21T02:40:43.399019+0000","last_peered":"2024-09-21T02:40:43.399019+0000","last_clean":"2024-09-21T02:40:43.399019+0000","last_became_active":"2024-09-21T02:39:56.928633+0000","last_became_peered":"2024-09-21T02:39:56.928633+0000","last_unstale":"2024-09-21T02:40:43.399019+0000","last_undegraded":"2024-09-21T02:40:43.399019+0000","last_fullsized":"2024-09-21T02:40:43.399019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:56.599982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.415668+0000","last_change":"2024-09-21T02:39:46.866922+0000","last_active":"2024-09-21T02:40:43.415668+0000","last_peered":"2024-09-21T02:40:43.415668+0000","last_clean":"2024-09-21T02:40:43.415668+0000","last_became_active":"2024-09-21T02:39:46.866061+0000","last_became_peered":"2024-09-21T02:39:46.866061+0000","last_unstale":"2024-09-21T02:40:43.415668+0000","last_undegraded":"2024-09-21T02:40:43.415668+0000","last_fullsized":"2024-09-21T02:40:43.415668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:02.707212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398542+0000","last_change":"2024-09-21T02:39:43.824188+0000","last_active":"2024-09-21T02:40:43.398542+0000","last_peered":"2024-09-21T02:40:43.398542+0000","last_clean":"2024-09-21T02:40:43.398542+0000","last_became_active":"2024-09-21T02:39:43.823760+0000","last_became_peered":"2024-09-21T02:39:43.823760+0000","last_unstale":"2024-09-21T02:40:43.398542+0000","last_undegraded":"2024-09-21T02:40:43.398542+0000","last_fullsized":"2024-09-21T02:40:43.398542+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:56.770947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395538+0000","last_change":"2024-09-21T02:39:56.920213+0000","last_active":"2024-09-21T02:40:43.395538+0000","last_peered":"2024-09-21T02:40:43.395538+0000","last_clean":"2024-09-21T02:40:43.395538+0000","last_became_active":"2024-09-21T02:39:56.919796+0000","last_became_peered":"2024-09-21T02:39:56.919796+0000","last_unstale":"2024-09-21T02:40:43.395538+0000","last_undegraded":"2024-09-21T02:40:43.395538+0000","last_fullsized":"2024-09-21T02:40:43.395538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:32.162844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403164+0000","last_change":"2024-09-21T02:39:46.846759+0000","last_active":"2024-09-21T02:40:43.403164+0000","last_peered":"2024-09-21T02:40:43.403164+0000","last_clean":"2024-09-21T02:40:43.403164+0000","last_became_active":"2024-09-21T02:39:46.846315+0000","last_became_peered":"2024-09-21T02:39:46.846315+0000","last_unstale":"2024-09-21T02:40:43.403164+0000","last_undegraded":"2024-09-21T02:40:43.403164+0000","last_fullsized":"2024-09-21T02:40:43.403164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:41.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'29","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:41:00.446493+0000","last_change":"2024-09-21T02:39:43.824564+0000","last_active":"2024-09-21T02:41:00.446493+0000","last_peered":"2024-09-21T02:41:00.446493+0000","last_clean":"2024-09-21T02:41:00.446493+0000","last_became_active":"2024-09-21T02:39:43.824190+0000","last_became_peered":"2024-09-21T02:39:43.824190+0000","last_unstale":"2024-09-21T02:41:00.446493+0000","last_undegraded":"2024-09-21T02:41:00.446493+0000","last_fullsized":"2024-09-21T02:41:00.446493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:45.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60885,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":80,"num_write":30,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412220+0000","last_change":"2024-09-21T02:39:56.928936+0000","last_active":"2024-09-21T02:40:43.412220+0000","last_peered":"2024-09-21T02:40:43.412220+0000","last_clean":"2024-09-21T02:40:43.412220+0000","last_became_active":"2024-09-21T02:39:56.927999+0000","last_became_peered":"2024-09-21T02:39:56.927999+0000","last_unstale":"2024-09-21T02:40:43.412220+0000","last_undegraded":"2024-09-21T02:40:43.412220+0000","last_fullsized":"2024-09-21T02:40:43.412220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:33.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395641+0000","last_change":"2024-09-21T02:39:46.860572+0000","last_active":"2024-09-21T02:40:43.395641+0000","last_peered":"2024-09-21T02:40:43.395641+0000","last_clean":"2024-09-21T02:40:43.395641+0000","last_became_active":"2024-09-21T02:39:46.860073+0000","last_became_peered":"2024-09-21T02:39:46.860073+0000","last_unstale":"2024-09-21T02:40:43.395641+0000","last_undegraded":"2024-09-21T02:40:43.395641+0000","last_fullsized":"2024-09-21T02:40:43.395641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:48.355107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395704+0000","last_change":"2024-09-21T02:39:43.828437+0000","last_active":"2024-09-21T02:40:43.395704+0000","last_peered":"2024-09-21T02:40:43.395704+0000","last_clean":"2024-09-21T02:40:43.395704+0000","last_became_active":"2024-09-21T02:39:43.828033+0000","last_became_peered":"2024-09-21T02:39:43.828033+0000","last_unstale":"2024-09-21T02:40:43.395704+0000","last_undegraded":"2024-09-21T02:40:43.395704+0000","last_fullsized":"2024-09-21T02:40:43.395704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:24.065773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401901+0000","last_change":"2024-09-21T02:39:56.937714+0000","last_active":"2024-09-21T02:40:43.401901+0000","last_peered":"2024-09-21T02:40:43.401901+0000","last_clean":"2024-09-21T02:40:43.401901+0000","last_became_active":"2024-09-21T02:39:56.937145+0000","last_became_peered":"2024-09-21T02:39:56.937145+0000","last_unstale":"2024-09-21T02:40:43.401901+0000","last_undegraded":"2024-09-21T02:40:43.401901+0000","last_fullsized":"2024-09-21T02:40:43.401901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:59.265795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400347+0000","last_change":"2024-09-21T02:39:46.864600+0000","last_active":"2024-09-21T02:40:43.400347+0000","last_peered":"2024-09-21T02:40:43.400347+0000","last_clean":"2024-09-21T02:40:43.400347+0000","last_became_active":"2024-09-21T02:39:46.862043+0000","last_became_peered":"2024-09-21T02:39:46.862043+0000","last_unstale":"2024-09-21T02:40:43.400347+0000","last_undegraded":"2024-09-21T02:40:43.400347+0000","last_fullsized":"2024-09-21T02:40:43.400347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.119974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402322+0000","last_change":"2024-09-21T02:39:43.825910+0000","last_active":"2024-09-21T02:40:43.402322+0000","last_peered":"2024-09-21T02:40:43.402322+0000","last_clean":"2024-09-21T02:40:43.402322+0000","last_became_active":"2024-09-21T02:39:43.825370+0000","last_became_peered":"2024-09-21T02:39:43.825370+0000","last_unstale":"2024-09-21T02:40:43.402322+0000","last_undegraded":"2024-09-21T02:40:43.402322+0000","last_fullsized":"2024-09-21T02:40:43.402322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:05.410114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411733+0000","last_change":"2024-09-21T02:39:56.935321+0000","last_active":"2024-09-21T02:40:43.411733+0000","last_peered":"2024-09-21T02:40:43.411733+0000","last_clean":"2024-09-21T02:40:43.411733+0000","last_became_active":"2024-09-21T02:39:56.931669+0000","last_became_peered":"2024-09-21T02:39:56.931669+0000","last_unstale":"2024-09-21T02:40:43.411733+0000","last_undegraded":"2024-09-21T02:40:43.411733+0000","last_fullsized":"2024-09-21T02:40:43.411733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:20.323574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395730+0000","last_change":"2024-09-21T02:39:46.853469+0000","last_active":"2024-09-21T02:40:43.395730+0000","last_peered":"2024-09-21T02:40:43.395730+0000","last_clean":"2024-09-21T02:40:43.395730+0000","last_became_active":"2024-09-21T02:39:46.853133+0000","last_became_peered":"2024-09-21T02:39:46.853133+0000","last_unstale":"2024-09-21T02:40:43.395730+0000","last_undegraded":"2024-09-21T02:40:43.395730+0000","last_fullsized":"2024-09-21T02:40:43.395730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.055341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:59.440064+0000","last_change":"2024-09-21T02:39:43.828678+0000","last_active":"2024-09-21T02:40:59.440064+0000","last_peered":"2024-09-21T02:40:59.440064+0000","last_clean":"2024-09-21T02:40:59.440064+0000","last_became_active":"2024-09-21T02:39:43.828281+0000","last_became_peered":"2024-09-21T02:39:43.828281+0000","last_unstale":"2024-09-21T02:40:59.440064+0000","last_undegraded":"2024-09-21T02:40:59.440064+0000","last_fullsized":"2024-09-21T02:40:59.440064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:42.678028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397054+0000","last_change":"2024-09-21T02:39:56.920489+0000","last_active":"2024-09-21T02:40:43.397054+0000","last_peered":"2024-09-21T02:40:43.397054+0000","last_clean":"2024-09-21T02:40:43.397054+0000","last_became_active":"2024-09-21T02:39:56.920031+0000","last_became_peered":"2024-09-21T02:39:56.920031+0000","last_unstale":"2024-09-21T02:40:43.397054+0000","last_undegraded":"2024-09-21T02:40:43.397054+0000","last_fullsized":"2024-09-21T02:40:43.397054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:56.576113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399754+0000","last_change":"2024-09-21T02:39:56.922470+0000","last_active":"2024-09-21T02:40:43.399754+0000","last_peered":"2024-09-21T02:40:43.399754+0000","last_clean":"2024-09-21T02:40:43.399754+0000","last_became_active":"2024-09-21T02:39:56.922014+0000","last_became_peered":"2024-09-21T02:39:56.922014+0000","last_unstale":"2024-09-21T02:40:43.399754+0000","last_undegraded":"2024-09-21T02:40:43.399754+0000","last_fullsized":"2024-09-21T02:40:43.399754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:25.307835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412133+0000","last_change":"2024-09-21T02:39:46.852869+0000","last_active":"2024-09-21T02:40:43.412133+0000","last_peered":"2024-09-21T02:40:43.412133+0000","last_clean":"2024-09-21T02:40:43.412133+0000","last_became_active":"2024-09-21T02:39:46.852237+0000","last_became_peered":"2024-09-21T02:39:46.852237+0000","last_unstale":"2024-09-21T02:40:43.412133+0000","last_undegraded":"2024-09-21T02:40:43.412133+0000","last_fullsized":"2024-09-21T02:40:43.412133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:10.729381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395550+0000","last_change":"2024-09-21T02:39:43.827358+0000","last_active":"2024-09-21T02:40:43.395550+0000","last_peered":"2024-09-21T02:40:43.395550+0000","last_clean":"2024-09-21T02:40:43.395550+0000","last_became_active":"2024-09-21T02:39:43.826910+0000","last_became_peered":"2024-09-21T02:39:43.826910+0000","last_unstale":"2024-09-21T02:40:43.395550+0000","last_undegraded":"2024-09-21T02:40:43.395550+0000","last_fullsized":"2024-09-21T02:40:43.395550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:48.528314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398573+0000","last_change":"2024-09-21T02:39:56.930809+0000","last_active":"2024-09-21T02:40:43.398573+0000","last_peered":"2024-09-21T02:40:43.398573+0000","last_clean":"2024-09-21T02:40:43.398573+0000","last_became_active":"2024-09-21T02:39:56.930355+0000","last_became_peered":"2024-09-21T02:39:56.930355+0000","last_unstale":"2024-09-21T02:40:43.398573+0000","last_undegraded":"2024-09-21T02:40:43.398573+0000","last_fullsized":"2024-09-21T02:40:43.398573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:41.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397031+0000","last_change":"2024-09-21T02:39:46.856046+0000","last_active":"2024-09-21T02:40:43.397031+0000","last_peered":"2024-09-21T02:40:43.397031+0000","last_clean":"2024-09-21T02:40:43.397031+0000","last_became_active":"2024-09-21T02:39:46.855675+0000","last_became_peered":"2024-09-21T02:39:46.855675+0000","last_unstale":"2024-09-21T02:40:43.397031+0000","last_undegraded":"2024-09-21T02:40:43.397031+0000","last_fullsized":"2024-09-21T02:40:43.397031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.547082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416633+0000","last_change":"2024-09-21T02:39:43.828888+0000","last_active":"2024-09-21T02:40:43.416633+0000","last_peered":"2024-09-21T02:40:43.416633+0000","last_clean":"2024-09-21T02:40:43.416633+0000","last_became_active":"2024-09-21T02:39:43.828340+0000","last_became_peered":"2024-09-21T02:39:43.828340+0000","last_unstale":"2024-09-21T02:40:43.416633+0000","last_undegraded":"2024-09-21T02:40:43.416633+0000","last_fullsized":"2024-09-21T02:40:43.416633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:09.017191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412206+0000","last_change":"2024-09-21T02:39:43.828957+0000","last_active":"2024-09-21T02:40:43.412206+0000","last_peered":"2024-09-21T02:40:43.412206+0000","last_clean":"2024-09-21T02:40:43.412206+0000","last_became_active":"2024-09-21T02:39:43.827899+0000","last_became_peered":"2024-09-21T02:39:43.827899+0000","last_unstale":"2024-09-21T02:40:43.412206+0000","last_undegraded":"2024-09-21T02:40:43.412206+0000","last_fullsized":"2024-09-21T02:40:43.412206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:36.727082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395361+0000","last_change":"2024-09-21T02:39:46.855278+0000","last_active":"2024-09-21T02:40:43.395361+0000","last_peered":"2024-09-21T02:40:43.395361+0000","last_clean":"2024-09-21T02:40:43.395361+0000","last_became_active":"2024-09-21T02:39:46.854905+0000","last_became_peered":"2024-09-21T02:39:46.854905+0000","last_unstale":"2024-09-21T02:40:43.395361+0000","last_undegraded":"2024-09-21T02:40:43.395361+0000","last_fullsized":"2024-09-21T02:40:43.395361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.244912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398327+0000","last_change":"2024-09-21T02:39:56.931183+0000","last_active":"2024-09-21T02:40:43.398327+0000","last_peered":"2024-09-21T02:40:43.398327+0000","last_clean":"2024-09-21T02:40:43.398327+0000","last_became_active":"2024-09-21T02:39:56.930776+0000","last_became_peered":"2024-09-21T02:39:56.930776+0000","last_unstale":"2024-09-21T02:40:43.398327+0000","last_undegraded":"2024-09-21T02:40:43.398327+0000","last_fullsized":"2024-09-21T02:40:43.398327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:56.272272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":69,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:59.440875+0000","last_change":"2024-09-21T02:39:43.823668+0000","last_active":"2024-09-21T02:40:59.440875+0000","last_peered":"2024-09-21T02:40:59.440875+0000","last_clean":"2024-09-21T02:40:59.440875+0000","last_became_active":"2024-09-21T02:39:43.823132+0000","last_became_peered":"2024-09-21T02:39:43.823132+0000","last_unstale":"2024-09-21T02:40:59.440875+0000","last_undegraded":"2024-09-21T02:40:59.440875+0000","last_fullsized":"2024-09-21T02:40:59.440875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:33.187554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402016+0000","last_change":"2024-09-21T02:39:46.845740+0000","last_active":"2024-09-21T02:40:43.402016+0000","last_peered":"2024-09-21T02:40:43.402016+0000","last_clean":"2024-09-21T02:40:43.402016+0000","last_became_active":"2024-09-21T02:39:46.845361+0000","last_became_peered":"2024-09-21T02:39:46.845361+0000","last_unstale":"2024-09-21T02:40:43.402016+0000","last_undegraded":"2024-09-21T02:40:43.402016+0000","last_fullsized":"2024-09-21T02:40:43.402016+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.546769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399488+0000","last_change":"2024-09-21T02:39:56.919760+0000","last_active":"2024-09-21T02:40:43.399488+0000","last_peered":"2024-09-21T02:40:43.399488+0000","last_clean":"2024-09-21T02:40:43.399488+0000","last_became_active":"2024-09-21T02:39:56.919315+0000","last_became_peered":"2024-09-21T02:39:56.919315+0000","last_unstale":"2024-09-21T02:40:43.399488+0000","last_undegraded":"2024-09-21T02:40:43.399488+0000","last_fullsized":"2024-09-21T02:40:43.399488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:52.889707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400397+0000","last_change":"2024-09-21T02:39:46.848040+0000","last_active":"2024-09-21T02:40:43.400397+0000","last_peered":"2024-09-21T02:40:43.400397+0000","last_clean":"2024-09-21T02:40:43.400397+0000","last_became_active":"2024-09-21T02:39:46.847627+0000","last_became_peered":"2024-09-21T02:39:46.847627+0000","last_unstale":"2024-09-21T02:40:43.400397+0000","last_undegraded":"2024-09-21T02:40:43.400397+0000","last_fullsized":"2024-09-21T02:40:43.400397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:14.139156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399887+0000","last_change":"2024-09-21T02:39:46.853208+0000","last_active":"2024-09-21T02:40:43.399887+0000","last_peered":"2024-09-21T02:40:43.399887+0000","last_clean":"2024-09-21T02:40:43.399887+0000","last_became_active":"2024-09-21T02:39:46.852821+0000","last_became_peered":"2024-09-21T02:39:46.852821+0000","last_unstale":"2024-09-21T02:40:43.399887+0000","last_undegraded":"2024-09-21T02:40:43.399887+0000","last_fullsized":"2024-09-21T02:40:43.399887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:24.597702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398270+0000","last_change":"2024-09-21T02:39:46.866239+0000","last_active":"2024-09-21T02:40:43.398270+0000","last_peered":"2024-09-21T02:40:43.398270+0000","last_clean":"2024-09-21T02:40:43.398270+0000","last_became_active":"2024-09-21T02:39:46.865935+0000","last_became_peered":"2024-09-21T02:39:46.865935+0000","last_unstale":"2024-09-21T02:40:43.398270+0000","last_undegraded":"2024-09-21T02:40:43.398270+0000","last_fullsized":"2024-09-21T02:40:43.398270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.420521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399912+0000","last_change":"2024-09-21T02:39:46.861857+0000","last_active":"2024-09-21T02:40:43.399912+0000","last_peered":"2024-09-21T02:40:43.399912+0000","last_clean":"2024-09-21T02:40:43.399912+0000","last_became_active":"2024-09-21T02:39:46.861512+0000","last_became_peered":"2024-09-21T02:39:46.861512+0000","last_unstale":"2024-09-21T02:40:43.399912+0000","last_undegraded":"2024-09-21T02:40:43.399912+0000","last_fullsized":"2024-09-21T02:40:43.399912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.044159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416171+0000","last_change":"2024-09-21T02:39:46.858655+0000","last_active":"2024-09-21T02:40:43.416171+0000","last_peered":"2024-09-21T02:40:43.416171+0000","last_clean":"2024-09-21T02:40:43.416171+0000","last_became_active":"2024-09-21T02:39:46.858376+0000","last_became_peered":"2024-09-21T02:39:46.858376+0000","last_unstale":"2024-09-21T02:40:43.416171+0000","last_undegraded":"2024-09-21T02:40:43.416171+0000","last_fullsized":"2024-09-21T02:40:43.416171+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:16.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398999+0000","last_change":"2024-09-21T02:39:46.847973+0000","last_active":"2024-09-21T02:40:43.398999+0000","last_peered":"2024-09-21T02:40:43.398999+0000","last_clean":"2024-09-21T02:40:43.398999+0000","last_became_active":"2024-09-21T02:39:46.846957+0000","last_became_peered":"2024-09-21T02:39:46.846957+0000","last_unstale":"2024-09-21T02:40:43.398999+0000","last_undegraded":"2024-09-21T02:40:43.398999+0000","last_fullsized":"2024-09-21T02:40:43.398999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:44.077854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400226+0000","last_change":"2024-09-21T02:39:46.851310+0000","last_active":"2024-09-21T02:40:43.400226+0000","last_peered":"2024-09-21T02:40:43.400226+0000","last_clean":"2024-09-21T02:40:43.400226+0000","last_became_active":"2024-09-21T02:39:46.850666+0000","last_became_peered":"2024-09-21T02:39:46.850666+0000","last_unstale":"2024-09-21T02:40:43.400226+0000","last_undegraded":"2024-09-21T02:40:43.400226+0000","last_fullsized":"2024-09-21T02:40:43.400226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:48.354795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398248+0000","last_change":"2024-09-21T02:39:46.857409+0000","last_active":"2024-09-21T02:40:43.398248+0000","last_peered":"2024-09-21T02:40:43.398248+0000","last_clean":"2024-09-21T02:40:43.398248+0000","last_became_active":"2024-09-21T02:39:46.856974+0000","last_became_peered":"2024-09-21T02:39:46.856974+0000","last_unstale":"2024-09-21T02:40:43.398248+0000","last_undegraded":"2024-09-21T02:40:43.398248+0000","last_fullsized":"2024-09-21T02:40:43.398248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.140154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394920+0000","last_change":"2024-09-21T02:39:46.844168+0000","last_active":"2024-09-21T02:40:43.394920+0000","last_peered":"2024-09-21T02:40:43.394920+0000","last_clean":"2024-09-21T02:40:43.394920+0000","last_became_active":"2024-09-21T02:39:46.843509+0000","last_became_peered":"2024-09-21T02:39:46.843509+0000","last_unstale":"2024-09-21T02:40:43.394920+0000","last_undegraded":"2024-09-21T02:40:43.394920+0000","last_fullsized":"2024-09-21T02:40:43.394920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.899890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397174+0000","last_change":"2024-09-21T02:39:46.854805+0000","last_active":"2024-09-21T02:40:43.397174+0000","last_peered":"2024-09-21T02:40:43.397174+0000","last_clean":"2024-09-21T02:40:43.397174+0000","last_became_active":"2024-09-21T02:39:46.850248+0000","last_became_peered":"2024-09-21T02:39:46.850248+0000","last_unstale":"2024-09-21T02:40:43.397174+0000","last_undegraded":"2024-09-21T02:40:43.397174+0000","last_fullsized":"2024-09-21T02:40:43.397174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:45.628337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395405+0000","last_change":"2024-09-21T02:39:46.866278+0000","last_active":"2024-09-21T02:40:43.395405+0000","last_peered":"2024-09-21T02:40:43.395405+0000","last_clean":"2024-09-21T02:40:43.395405+0000","last_became_active":"2024-09-21T02:39:46.865810+0000","last_became_peered":"2024-09-21T02:39:46.865810+0000","last_unstale":"2024-09-21T02:40:43.395405+0000","last_undegraded":"2024-09-21T02:40:43.395405+0000","last_fullsized":"2024-09-21T02:40:43.395405+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.754340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416117+0000","last_change":"2024-09-21T02:39:46.857721+0000","last_active":"2024-09-21T02:40:43.416117+0000","last_peered":"2024-09-21T02:40:43.416117+0000","last_clean":"2024-09-21T02:40:43.416117+0000","last_became_active":"2024-09-21T02:39:46.853640+0000","last_became_peered":"2024-09-21T02:39:46.853640+0000","last_unstale":"2024-09-21T02:40:43.416117+0000","last_undegraded":"2024-09-21T02:40:43.416117+0000","last_fullsized":"2024-09-21T02:40:43.416117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:54.019607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413715+0000","last_change":"2024-09-21T02:40:43.413457+0000","last_active":"2024-09-21T02:40:43.413715+0000","last_peered":"2024-09-21T02:40:43.413715+0000","last_clean":"2024-09-21T02:40:43.413715+0000","last_became_active":"2024-09-21T02:40:43.413000+0000","last_became_peered":"2024-09-21T02:40:43.413000+0000","last_unstale":"2024-09-21T02:40:43.413715+0000","last_undegraded":"2024-09-21T02:40:43.413715+0000","last_fullsized":"2024-09-21T02:40:43.413715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:27.775410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398785+0000","last_change":"2024-09-21T02:39:46.857169+0000","last_active":"2024-09-21T02:40:43.398785+0000","last_peered":"2024-09-21T02:40:43.398785+0000","last_clean":"2024-09-21T02:40:43.398785+0000","last_became_active":"2024-09-21T02:39:46.856757+0000","last_became_peered":"2024-09-21T02:39:46.856757+0000","last_unstale":"2024-09-21T02:40:43.398785+0000","last_undegraded":"2024-09-21T02:40:43.398785+0000","last_fullsized":"2024-09-21T02:40:43.398785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:36.729746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413017+0000","last_change":"2024-09-21T02:39:46.854162+0000","last_active":"2024-09-21T02:40:43.413017+0000","last_peered":"2024-09-21T02:40:43.413017+0000","last_clean":"2024-09-21T02:40:43.413017+0000","last_became_active":"2024-09-21T02:39:46.853697+0000","last_became_peered":"2024-09-21T02:39:46.853697+0000","last_unstale":"2024-09-21T02:40:43.413017+0000","last_undegraded":"2024-09-21T02:40:43.413017+0000","last_fullsized":"2024-09-21T02:40:43.413017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.605606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399434+0000","last_change":"2024-09-21T02:39:46.853570+0000","last_active":"2024-09-21T02:40:43.399434+0000","last_peered":"2024-09-21T02:40:43.399434+0000","last_clean":"2024-09-21T02:40:43.399434+0000","last_became_active":"2024-09-21T02:39:46.853074+0000","last_became_peered":"2024-09-21T02:39:46.853074+0000","last_unstale":"2024-09-21T02:40:43.399434+0000","last_undegraded":"2024-09-21T02:40:43.399434+0000","last_fullsized":"2024-09-21T02:40:43.399434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:02.642887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394962+0000","last_change":"2024-09-21T02:39:46.850070+0000","last_active":"2024-09-21T02:40:43.394962+0000","last_peered":"2024-09-21T02:40:43.394962+0000","last_clean":"2024-09-21T02:40:43.394962+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:40:43.394962+0000","last_undegraded":"2024-09-21T02:40:43.394962+0000","last_fullsized":"2024-09-21T02:40:43.394962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:59.185574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403838+0000","last_change":"2024-09-21T02:40:43.403735+0000","last_active":"2024-09-21T02:40:43.403838+0000","last_peered":"2024-09-21T02:40:43.403838+0000","last_clean":"2024-09-21T02:40:43.403838+0000","last_became_active":"2024-09-21T02:40:43.403330+0000","last_became_peered":"2024-09-21T02:40:43.403330+0000","last_unstale":"2024-09-21T02:40:43.403838+0000","last_undegraded":"2024-09-21T02:40:43.403838+0000","last_fullsized":"2024-09-21T02:40:43.403838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:35.043475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399591+0000","last_change":"2024-09-21T02:39:46.850811+0000","last_active":"2024-09-21T02:40:43.399591+0000","last_peered":"2024-09-21T02:40:43.399591+0000","last_clean":"2024-09-21T02:40:43.399591+0000","last_became_active":"2024-09-21T02:39:46.850423+0000","last_became_peered":"2024-09-21T02:39:46.850423+0000","last_unstale":"2024-09-21T02:40:43.399591+0000","last_undegraded":"2024-09-21T02:40:43.399591+0000","last_fullsized":"2024-09-21T02:40:43.399591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:47.343607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416003+0000","last_change":"2024-09-21T02:39:46.851169+0000","last_active":"2024-09-21T02:40:43.416003+0000","last_peered":"2024-09-21T02:40:43.416003+0000","last_clean":"2024-09-21T02:40:43.416003+0000","last_became_active":"2024-09-21T02:39:46.850258+0000","last_became_peered":"2024-09-21T02:39:46.850258+0000","last_unstale":"2024-09-21T02:40:43.416003+0000","last_undegraded":"2024-09-21T02:40:43.416003+0000","last_fullsized":"2024-09-21T02:40:43.416003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:02.588325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402907+0000","last_change":"2024-09-21T02:39:46.854082+0000","last_active":"2024-09-21T02:40:43.402907+0000","last_peered":"2024-09-21T02:40:43.402907+0000","last_clean":"2024-09-21T02:40:43.402907+0000","last_became_active":"2024-09-21T02:39:46.852226+0000","last_became_peered":"2024-09-21T02:39:46.852226+0000","last_unstale":"2024-09-21T02:40:43.402907+0000","last_undegraded":"2024-09-21T02:40:43.402907+0000","last_fullsized":"2024-09-21T02:40:43.402907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:41.960472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402990+0000","last_change":"2024-09-21T02:39:46.856222+0000","last_active":"2024-09-21T02:40:43.402990+0000","last_peered":"2024-09-21T02:40:43.402990+0000","last_clean":"2024-09-21T02:40:43.402990+0000","last_became_active":"2024-09-21T02:39:46.855868+0000","last_became_peered":"2024-09-21T02:39:46.855868+0000","last_unstale":"2024-09-21T02:40:43.402990+0000","last_undegraded":"2024-09-21T02:40:43.402990+0000","last_fullsized":"2024-09-21T02:40:43.402990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:31.396030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412359+0000","last_change":"2024-09-21T02:39:46.862312+0000","last_active":"2024-09-21T02:40:43.412359+0000","last_peered":"2024-09-21T02:40:43.412359+0000","last_clean":"2024-09-21T02:40:43.412359+0000","last_became_active":"2024-09-21T02:39:46.861921+0000","last_became_peered":"2024-09-21T02:39:46.861921+0000","last_unstale":"2024-09-21T02:40:43.412359+0000","last_undegraded":"2024-09-21T02:40:43.412359+0000","last_fullsized":"2024-09-21T02:40:43.412359+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:33.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395777+0000","last_change":"2024-09-21T02:39:46.851155+0000","last_active":"2024-09-21T02:40:43.395777+0000","last_peered":"2024-09-21T02:40:43.395777+0000","last_clean":"2024-09-21T02:40:43.395777+0000","last_became_active":"2024-09-21T02:39:46.850809+0000","last_became_peered":"2024-09-21T02:39:46.850809+0000","last_unstale":"2024-09-21T02:40:43.395777+0000","last_undegraded":"2024-09-21T02:40:43.395777+0000","last_fullsized":"2024-09-21T02:40:43.395777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.396921+0000","last_change":"2024-09-21T02:39:46.850585+0000","last_active":"2024-09-21T02:40:43.396921+0000","last_peered":"2024-09-21T02:40:43.396921+0000","last_clean":"2024-09-21T02:40:43.396921+0000","last_became_active":"2024-09-21T02:39:46.850114+0000","last_became_peered":"2024-09-21T02:39:46.850114+0000","last_unstale":"2024-09-21T02:40:43.396921+0000","last_undegraded":"2024-09-21T02:40:43.396921+0000","last_fullsized":"2024-09-21T02:40:43.396921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:04.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402958+0000","last_change":"2024-09-21T02:39:46.850416+0000","last_active":"2024-09-21T02:40:43.402958+0000","last_peered":"2024-09-21T02:40:43.402958+0000","last_clean":"2024-09-21T02:40:43.402958+0000","last_became_active":"2024-09-21T02:39:46.850035+0000","last_became_peered":"2024-09-21T02:39:46.850035+0000","last_unstale":"2024-09-21T02:40:43.402958+0000","last_undegraded":"2024-09-21T02:40:43.402958+0000","last_fullsized":"2024-09-21T02:40:43.402958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:09.139331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411802+0000","last_change":"2024-09-21T02:39:46.861376+0000","last_active":"2024-09-21T02:40:43.411802+0000","last_peered":"2024-09-21T02:40:43.411802+0000","last_clean":"2024-09-21T02:40:43.411802+0000","last_became_active":"2024-09-21T02:39:46.861011+0000","last_became_peered":"2024-09-21T02:39:46.861011+0000","last_unstale":"2024-09-21T02:40:43.411802+0000","last_undegraded":"2024-09-21T02:40:43.411802+0000","last_fullsized":"2024-09-21T02:40:43.411802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:45.123705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402046+0000","last_change":"2024-09-21T02:39:46.846135+0000","last_active":"2024-09-21T02:40:43.402046+0000","last_peered":"2024-09-21T02:40:43.402046+0000","last_clean":"2024-09-21T02:40:43.402046+0000","last_became_active":"2024-09-21T02:39:46.845693+0000","last_became_peered":"2024-09-21T02:39:46.845693+0000","last_unstale":"2024-09-21T02:40:43.402046+0000","last_undegraded":"2024-09-21T02:40:43.402046+0000","last_fullsized":"2024-09-21T02:40:43.402046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:55.830932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402612+0000","last_change":"2024-09-21T02:39:46.853300+0000","last_active":"2024-09-21T02:40:43.402612+0000","last_peered":"2024-09-21T02:40:43.402612+0000","last_clean":"2024-09-21T02:40:43.402612+0000","last_became_active":"2024-09-21T02:39:46.852953+0000","last_became_peered":"2024-09-21T02:39:46.852953+0000","last_unstale":"2024-09-21T02:40:43.402612+0000","last_undegraded":"2024-09-21T02:40:43.402612+0000","last_fullsized":"2024-09-21T02:40:43.402612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:04.475743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400076+0000","last_change":"2024-09-21T02:39:46.854976+0000","last_active":"2024-09-21T02:40:43.400076+0000","last_peered":"2024-09-21T02:40:43.400076+0000","last_clean":"2024-09-21T02:40:43.400076+0000","last_became_active":"2024-09-21T02:39:46.852970+0000","last_became_peered":"2024-09-21T02:39:46.852970+0000","last_unstale":"2024-09-21T02:40:43.400076+0000","last_undegraded":"2024-09-21T02:40:43.400076+0000","last_fullsized":"2024-09-21T02:40:43.400076+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:54.654967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399898+0000","last_change":"2024-09-21T02:39:46.848698+0000","last_active":"2024-09-21T02:40:43.399898+0000","last_peered":"2024-09-21T02:40:43.399898+0000","last_clean":"2024-09-21T02:40:43.399898+0000","last_became_active":"2024-09-21T02:39:46.848374+0000","last_became_peered":"2024-09-21T02:39:46.848374+0000","last_unstale":"2024-09-21T02:40:43.399898+0000","last_undegraded":"2024-09-21T02:40:43.399898+0000","last_fullsized":"2024-09-21T02:40:43.399898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:59.589062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399265+0000","last_change":"2024-09-21T02:39:46.851850+0000","last_active":"2024-09-21T02:40:43.399265+0000","last_peered":"2024-09-21T02:40:43.399265+0000","last_clean":"2024-09-21T02:40:43.399265+0000","last_became_active":"2024-09-21T02:39:46.851408+0000","last_became_peered":"2024-09-21T02:39:46.851408+0000","last_unstale":"2024-09-21T02:40:43.399265+0000","last_undegraded":"2024-09-21T02:40:43.399265+0000","last_fullsized":"2024-09-21T02:40:43.399265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:27.831504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65277,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":162,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":195831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":491931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939681,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28660,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716492,"statfs":{"total":95995035648,"available":95965687808,"internally_reserved":0,"allocated":1675264,"data_stored":1144571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103206,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":492167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299437,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":492087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495666,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1593344,"data_stored":1088387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659192,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":487343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855422,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1601536,"data_stored":1083584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986242,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":492384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":487537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1069056,"data_stored":549879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1044480,"data_stored":548138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":488731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:41:04.566 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T02:41:04.567 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T02:41:04.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T02:41:04.972 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:04 smithi172 ceph-mon[35067]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-21T02:41:05.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:04 smithi084 ceph-mon[30747]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-21T02:41:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:04 smithi090 ceph-mon[34571]: pgmap v357: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-09-21T02:41:05.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.612+0000 7f6a12600640 1 -- 172.21.15.84:0/635907337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c1073b0 msgr2=0x7f6a0c10dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:05.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.612+0000 7f6a12600640 1 --2- 172.21.15.84:0/635907337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c1073b0 0x7f6a0c10dd50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009ca0 tx=0x7f6a0402a950 comp rx=0 tx=0).stop 2024-09-21T02:41:05.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.613+0000 7f6a12600640 1 -- 172.21.15.84:0/635907337 shutdown_connections 2024-09-21T02:41:05.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.613+0000 7f6a12600640 1 --2- 172.21.15.84:0/635907337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c1073b0 0x7f6a0c10dd50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.613+0000 7f6a12600640 1 --2- 172.21.15.84:0/635907337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a0c106a10 0x7f6a0c106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.613+0000 7f6a12600640 1 --2- 172.21.15.84:0/635907337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0c105980 0x7f6a0c105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.613+0000 7f6a12600640 1 -- 172.21.15.84:0/635907337 >> 172.21.15.84:0/635907337 conn(0x7f6a0c1012f0 msgr2=0x7f6a0c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.613+0000 7f6a12600640 1 -- 172.21.15.84:0/635907337 shutdown_connections 2024-09-21T02:41:05.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.613+0000 7f6a12600640 1 -- 172.21.15.84:0/635907337 wait complete. 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a12600640 1 Processor -- start 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a12600640 1 -- start start 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a12600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c105980 0x7f6a0c19c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a12600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0c106a10 0x7f6a0c19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a12600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a0c1073b0 0x7f6a0c19d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a12600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c111700 con 0x7f6a0c1073b0 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a12600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c111580 con 0x7f6a0c105980 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a12600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c111880 con 0x7f6a0c106a10 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a0b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c105980 0x7f6a0c19c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:05.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a0b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c105980 0x7f6a0c19c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:44796/0 (socket says 172.21.15.84:44796) 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.614+0000 7f6a0b400640 1 -- 172.21.15.84:0/553288894 learned_addr learned my addr 172.21.15.84:0/553288894 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0aa00640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0c106a10 0x7f6a0c19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0be00640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a0c1073b0 0x7f6a0c19d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0b400640 1 -- 172.21.15.84:0/553288894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0c106a10 msgr2=0x7f6a0c19c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0b400640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0c106a10 0x7f6a0c19c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0b400640 1 -- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a0c1073b0 msgr2=0x7f6a0c19d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0b400640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a0c1073b0 0x7f6a0c19d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0b400640 1 -- 172.21.15.84:0/553288894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c19dc40 con 0x7f6a0c105980 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0aa00640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0c106a10 0x7f6a0c19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.615+0000 7f6a0b400640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c105980 0x7f6a0c19c210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e9f0 tx=0x7f69fc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.616+0000 7f6a03e00640 1 -- 172.21.15.84:0/553288894 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00cd80 con 0x7f6a0c105980 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.616+0000 7f6a03e00640 1 -- 172.21.15.84:0/553288894 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f69fc0054f0 con 0x7f6a0c105980 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.616+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c19df30 con 0x7f6a0c105980 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.616+0000 7f6a03e00640 1 -- 172.21.15.84:0/553288894 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc010690 con 0x7f6a0c105980 2024-09-21T02:41:05.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.616+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c1a4630 con 0x7f6a0c105980 2024-09-21T02:41:05.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.617+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c10cb60 con 0x7f6a0c105980 2024-09-21T02:41:05.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.619+0000 7f6a03e00640 1 -- 172.21.15.84:0/553288894 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f69fc0046c0 con 0x7f6a0c105980 2024-09-21T02:41:05.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.621+0000 7f6a03e00640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f69f00b65a0 0x7f69f00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:05.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.621+0000 7f6a03e00640 1 -- 172.21.15.84:0/553288894 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f69fc0e7df0 con 0x7f6a0c105980 2024-09-21T02:41:05.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.621+0000 7f6a0aa00640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f69f00b65a0 0x7f69f00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:05.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.621+0000 7f6a0aa00640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f69f00b65a0 0x7f69f00b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f69f80095f0 tx=0x7f69f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:05.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.622+0000 7f6a03e00640 1 -- 172.21.15.84:0/553288894 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69fc0ae160 con 0x7f6a0c105980 2024-09-21T02:41:05.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:05 smithi084 ceph-mon[30747]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:05.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.887+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f6a0c02e640 con 0x7f6a0c105980 2024-09-21T02:41:05.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.896+0000 7f6a03e00640 1 -- 172.21.15.84:0/553288894 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f69fc0b2540 con 0x7f6a0c105980 2024-09-21T02:41:05.898 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-09-21T02:41:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBBMu5mjlsINRAAiGzIbV1bewVE/mDpiYxZzA== 2024-09-21T02:41:05.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f69f00b65a0 msgr2=0x7f69f00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:05.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f69f00b65a0 0x7f69f00b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f69f80095f0 tx=0x7f69f8005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:05.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c105980 msgr2=0x7f6a0c19c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:05.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c105980 0x7f6a0c19c210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e9f0 tx=0x7f69fc00edf0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 shutdown_connections 2024-09-21T02:41:05.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f69f00b65a0 0x7f69f00b8ab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0c106a10 0x7f6a0c19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a0c1073b0 0x7f6a0c19d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 --2- 172.21.15.84:0/553288894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6a0c105980 0x7f6a0c19c210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:05.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 >> 172.21.15.84:0/553288894 conn(0x7f6a0c1012f0 msgr2=0x7f6a0c109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:05.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 shutdown_connections 2024-09-21T02:41:05.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:05.899+0000 7f6a12600640 1 -- 172.21.15.84:0/553288894 wait complete. 2024-09-21T02:41:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:05 smithi172 ceph-mon[35067]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:05 smithi090 ceph-mon[34571]: from='client.24926 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:06.815 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:41:06.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T02:41:06.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T02:41:06.890 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:06 smithi084 ceph-mon[30747]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-21T02:41:06.890 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:06 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/553288894' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:41:06.890 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:06 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:41:06.891 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:06 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:41:06.899 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T02:41:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:06 smithi172 ceph-mon[35067]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-21T02:41:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:06 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/553288894' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:41:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:06 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:41:07.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:06 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:41:07.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:06 smithi090 ceph-mon[34571]: pgmap v358: 129 pgs: 129 active+clean; 641 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-21T02:41:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:06 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/553288894' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:41:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:06 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T02:41:07.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:06 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T02:41:07.306 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:07.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:07 smithi084 ceph-mon[30747]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-21T02:41:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.952+0000 7f3157000640 1 -- 172.21.15.84:0/306822242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3150114440 msgr2=0x7f3150116910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.952+0000 7f3157000640 1 --2- 172.21.15.84:0/306822242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3150114440 0x7f3150116910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3148009ca0 tx=0x7f314802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:07.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.952+0000 7f3157000640 1 -- 172.21.15.84:0/306822242 shutdown_connections 2024-09-21T02:41:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.952+0000 7f3157000640 1 --2- 172.21.15.84:0/306822242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3150114440 0x7f3150116910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.952+0000 7f3157000640 1 --2- 172.21.15.84:0/306822242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3150075dd0 0x7f31500761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.952+0000 7f3157000640 1 --2- 172.21.15.84:0/306822242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3150077380 0x7f31500757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.953+0000 7f3157000640 1 -- 172.21.15.84:0/306822242 >> 172.21.15.84:0/306822242 conn(0x7f31500ff5e0 msgr2=0x7f3150101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.953+0000 7f3157000640 1 -- 172.21.15.84:0/306822242 shutdown_connections 2024-09-21T02:41:07.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.953+0000 7f3157000640 1 -- 172.21.15.84:0/306822242 wait complete. 2024-09-21T02:41:07.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f3157000640 1 Processor -- start 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f3157000640 1 -- start start 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f3157000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3150075dd0 0x7f31501a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f3157000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3150077380 0x7f31501a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f3157000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3150114440 0x7f31501a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f3157000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f315011a1c0 con 0x7f3150077380 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f3157000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f315011a040 con 0x7f3150114440 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f3157000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f315011a340 con 0x7f3150075dd0 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.954+0000 7f314fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3150075dd0 0x7f31501a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3150075dd0 0x7f31501a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:60340/0 (socket says 172.21.15.84:60340) 2024-09-21T02:41:07.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314fe00640 1 -- 172.21.15.84:0/3198420325 learned_addr learned my addr 172.21.15.84:0/3198420325 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314f400640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3150077380 0x7f31501a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f3155000640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3150114440 0x7f31501a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314fe00640 1 -- 172.21.15.84:0/3198420325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3150114440 msgr2=0x7f31501a6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314fe00640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3150114440 0x7f31501a6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314fe00640 1 -- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3150077380 msgr2=0x7f31501a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314fe00640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3150077380 0x7f31501a1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314fe00640 1 -- 172.21.15.84:0/3198420325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31501a6a40 con 0x7f3150075dd0 2024-09-21T02:41:07.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.955+0000 7f314fe00640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3150075dd0 0x7f31501a0ad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9f0 tx=0x7f314000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.956+0000 7f314cc00640 1 -- 172.21.15.84:0/3198420325 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314000cd80 con 0x7f3150075dd0 2024-09-21T02:41:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.956+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31501a6d30 con 0x7f3150075dd0 2024-09-21T02:41:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.956+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31501ad490 con 0x7f3150075dd0 2024-09-21T02:41:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.956+0000 7f314cc00640 1 -- 172.21.15.84:0/3198420325 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f31400054f0 con 0x7f3150075dd0 2024-09-21T02:41:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.956+0000 7f314cc00640 1 -- 172.21.15.84:0/3198420325 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140010690 con 0x7f3150075dd0 2024-09-21T02:41:07.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.957+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31300052c0 con 0x7f3150075dd0 2024-09-21T02:41:07.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.960+0000 7f314cc00640 1 -- 172.21.15.84:0/3198420325 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f31400046c0 con 0x7f3150075dd0 2024-09-21T02:41:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.961+0000 7f314cc00640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31340b6620 0x7f31340b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.961+0000 7f314cc00640 1 -- 172.21.15.84:0/3198420325 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f31400e7b20 con 0x7f3150075dd0 2024-09-21T02:41:07.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.961+0000 7f314f400640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31340b6620 0x7f31340b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:07.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.962+0000 7f314f400640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31340b6620 0x7f31340b8b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f313c0095f0 tx=0x7f313c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:07.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:07.963+0000 7f314cc00640 1 -- 172.21.15.84:0/3198420325 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31400ade90 con 0x7f3150075dd0 2024-09-21T02:41:08.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:07 smithi172 ceph-mon[35067]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-21T02:41:08.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:07 smithi090 ceph-mon[34571]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-21T02:41:08.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.148+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f3130005880 con 0x7f3150075dd0 2024-09-21T02:41:08.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.149+0000 7f314cc00640 1 -- 172.21.15.84:0/3198420325 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v53) ==== 86+0+133 (secure 0 0 0) 0x7f31400b2270 con 0x7f3150075dd0 2024-09-21T02:41:08.150 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31340b6620 msgr2=0x7f31340b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31340b6620 0x7f31340b8b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f313c0095f0 tx=0x7f313c005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3150075dd0 msgr2=0x7f31501a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3150075dd0 0x7f31501a0ad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f314000e9f0 tx=0x7f314000edf0 comp rx=0 tx=0).stop 2024-09-21T02:41:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 shutdown_connections 2024-09-21T02:41:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3150114440 0x7f31501a6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3150077380 0x7f31501a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31340b6620 0x7f31340b8b30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 --2- 172.21.15.84:0/3198420325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3150075dd0 0x7f31501a0ad0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 >> 172.21.15.84:0/3198420325 conn(0x7f31500ff5e0 msgr2=0x7f3150110340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 shutdown_connections 2024-09-21T02:41:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:08.152+0000 7f3157000640 1 -- 172.21.15.84:0/3198420325 wait complete. 2024-09-21T02:41:08.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:08 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3198420325' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:41:08.891 INFO:teuthology.orchestra.run.smithi084.stdout:[{"version":53,"timestamp":"2024-09-21T02:39:34.429406+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T02:41:08.892 INFO:tasks.ceph_manager:config epoch is 53 2024-09-21T02:41:08.892 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T02:41:08.892 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T02:41:08.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T02:41:09.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:08 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3198420325' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:41:09.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:08 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3198420325' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T02:41:09.262 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:09.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 -- 172.21.15.84:0/676051734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc03810de30 msgr2=0x7fc038110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:09.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 --2- 172.21.15.84:0/676051734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc03810de30 0x7fc038110320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc030009ca0 tx=0x7fc03002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 -- 172.21.15.84:0/676051734 shutdown_connections 2024-09-21T02:41:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 --2- 172.21.15.84:0/676051734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc038105320 0x7fc03810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 --2- 172.21.15.84:0/676051734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc03810de30 0x7fc038110320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 --2- 172.21.15.84:0/676051734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0381049d0 0x7fc038104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 -- 172.21.15.84:0/676051734 >> 172.21.15.84:0/676051734 conn(0x7fc038079740 msgr2=0x7fc038079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 -- 172.21.15.84:0/676051734 shutdown_connections 2024-09-21T02:41:09.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.916+0000 7fc03da00640 1 -- 172.21.15.84:0/676051734 wait complete. 2024-09-21T02:41:09.918 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:09 smithi084 ceph-mon[30747]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T02:41:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.917+0000 7fc03da00640 1 Processor -- start 2024-09-21T02:41:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.917+0000 7fc03da00640 1 -- start start 2024-09-21T02:41:09.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc03da00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0381049d0 0x7fc03819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc03da00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc038105320 0x7fc03819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc03da00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc03810de30 0x7fc03819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc03da00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc038113bd0 con 0x7fc03810de30 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc03da00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc038113a50 con 0x7fc0381049d0 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc03da00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc038113d50 con 0x7fc038105320 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc036a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0381049d0 0x7fc03819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc037400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc03810de30 0x7fc03819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc036a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0381049d0 0x7fc03819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:44820/0 (socket says 172.21.15.84:44820) 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc036a00640 1 -- 172.21.15.84:0/2100072276 learned_addr learned my addr 172.21.15.84:0/2100072276 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:09.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.918+0000 7fc02e000640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc038105320 0x7fc03819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:09.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc036a00640 1 -- 172.21.15.84:0/2100072276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc038105320 msgr2=0x7fc03819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:09.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc036a00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc038105320 0x7fc03819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:09.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc036a00640 1 -- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc03810de30 msgr2=0x7fc03819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:09.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc036a00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc03810de30 0x7fc03819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:09.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc036a00640 1 -- 172.21.15.84:0/2100072276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0381a04d0 con 0x7fc0381049d0 2024-09-21T02:41:09.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc036a00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0381049d0 0x7fc03819a560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc02800e9c0 tx=0x7fc02800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:09.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc02fe00640 1 -- 172.21.15.84:0/2100072276 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02800cd80 con 0x7fc0381049d0 2024-09-21T02:41:09.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0381a07c0 con 0x7fc0381049d0 2024-09-21T02:41:09.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc02fe00640 1 -- 172.21.15.84:0/2100072276 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0280035f0 con 0x7fc0381049d0 2024-09-21T02:41:09.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0381a6f20 con 0x7fc0381049d0 2024-09-21T02:41:09.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.919+0000 7fc02fe00640 1 -- 172.21.15.84:0/2100072276 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028010670 con 0x7fc0381049d0 2024-09-21T02:41:09.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.920+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03806c240 con 0x7fc0381049d0 2024-09-21T02:41:09.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.923+0000 7fc02fe00640 1 -- 172.21.15.84:0/2100072276 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc0280037a0 con 0x7fc0381049d0 2024-09-21T02:41:09.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.924+0000 7fc02fe00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc01c0b65a0 0x7fc01c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:09.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.925+0000 7fc02fe00640 1 -- 172.21.15.84:0/2100072276 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fc0280e7c40 con 0x7fc0381049d0 2024-09-21T02:41:09.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.925+0000 7fc02e000640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc01c0b65a0 0x7fc01c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:09.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.925+0000 7fc02e000640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc01c0b65a0 0x7fc01c0b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc03810faf0 tx=0x7fc020005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:09.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:09.926+0000 7fc02fe00640 1 -- 172.21.15.84:0/2100072276 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0280ae040 con 0x7fc0381049d0 2024-09-21T02:41:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:09 smithi172 ceph-mon[35067]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T02:41:10.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:09 smithi090 ceph-mon[34571]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T02:41:10.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.160+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc038104de0 con 0x7fc0381049d0 2024-09-21T02:41:10.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.166+0000 7fc02fe00640 1 -- 172.21.15.84:0/2100072276 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296436 (secure 0 0 0) 0x7fc0280b2420 con 0x7fc0381049d0 2024-09-21T02:41:10.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc01c0b65a0 msgr2=0x7fc01c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc01c0b65a0 0x7fc01c0b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc03810faf0 tx=0x7fc020005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0381049d0 msgr2=0x7fc03819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0381049d0 0x7fc03819a560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc02800e9c0 tx=0x7fc02800ee80 comp rx=0 tx=0).stop 2024-09-21T02:41:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 shutdown_connections 2024-09-21T02:41:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc01c0b65a0 0x7fc01c0b8ab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc038105320 0x7fc03819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:10.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc03810de30 0x7fc03819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:10.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 --2- 172.21.15.84:0/2100072276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0381049d0 0x7fc03819a560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:10.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 >> 172.21.15.84:0/2100072276 conn(0x7fc038079740 msgr2=0x7fc0380ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:10.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 shutdown_connections 2024-09-21T02:41:10.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:10.171+0000 7fc03da00640 1 -- 172.21.15.84:0/2100072276 wait complete. 2024-09-21T02:41:10.904 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:10 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2100072276' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:41:10.942 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":2416519122},{"type":"v1","addr":"172.21.15.84:6801","nonce":2416519122}]},"active_addr":"172.21.15.84:6801/2416519122","active_change":"2024-09-21T02:31:41.471537+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24124,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24134,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.84:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3005732966}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":816984279}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3562517394}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":253908522}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2218328970}]}]} 2024-09-21T02:41:10.949 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T02:41:10.949 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T02:41:10.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:41:11.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:10 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2100072276' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:41:11.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:10 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2100072276' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T02:41:11.327 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:11.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:11 smithi084 ceph-mon[30747]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:41:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 -- 172.21.15.84:0/160216998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec1046a0 msgr2=0x7f40ec06bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 --2- 172.21.15.84:0/160216998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec1046a0 0x7f40ec06bac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009900 tx=0x7f40dc02a410 comp rx=0 tx=0).stop 2024-09-21T02:41:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 -- 172.21.15.84:0/160216998 shutdown_connections 2024-09-21T02:41:11.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 --2- 172.21.15.84:0/160216998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ec110040 0x7f40ec112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 --2- 172.21.15.84:0/160216998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40ec06c0e0 0x7f40ec06c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 --2- 172.21.15.84:0/160216998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec1046a0 0x7f40ec06bac0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 -- 172.21.15.84:0/160216998 >> 172.21.15.84:0/160216998 conn(0x7f40ec0799a0 msgr2=0x7f40ec079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 -- 172.21.15.84:0/160216998 shutdown_connections 2024-09-21T02:41:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.983+0000 7f40f3a00640 1 -- 172.21.15.84:0/160216998 wait complete. 2024-09-21T02:41:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.984+0000 7f40f3a00640 1 Processor -- start 2024-09-21T02:41:11.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.984+0000 7f40f3a00640 1 -- start start 2024-09-21T02:41:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f3a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06c0e0 0x7f40ec19c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f3a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ec1046a0 0x7f40ec19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f3a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40ec110040 0x7f40ec1a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f3a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec115e20 con 0x7f40ec06c0e0 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f3a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec115ca0 con 0x7f40ec110040 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f3a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec115fa0 con 0x7f40ec1046a0 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06c0e0 0x7f40ec19c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06c0e0 0x7f40ec19c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41884/0 (socket says 172.21.15.84:41884) 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1000640 1 -- 172.21.15.84:0/3997066350 learned_addr learned my addr 172.21.15.84:0/3997066350 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40e3e00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ec1046a0 0x7f40ec19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1a00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40ec110040 0x7f40ec1a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1000640 1 -- 172.21.15.84:0/3997066350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ec1046a0 msgr2=0x7f40ec19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1000640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ec1046a0 0x7f40ec19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1000640 1 -- 172.21.15.84:0/3997066350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40ec110040 msgr2=0x7f40ec1a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1000640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40ec110040 0x7f40ec1a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:11.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.985+0000 7f40f1000640 1 -- 172.21.15.84:0/3997066350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec1a26e0 con 0x7f40ec06c0e0 2024-09-21T02:41:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.986+0000 7f40f1000640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06c0e0 0x7f40ec19c770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40dc005ab0 tx=0x7f40dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.986+0000 7f40ea000640 1 -- 172.21.15.84:0/3997066350 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc03f030 con 0x7f40ec06c0e0 2024-09-21T02:41:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.986+0000 7f40ea000640 1 -- 172.21.15.84:0/3997066350 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f40dc003cd0 con 0x7f40ec06c0e0 2024-09-21T02:41:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.986+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec1a2970 con 0x7f40ec06c0e0 2024-09-21T02:41:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.986+0000 7f40ea000640 1 -- 172.21.15.84:0/3997066350 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc035070 con 0x7f40ec06c0e0 2024-09-21T02:41:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.986+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec1a9130 con 0x7f40ec06c0e0 2024-09-21T02:41:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.987+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ec06c4f0 con 0x7f40ec06c0e0 2024-09-21T02:41:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.989+0000 7f40ea000640 1 -- 172.21.15.84:0/3997066350 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f40dc042030 con 0x7f40ec06c0e0 2024-09-21T02:41:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.991+0000 7f40ea000640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40d00b6620 0x7f40d00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.991+0000 7f40ea000640 1 -- 172.21.15.84:0/3997066350 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f40dc107f60 con 0x7f40ec06c0e0 2024-09-21T02:41:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.991+0000 7f40e3e00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40d00b6620 0x7f40d00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.992+0000 7f40e3e00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40d00b6620 0x7f40d00b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f40ec06af60 tx=0x7f40d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:11.996+0000 7f40ea000640 1 -- 172.21.15.84:0/3997066350 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40dc0d26b0 con 0x7f40ec06c0e0 2024-09-21T02:41:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:11 smithi172 ceph-mon[35067]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:41:12.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:11 smithi090 ceph-mon[34571]: pgmap v361: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:41:12.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.183+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40ec1a9360 con 0x7f40ec06c0e0 2024-09-21T02:41:12.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.185+0000 7f40ea000640 1 -- 172.21.15.84:0/3997066350 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24726 (secure 0 0 0) 0x7f40dc0d75f0 con 0x7f40ec06c0e0 2024-09-21T02:41:12.187 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:12.187 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:40:43.390340+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:41:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40d00b6620 msgr2=0x7f40d00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40d00b6620 0x7f40d00b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f40ec06af60 tx=0x7f40d400b410 comp rx=0 tx=0).stop 2024-09-21T02:41:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06c0e0 msgr2=0x7f40ec19c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06c0e0 0x7f40ec19c770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40dc005ab0 tx=0x7f40dc0042f0 comp rx=0 tx=0).stop 2024-09-21T02:41:12.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 shutdown_connections 2024-09-21T02:41:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40d00b6620 0x7f40d00b8b30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ec1046a0 0x7f40ec19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40ec110040 0x7f40ec1a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 --2- 172.21.15.84:0/3997066350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40ec06c0e0 0x7f40ec19c770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 >> 172.21.15.84:0/3997066350 conn(0x7f40ec0799a0 msgr2=0x7f40ec1014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 shutdown_connections 2024-09-21T02:41:12.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:12.188+0000 7f40f3a00640 1 -- 172.21.15.84:0/3997066350 wait complete. 2024-09-21T02:41:12.864 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:12 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3997066350' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:12.904 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T02:41:12.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:41:13.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:12 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3997066350' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:13.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:12 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3997066350' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:13.274 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 -- 172.21.15.84:0/1958623801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010be50 msgr2=0x7efc20112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 --2- 172.21.15.84:0/1958623801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010be50 0x7efc20112680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efc18009ca0 tx=0x7efc1802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 -- 172.21.15.84:0/1958623801 shutdown_connections 2024-09-21T02:41:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 --2- 172.21.15.84:0/1958623801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc2010b500 0x7efc2010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 --2- 172.21.15.84:0/1958623801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010be50 0x7efc20112680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 --2- 172.21.15.84:0/1958623801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc20105bc0 0x7efc20105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 -- 172.21.15.84:0/1958623801 >> 172.21.15.84:0/1958623801 conn(0x7efc20101670 msgr2=0x7efc20103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:13.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 -- 172.21.15.84:0/1958623801 shutdown_connections 2024-09-21T02:41:13.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.899+0000 7efc25200640 1 -- 172.21.15.84:0/1958623801 wait complete. 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.900+0000 7efc25200640 1 Processor -- start 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.900+0000 7efc25200640 1 -- start start 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc25200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20105bc0 0x7efc2019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc25200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010b500 0x7efc2019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc25200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc2010be50 0x7efc201a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc25200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc20115c50 con 0x7efc2010b500 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc25200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc20115ad0 con 0x7efc2010be50 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc25200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc20115dd0 con 0x7efc20105bc0 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc16a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010b500 0x7efc2019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:13.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc16a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010b500 0x7efc2019cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41900/0 (socket says 172.21.15.84:41900) 2024-09-21T02:41:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc16a00640 1 -- 172.21.15.84:0/1508081135 learned_addr learned my addr 172.21.15.84:0/1508081135 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc1fe00640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc2010be50 0x7efc201a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.901+0000 7efc1f400640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20105bc0 0x7efc2019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.902+0000 7efc16a00640 1 -- 172.21.15.84:0/1508081135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20105bc0 msgr2=0x7efc2019c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.902+0000 7efc16a00640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20105bc0 0x7efc2019c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.902+0000 7efc16a00640 1 -- 172.21.15.84:0/1508081135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc2010be50 msgr2=0x7efc201a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.902+0000 7efc16a00640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc2010be50 0x7efc201a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:13.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.902+0000 7efc16a00640 1 -- 172.21.15.84:0/1508081135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc201a2530 con 0x7efc2010b500 2024-09-21T02:41:13.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.902+0000 7efc16a00640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010b500 0x7efc2019cb60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e9c0 tx=0x7efc0800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:13.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.902+0000 7efc1cc00640 1 -- 172.21.15.84:0/1508081135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0800ccc0 con 0x7efc2010b500 2024-09-21T02:41:13.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.903+0000 7efc1cc00640 1 -- 172.21.15.84:0/1508081135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efc080054f0 con 0x7efc2010b500 2024-09-21T02:41:13.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.903+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc201a2820 con 0x7efc2010b500 2024-09-21T02:41:13.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.903+0000 7efc1cc00640 1 -- 172.21.15.84:0/1508081135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08010430 con 0x7efc2010b500 2024-09-21T02:41:13.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.903+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc201a8f80 con 0x7efc2010b500 2024-09-21T02:41:13.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.904+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc20105fd0 con 0x7efc2010b500 2024-09-21T02:41:13.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.906+0000 7efc1cc00640 1 -- 172.21.15.84:0/1508081135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7efc080046c0 con 0x7efc2010b500 2024-09-21T02:41:13.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.907+0000 7efc1cc00640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efc040b65a0 0x7efc040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:13.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.908+0000 7efc1cc00640 1 -- 172.21.15.84:0/1508081135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7efc080e7d60 con 0x7efc2010b500 2024-09-21T02:41:13.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.908+0000 7efc1f400640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efc040b65a0 0x7efc040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:13.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.908+0000 7efc1f400640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efc040b65a0 0x7efc040b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efc100095f0 tx=0x7efc10005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:13.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:13.910+0000 7efc1cc00640 1 -- 172.21.15.84:0/1508081135 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc08056710 con 0x7efc2010b500 2024-09-21T02:41:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:13 smithi172 ceph-mon[35067]: pgmap v362: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:41:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:13 smithi084 ceph-mon[30747]: pgmap v362: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:41:14.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:13 smithi090 ceph-mon[34571]: pgmap v362: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:41:14.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.098+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc2019d6f0 con 0x7efc2010b500 2024-09-21T02:41:14.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.100+0000 7efc1cc00640 1 -- 172.21.15.84:0/1508081135 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24726 (secure 0 0 0) 0x7efc2019d6f0 con 0x7efc2010b500 2024-09-21T02:41:14.102 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:14.102 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":86,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:40:43.390340+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:41:14.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.102+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efc040b65a0 msgr2=0x7efc040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:14.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.102+0000 7efc25200640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efc040b65a0 0x7efc040b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efc100095f0 tx=0x7efc10005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:14.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.102+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010b500 msgr2=0x7efc2019cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.102+0000 7efc25200640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010b500 0x7efc2019cb60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e9c0 tx=0x7efc0800ee80 comp rx=0 tx=0).stop 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.102+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 shutdown_connections 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.102+0000 7efc25200640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc2010be50 0x7efc201a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.102+0000 7efc25200640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc2010b500 0x7efc2019cb60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.102+0000 7efc25200640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efc040b65a0 0x7efc040b8ab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.103+0000 7efc25200640 1 --2- 172.21.15.84:0/1508081135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc20105bc0 0x7efc2019c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.103+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 >> 172.21.15.84:0/1508081135 conn(0x7efc20101670 msgr2=0x7efc2010aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.103+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 shutdown_connections 2024-09-21T02:41:14.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:14.103+0000 7efc25200640 1 -- 172.21.15.84:0/1508081135 wait complete. 2024-09-21T02:41:14.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:14 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1508081135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:14.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T02:41:14.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T02:41:14.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T02:41:14.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T02:41:14.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T02:41:14.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T02:41:14.956 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T02:41:14.956 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T02:41:14.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T02:41:14.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T02:41:14.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T02:41:14.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T02:41:15.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:14 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1508081135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:15.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:14 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1508081135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:15.944 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:15.944 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:15.978 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:15.979 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:15.993 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:15 smithi172 ceph-mon[35067]: pgmap v363: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:41:16.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:15 smithi084 ceph-mon[30747]: pgmap v363: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:41:16.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:15 smithi090 ceph-mon[34571]: pgmap v363: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:41:16.074 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:17.314 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:17.326 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:17.326 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:17.326 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 -- 172.21.15.84:0/1449231622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc1094b0 msgr2=0x7f4ebc1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 --2- 172.21.15.84:0/1449231622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc1094b0 0x7f4ebc1098c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009900 tx=0x7f4ea802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 -- 172.21.15.84:0/1449231622 shutdown_connections 2024-09-21T02:41:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 --2- 172.21.15.84:0/1449231622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc1094b0 0x7f4ebc1098c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 --2- 172.21.15.84:0/1449231622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc109e00 0x7f4ebc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 --2- 172.21.15.84:0/1449231622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ebc103b70 0x7f4ebc103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 -- 172.21.15.84:0/1449231622 >> 172.21.15.84:0/1449231622 conn(0x7f4ebc0ff5e0 msgr2=0x7f4ebc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 -- 172.21.15.84:0/1449231622 shutdown_connections 2024-09-21T02:41:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.385+0000 7f4ec2a00640 1 -- 172.21.15.84:0/1449231622 wait complete. 2024-09-21T02:41:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.386+0000 7f4ec2a00640 1 Processor -- start 2024-09-21T02:41:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ec2a00640 1 -- start start 2024-09-21T02:41:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ec2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ebc103b70 0x7f4ebc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ec2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc1094b0 0x7f4ebc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ec2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc109e00 0x7f4ebc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ec2a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc113c30 con 0x7f4ebc103b70 2024-09-21T02:41:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ec2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc113ab0 con 0x7f4ebc109e00 2024-09-21T02:41:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ec2a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc113db0 con 0x7f4ebc1094b0 2024-09-21T02:41:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ebbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ebc103b70 0x7f4ebc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ebbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ebc103b70 0x7f4ebc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41926/0 (socket says 172.21.15.84:41926) 2024-09-21T02:41:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ebbe00640 1 -- 172.21.15.84:0/4207910233 learned_addr learned my addr 172.21.15.84:0/4207910233 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.387+0000 7f4ec0a00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc109e00 0x7f4ebc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ebbe00640 1 -- 172.21.15.84:0/4207910233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc1094b0 msgr2=0x7f4ebc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ebb400640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc1094b0 0x7f4ebc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ebbe00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc1094b0 0x7f4ebc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ebbe00640 1 -- 172.21.15.84:0/4207910233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc109e00 msgr2=0x7f4ebc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ebbe00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc109e00 0x7f4ebc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ebbe00640 1 -- 172.21.15.84:0/4207910233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc1a8840 con 0x7f4ebc103b70 2024-09-21T02:41:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ebb400640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc1094b0 0x7f4ebc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:41:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ec0a00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ebc109e00 0x7f4ebc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.388+0000 7f4ebbe00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ebc103b70 0x7f4ebc075710 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00e9f0 tx=0x7f4eac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:17.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.389+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00cd80 con 0x7f4ebc103b70 2024-09-21T02:41:17.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.389+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ebc1a8b30 con 0x7f4ebc103b70 2024-09-21T02:41:17.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.389+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4eac010900 con 0x7f4ebc103b70 2024-09-21T02:41:17.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.389+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac018920 con 0x7f4ebc103b70 2024-09-21T02:41:17.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.389+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ebc1a9070 con 0x7f4ebc103b70 2024-09-21T02:41:17.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.390+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ebc063ad0 con 0x7f4ebc103b70 2024-09-21T02:41:17.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.392+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4eac010ab0 con 0x7f4ebc103b70 2024-09-21T02:41:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.394+0000 7f4eb8c00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4ea00b65a0 0x7f4ea00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.394+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f4eac0e7c90 con 0x7f4ebc103b70 2024-09-21T02:41:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.394+0000 7f4ebb400640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4ea00b65a0 0x7f4ea00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.394+0000 7f4eb8c00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] conn(0x7f4ea00c16b0 0x7f4ea00c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.394+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 --> [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4eac01ee50 con 0x7f4ea00c16b0 2024-09-21T02:41:17.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.394+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f4eac0ed2a0 con 0x7f4ebc103b70 2024-09-21T02:41:17.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.394+0000 7f4ec0a00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] conn(0x7f4ea00c16b0 0x7f4ea00c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.395+0000 7f4ebb400640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4ea00b65a0 0x7f4ea00b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ea802a910 tx=0x7f4ea8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.395+0000 7f4ec0a00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] conn(0x7f4ea00c16b0 0x7f4ea00c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:17.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.396+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 <== osd.3 v2:172.21.15.84:6810/2780019322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4eac01ee50 con 0x7f4ea00c16b0 2024-09-21T02:41:17.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.410+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 --> [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ebc063f50 con 0x7f4ea00c16b0 2024-09-21T02:41:17.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.410+0000 7f4eb8c00640 1 -- 172.21.15.84:0/4207910233 <== osd.3 v2:172.21.15.84:6810/2780019322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4ebc063f50 con 0x7f4ea00c16b0 2024-09-21T02:41:17.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] conn(0x7f4ea00c16b0 msgr2=0x7f4ea00c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] conn(0x7f4ea00c16b0 0x7f4ea00c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4ea00b65a0 msgr2=0x7f4ea00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4ea00b65a0 0x7f4ea00b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ea802a910 tx=0x7f4ea8005fd0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ebc103b70 msgr2=0x7f4ebc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 --2- 172.21.15.84:0/4207910233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ebc103b70 0x7f4ebc075710 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00e9f0 tx=0x7f4eac00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec0a00640 1 -- 172.21.15.84:0/4207910233 reap_dead start 2024-09-21T02:41:17.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 shutdown_connections 2024-09-21T02:41:17.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 >> 172.21.15.84:0/4207910233 conn(0x7f4ebc0ff5e0 msgr2=0x7f4ebc108b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:17.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 shutdown_connections 2024-09-21T02:41:17.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.411+0000 7f4ec2a00640 1 -- 172.21.15.84:0/4207910233 wait complete. 2024-09-21T02:41:17.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:17 smithi084 ceph-mon[30747]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:41:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 -- 172.21.15.84:0/4097604295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf41094a0 msgr2=0x7f2bf41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 --2- 172.21.15.84:0/4097604295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf41094a0 0x7f2bf41098b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009900 tx=0x7f2be002a410 comp rx=0 tx=0).stop 2024-09-21T02:41:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 -- 172.21.15.84:0/4097604295 shutdown_connections 2024-09-21T02:41:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 --2- 172.21.15.84:0/4097604295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf4109df0 0x7f2bf4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 --2- 172.21.15.84:0/4097604295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf41094a0 0x7f2bf41098b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 --2- 172.21.15.84:0/4097604295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bf4103b60 0x7f2bf4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 -- 172.21.15.84:0/4097604295 >> 172.21.15.84:0/4097604295 conn(0x7f2bf407b850 msgr2=0x7f2bf407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 -- 172.21.15.84:0/4097604295 shutdown_connections 2024-09-21T02:41:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.985+0000 7f2bfbc00640 1 -- 172.21.15.84:0/4097604295 wait complete. 2024-09-21T02:41:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.986+0000 7f2bfbc00640 1 Processor -- start 2024-09-21T02:41:17.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.986+0000 7f2bfbc00640 1 -- start start 2024-09-21T02:41:17.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bfbc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf4103b60 0x7f2bf419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bfbc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bf41094a0 0x7f2bf419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bfbc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf4109df0 0x7f2bf419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bfbc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4113bd0 con 0x7f2bf4103b60 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bfbc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4113a50 con 0x7f2bf4109df0 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bfbc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4113d50 con 0x7f2bf41094a0 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bf9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf4103b60 0x7f2bf419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bf9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf4103b60 0x7f2bf419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41974/0 (socket says 172.21.15.84:41974) 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bf3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bf41094a0 0x7f2bf419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bf9200640 1 -- 172.21.15.84:0/3283085235 learned_addr learned my addr 172.21.15.84:0/3283085235 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.987+0000 7f2bf9c00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf4109df0 0x7f2bf419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bf3e00640 1 -- 172.21.15.84:0/3283085235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf4109df0 msgr2=0x7f2bf419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bf3e00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bf4109df0 0x7f2bf419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bf3e00640 1 -- 172.21.15.84:0/3283085235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf4103b60 msgr2=0x7f2bf419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bf3e00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf4103b60 0x7f2bf419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bf3e00640 1 -- 172.21.15.84:0/3283085235 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf41a04d0 con 0x7f2bf41094a0 2024-09-21T02:41:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bf3e00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bf41094a0 0x7f2bf419ab00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2be002a930 tx=0x7f2be0004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be003f030 con 0x7f2bf41094a0 2024-09-21T02:41:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2be0004440 con 0x7f2bf41094a0 2024-09-21T02:41:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.988+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf41a0760 con 0x7f2bf41094a0 2024-09-21T02:41:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.989+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0035070 con 0x7f2bf41094a0 2024-09-21T02:41:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.989+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf41a6f20 con 0x7f2bf41094a0 2024-09-21T02:41:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.990+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bf4063b50 con 0x7f2bf41094a0 2024-09-21T02:41:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.992+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2be0042030 con 0x7f2bf41094a0 2024-09-21T02:41:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.994+0000 7f2bf1600640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2bd80b65a0 0x7f2bd80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.994+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f2be01081c0 con 0x7f2bf41094a0 2024-09-21T02:41:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.994+0000 7f2bf9200640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2bd80b65a0 0x7f2bd80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.994+0000 7f2bf1600640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] conn(0x7f2bd80c16b0 0x7f2bd80c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.994+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 --> [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bd80c4270 con 0x7f2bd80c16b0 2024-09-21T02:41:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.994+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f2be0108570 con 0x7f2bf41094a0 2024-09-21T02:41:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.995+0000 7f2bf9200640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2bd80b65a0 0x7f2bd80b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009cd0 tx=0x7f2be4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.995+0000 7f2bf9c00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] conn(0x7f2bd80c16b0 0x7f2bd80c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.995+0000 7f2bf9c00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] conn(0x7f2bd80c16b0 0x7f2bd80c3ba0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.996+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 <== osd.7 v2:172.21.15.90:6816/2835288640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2bd80c4270 con 0x7f2bd80c16b0 2024-09-21T02:41:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:17 smithi172 ceph-mon[35067]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:41:18.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.010+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 --> [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2bf4063f50 con 0x7f2bd80c16b0 2024-09-21T02:41:18.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.011+0000 7f2bf1600640 1 -- 172.21.15.84:0/3283085235 <== osd.7 v2:172.21.15.90:6816/2835288640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2bf4063f50 con 0x7f2bd80c16b0 2024-09-21T02:41:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.011+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 >> [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] conn(0x7f2bd80c16b0 msgr2=0x7f2bd80c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.011+0000 7f2bfbc00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] conn(0x7f2bd80c16b0 0x7f2bd80c3ba0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2bd80b65a0 msgr2=0x7f2bd80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bfbc00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2bd80b65a0 0x7f2bd80b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009cd0 tx=0x7f2be4005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bf41094a0 msgr2=0x7f2bf419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bfbc00640 1 --2- 172.21.15.84:0/3283085235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bf41094a0 0x7f2bf419ab00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2be002a930 tx=0x7f2be0004040 comp rx=0 tx=0).stop 2024-09-21T02:41:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bf9c00640 1 -- 172.21.15.84:0/3283085235 reap_dead start 2024-09-21T02:41:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 shutdown_connections 2024-09-21T02:41:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 >> 172.21.15.84:0/3283085235 conn(0x7f2bf407b850 msgr2=0x7f2bf41074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 shutdown_connections 2024-09-21T02:41:18.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.012+0000 7f2bfbc00640 1 -- 172.21.15.84:0/3283085235 wait complete. 2024-09-21T02:41:18.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:17 smithi090 ceph-mon[34571]: pgmap v364: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 -- 172.21.15.84:0/123159512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46dc1039b0 msgr2=0x7f46dc103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 --2- 172.21.15.84:0/123159512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46dc1039b0 0x7f46dc103dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009900 tx=0x7f46cc02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 -- 172.21.15.84:0/123159512 shutdown_connections 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 --2- 172.21.15.84:0/123159512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc1092f0 0x7f46dc109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 --2- 172.21.15.84:0/123159512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46dc109c40 0x7f46dc110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 --2- 172.21.15.84:0/123159512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46dc1039b0 0x7f46dc103dc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 -- 172.21.15.84:0/123159512 >> 172.21.15.84:0/123159512 conn(0x7f46dc0ff440 msgr2=0x7f46dc101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 -- 172.21.15.84:0/123159512 shutdown_connections 2024-09-21T02:41:18.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.224+0000 7f46dbe00640 1 -- 172.21.15.84:0/123159512 wait complete. 2024-09-21T02:41:18.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.226+0000 7f46dbe00640 1 Processor -- start 2024-09-21T02:41:18.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.226+0000 7f46dbe00640 1 -- start start 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.226+0000 7f46dbe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc1039b0 0x7f46dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.226+0000 7f46dbe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46dc1092f0 0x7f46dc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.226+0000 7f46dbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46dc109c40 0x7f46dc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.226+0000 7f46dbe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc113a90 con 0x7f46dc109c40 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.226+0000 7f46dbe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc113910 con 0x7f46dc1092f0 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.226+0000 7f46dbe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46dc113c10 con 0x7f46dc1039b0 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46da000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46dc1092f0 0x7f46dc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46daa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc1039b0 0x7f46dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46da000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46dc1092f0 0x7f46dc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:57128/0 (socket says 172.21.15.84:57128) 2024-09-21T02:41:18.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46da000640 1 -- 172.21.15.84:0/114304219 learned_addr learned my addr 172.21.15.84:0/114304219 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:18.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46db400640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46dc109c40 0x7f46dc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46da000640 1 -- 172.21.15.84:0/114304219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc1039b0 msgr2=0x7f46dc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46da000640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46dc1039b0 0x7f46dc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46da000640 1 -- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46dc109c40 msgr2=0x7f46dc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46da000640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46dc109c40 0x7f46dc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.227+0000 7f46da000640 1 -- 172.21.15.84:0/114304219 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc1a8720 con 0x7f46dc1092f0 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.228+0000 7f46da000640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46dc1092f0 0x7f46dc075c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46c800d750 tx=0x7f46c800dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.228+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c8017070 con 0x7f46dc1092f0 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.228+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f46c80054f0 con 0x7f46dc1092f0 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.228+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc1a8a10 con 0x7f46dc1092f0 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.228+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c8004d90 con 0x7f46dc1092f0 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.228+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46dc1a8f00 con 0x7f46dc1092f0 2024-09-21T02:41:18.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.229+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46dc063b50 con 0x7f46dc1092f0 2024-09-21T02:41:18.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.232+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f46c8004f30 con 0x7f46dc1092f0 2024-09-21T02:41:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.233+0000 7f46d3400640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c00b65a0 0x7f46c00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.233+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f46c80e7630 con 0x7f46dc1092f0 2024-09-21T02:41:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.233+0000 7f46daa00640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c00b65a0 0x7f46c00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.234+0000 7f46d3400640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] conn(0x7f46c00c16b0 0x7f46c00c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.234+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 --> [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46c8021e50 con 0x7f46c00c16b0 2024-09-21T02:41:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.234+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f46c80e79e0 con 0x7f46dc1092f0 2024-09-21T02:41:18.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.234+0000 7f46db400640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] conn(0x7f46c00c16b0 0x7f46c00c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.234+0000 7f46daa00640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c00b65a0 0x7f46c00b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f46dc077160 tx=0x7f46cc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.234+0000 7f46db400640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] conn(0x7f46c00c16b0 0x7f46c00c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:18.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.235+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 <== osd.0 v2:172.21.15.84:6802/3291842956 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46c8021e50 con 0x7f46c00c16b0 2024-09-21T02:41:18.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.249+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 --> [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46dc063fd0 con 0x7f46c00c16b0 2024-09-21T02:41:18.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46d3400640 1 -- 172.21.15.84:0/114304219 <== osd.0 v2:172.21.15.84:6802/3291842956 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46dc063fd0 con 0x7f46c00c16b0 2024-09-21T02:41:18.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] conn(0x7f46c00c16b0 msgr2=0x7f46c00c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] conn(0x7f46c00c16b0 0x7f46c00c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c00b65a0 msgr2=0x7f46c00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f46c00b65a0 0x7f46c00b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f46dc077160 tx=0x7f46cc000bc0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46dc1092f0 msgr2=0x7f46dc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 --2- 172.21.15.84:0/114304219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46dc1092f0 0x7f46dc075c50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46c800d750 tx=0x7f46c800dc10 comp rx=0 tx=0).stop 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46db400640 1 -- 172.21.15.84:0/114304219 reap_dead start 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 shutdown_connections 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 >> 172.21.15.84:0/114304219 conn(0x7f46dc0ff440 msgr2=0x7f46dc108960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.250+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 shutdown_connections 2024-09-21T02:41:18.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:18.251+0000 7f46dbe00640 1 -- 172.21.15.84:0/114304219 wait complete. 2024-09-21T02:41:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 -- 172.21.15.84:0/3729289034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d81049d0 msgr2=0x7f37d8104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 --2- 172.21.15.84:0/3729289034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d81049d0 0x7f37d8104de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009900 tx=0x7f37c802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 -- 172.21.15.84:0/3729289034 shutdown_connections 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 --2- 172.21.15.84:0/3729289034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37d810de30 0x7f37d8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 --2- 172.21.15.84:0/3729289034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37d8105320 0x7f37d810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 --2- 172.21.15.84:0/3729289034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d81049d0 0x7f37d8104de0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 -- 172.21.15.84:0/3729289034 >> 172.21.15.84:0/3729289034 conn(0x7f37d8079740 msgr2=0x7f37d8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 -- 172.21.15.84:0/3729289034 shutdown_connections 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.620+0000 7f37ddc00640 1 -- 172.21.15.84:0/3729289034 wait complete. 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.621+0000 7f37ddc00640 1 Processor -- start 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.621+0000 7f37ddc00640 1 -- start start 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37ddc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37d81049d0 0x7f37d819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37ddc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37d8105320 0x7f37d819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37ddc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d810de30 0x7f37d81a2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37ddc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8113bf0 con 0x7f37d8105320 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37ddc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8113a70 con 0x7f37d81049d0 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37ddc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8113d70 con 0x7f37d810de30 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37d7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d810de30 0x7f37d81a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37d6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37d8105320 0x7f37d819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37d7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d810de30 0x7f37d81a2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:43304/0 (socket says 172.21.15.84:43304) 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37d7400640 1 -- 172.21.15.84:0/2252993059 learned_addr learned my addr 172.21.15.84:0/2252993059 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.622+0000 7f37d6a00640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37d81049d0 0x7f37d819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37d7400640 1 -- 172.21.15.84:0/2252993059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37d81049d0 msgr2=0x7f37d819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37d7400640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37d81049d0 0x7f37d819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37d7400640 1 -- 172.21.15.84:0/2252993059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37d8105320 msgr2=0x7f37d819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37d7400640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37d8105320 0x7f37d819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37d7400640 1 -- 172.21.15.84:0/2252993059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d81a2770 con 0x7f37d810de30 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37d7400640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d810de30 0x7f37d81a2040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37d000efd0 tx=0x7f37d000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0003b70 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f37d0003d10 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d81a2a60 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0010990 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.623+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d81a91c0 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.624+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37d8104140 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.627+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f37d0010b30 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.628+0000 7f37cf400640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37bc0b6620 0x7f37bc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.629+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f37d00e7f80 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.629+0000 7f37d6a00640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37bc0b6620 0x7f37bc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.629+0000 7f37cf400640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] conn(0x7f37bc0c1730 0x7f37bc0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.629+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 --> [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37bc0c42f0 con 0x7f37bc0c1730 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.629+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f37d00e83d0 con 0x7f37d810de30 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.629+0000 7f37d6000640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] conn(0x7f37bc0c1730 0x7f37bc0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.629+0000 7f37d6a00640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37bc0b6620 0x7f37bc0b8b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f37c80314b0 tx=0x7f37c80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.630+0000 7f37d6000640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] conn(0x7f37bc0c1730 0x7f37bc0c3c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.631+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 <== osd.1 v2:172.21.15.90:6800/1253575304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37bc0c42f0 con 0x7f37bc0c1730 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.645+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 --> [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37d806b390 con 0x7f37bc0c1730 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37cf400640 1 -- 172.21.15.84:0/2252993059 <== osd.1 v2:172.21.15.90:6800/1253575304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f37d806b390 con 0x7f37bc0c1730 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 >> [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] conn(0x7f37bc0c1730 msgr2=0x7f37bc0c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37ddc00640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] conn(0x7f37bc0c1730 0x7f37bc0c3c20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37bc0b6620 msgr2=0x7f37bc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37ddc00640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37bc0b6620 0x7f37bc0b8b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f37c80314b0 tx=0x7f37c80058d0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d810de30 msgr2=0x7f37d81a2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37ddc00640 1 --2- 172.21.15.84:0/2252993059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37d810de30 0x7f37d81a2040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f37d000efd0 tx=0x7f37d000c6a0 comp rx=0 tx=0).stop 2024-09-21T02:41:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37d7400640 1 -- 172.21.15.84:0/2252993059 reap_dead start 2024-09-21T02:41:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 shutdown_connections 2024-09-21T02:41:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.646+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 >> 172.21.15.84:0/2252993059 conn(0x7f37d8079740 msgr2=0x7f37d81036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.647+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 shutdown_connections 2024-09-21T02:41:18.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:17.647+0000 7f37ddc00640 1 -- 172.21.15.84:0/2252993059 wait complete. 2024-09-21T02:41:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:19.642 INFO:teuthology.orchestra.run.smithi084.stdout:55834574935 2024-09-21T02:41:19.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T02:41:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:19 smithi172 ceph-mon[35067]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:41:20.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:19 smithi084 ceph-mon[30747]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:41:20.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:19 smithi090 ceph-mon[34571]: pgmap v365: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:41:20.777 INFO:teuthology.orchestra.run.smithi084.stdout:34359738461 2024-09-21T02:41:20.778 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T02:41:21.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.079+0000 7fc7d2800640 1 -- 172.21.15.84:0/2231591633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc0760a0 msgr2=0x7fc7cc10fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.079+0000 7fc7d2800640 1 --2- 172.21.15.84:0/2231591633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc0760a0 0x7fc7cc10fa10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009900 tx=0x7fc7b802a410 comp rx=0 tx=0).stop 2024-09-21T02:41:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.079+0000 7fc7d2800640 1 -- 172.21.15.84:0/2231591633 shutdown_connections 2024-09-21T02:41:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.079+0000 7fc7d2800640 1 --2- 172.21.15.84:0/2231591633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7cc10ff50 0x7fc7cc112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.079+0000 7fc7d2800640 1 --2- 172.21.15.84:0/2231591633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc0760a0 0x7fc7cc10fa10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.079+0000 7fc7d2800640 1 --2- 172.21.15.84:0/2231591633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7cc075750 0x7fc7cc075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.079+0000 7fc7d2800640 1 -- 172.21.15.84:0/2231591633 >> 172.21.15.84:0/2231591633 conn(0x7fc7cc0ff3e0 msgr2=0x7fc7cc101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.080+0000 7fc7d2800640 1 -- 172.21.15.84:0/2231591633 shutdown_connections 2024-09-21T02:41:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.080+0000 7fc7d2800640 1 -- 172.21.15.84:0/2231591633 wait complete. 2024-09-21T02:41:21.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.081+0000 7fc7d2800640 1 Processor -- start 2024-09-21T02:41:21.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.081+0000 7fc7d2800640 1 -- start start 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.081+0000 7fc7d2800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7cc075750 0x7fc7cc19c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.081+0000 7fc7d2800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7cc0760a0 0x7fc7cc19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.081+0000 7fc7d2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc10ff50 0x7fc7cc1a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.081+0000 7fc7d2800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc115be0 con 0x7fc7cc10ff50 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.081+0000 7fc7d2800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc115a60 con 0x7fc7cc0760a0 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.081+0000 7fc7d2800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc115d60 con 0x7fc7cc075750 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7cc075750 0x7fc7cc19c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc10ff50 0x7fc7cc1a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7cc075750 0x7fc7cc19c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:60732/0 (socket says 172.21.15.84:60732) 2024-09-21T02:41:21.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 -- 172.21.15.84:0/3278403326 learned_addr learned my addr 172.21.15.84:0/3278403326 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:21.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d0a00640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7cc0760a0 0x7fc7cc19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 -- 172.21.15.84:0/3278403326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7cc0760a0 msgr2=0x7fc7cc19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7cc0760a0 0x7fc7cc19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 -- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc10ff50 msgr2=0x7fc7cc1a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7cc10ff50 0x7fc7cc1a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 -- 172.21.15.84:0/3278403326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc1a2560 con 0x7fc7cc075750 2024-09-21T02:41:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.082+0000 7fc7d1400640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7cc075750 0x7fc7cc19c5f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000e9f0 tx=0x7fc7c000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.083+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000cd80 con 0x7fc7cc075750 2024-09-21T02:41:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.083+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7cc1a2850 con 0x7fc7cc075750 2024-09-21T02:41:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.083+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc7c0010900 con 0x7fc7cc075750 2024-09-21T02:41:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.083+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00188d0 con 0x7fc7cc075750 2024-09-21T02:41:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.083+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7cc1a8fb0 con 0x7fc7cc075750 2024-09-21T02:41:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.084+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7cc10a4e0 con 0x7fc7cc075750 2024-09-21T02:41:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.087+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc7c0010ab0 con 0x7fc7cc075750 2024-09-21T02:41:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.088+0000 7fc7ca000640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc7b40b65a0 0x7fc7b40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.088+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fc7c00e83e0 con 0x7fc7cc075750 2024-09-21T02:41:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.088+0000 7fc7d0a00640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc7b40b65a0 0x7fc7b40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.089+0000 7fc7ca000640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] conn(0x7fc7b40c16b0 0x7fc7b40c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.089+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 --> [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7c001ce70 con 0x7fc7b40c16b0 2024-09-21T02:41:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.089+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc7c00e8790 con 0x7fc7cc075750 2024-09-21T02:41:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.089+0000 7fc7d1e00640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] conn(0x7fc7b40c16b0 0x7fc7b40c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.089+0000 7fc7d0a00640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc7b40b65a0 0x7fc7b40b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8005940 tx=0x7fc7b80058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.090+0000 7fc7d1e00640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] conn(0x7fc7b40c16b0 0x7fc7b40c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.090+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 <== osd.6 v2:172.21.15.84:6818/4007584109 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7c001ce70 con 0x7fc7b40c16b0 2024-09-21T02:41:21.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.105+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 --> [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7cc076c60 con 0x7fc7b40c16b0 2024-09-21T02:41:21.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.105+0000 7fc7ca000640 1 -- 172.21.15.84:0/3278403326 <== osd.6 v2:172.21.15.84:6818/4007584109 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc7cc076c60 con 0x7fc7b40c16b0 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.105+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] conn(0x7fc7b40c16b0 msgr2=0x7fc7b40c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.105+0000 7fc7d2800640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] conn(0x7fc7b40c16b0 0x7fc7b40c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc7b40b65a0 msgr2=0x7fc7b40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d2800640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc7b40b65a0 0x7fc7b40b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8005940 tx=0x7fc7b80058d0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7cc075750 msgr2=0x7fc7cc19c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d2800640 1 --2- 172.21.15.84:0/3278403326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7cc075750 0x7fc7cc19c5f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000e9f0 tx=0x7fc7c000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d1e00640 1 -- 172.21.15.84:0/3278403326 reap_dead start 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 shutdown_connections 2024-09-21T02:41:21.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 >> 172.21.15.84:0/3278403326 conn(0x7fc7cc0ff3e0 msgr2=0x7fc7cc109a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:21.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 shutdown_connections 2024-09-21T02:41:21.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:21.106+0000 7fc7d2800640 1 -- 172.21.15.84:0/3278403326 wait complete. 2024-09-21T02:41:21.443 INFO:teuthology.orchestra.run.smithi084.stdout:107374182476 2024-09-21T02:41:21.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T02:41:21.950 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:21 smithi084 ceph-mon[30747]: pgmap v366: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T02:41:21.985 INFO:teuthology.orchestra.run.smithi084.stdout:197568495670 2024-09-21T02:41:21.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T02:41:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:21 smithi172 ceph-mon[35067]: pgmap v366: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T02:41:22.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:21 smithi090 ceph-mon[34571]: pgmap v366: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T02:41:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.574+0000 7f1673200640 1 -- 172.21.15.84:0/1650649114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f167410dc40 msgr2=0x7f1674110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.574+0000 7f1673200640 1 --2- 172.21.15.84:0/1650649114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f167410dc40 0x7f1674110130 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f166c009ca0 tx=0x7f166c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.575+0000 7f1673200640 1 -- 172.21.15.84:0/1650649114 shutdown_connections 2024-09-21T02:41:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.575+0000 7f1673200640 1 --2- 172.21.15.84:0/1650649114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f167410dc40 0x7f1674110130 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.575+0000 7f1673200640 1 --2- 172.21.15.84:0/1650649114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1674105130 0x7f167410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.575+0000 7f1673200640 1 --2- 172.21.15.84:0/1650649114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16741047e0 0x7f1674104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.575+0000 7f1673200640 1 -- 172.21.15.84:0/1650649114 >> 172.21.15.84:0/1650649114 conn(0x7f16740fe300 msgr2=0x7f1674100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.575+0000 7f1673200640 1 -- 172.21.15.84:0/1650649114 shutdown_connections 2024-09-21T02:41:22.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.575+0000 7f1673200640 1 -- 172.21.15.84:0/1650649114 wait complete. 2024-09-21T02:41:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.576+0000 7f1673200640 1 Processor -- start 2024-09-21T02:41:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.576+0000 7f1673200640 1 -- start start 2024-09-21T02:41:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.576+0000 7f1673200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16741047e0 0x7f167419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.576+0000 7f1673200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1674105130 0x7f167419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.576+0000 7f1673200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f167410dc40 0x7f167419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.576+0000 7f1673200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1674113a00 con 0x7f167410dc40 2024-09-21T02:41:22.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.576+0000 7f1673200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1674113880 con 0x7f1674105130 2024-09-21T02:41:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.576+0000 7f1673200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1674113b80 con 0x7f16741047e0 2024-09-21T02:41:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16741047e0 0x7f167419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16741047e0 0x7f167419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:60742/0 (socket says 172.21.15.84:60742) 2024-09-21T02:41:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671e00640 1 -- 172.21.15.84:0/3005830940 learned_addr learned my addr 172.21.15.84:0/3005830940 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1672800640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f167410dc40 0x7f167419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671400640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1674105130 0x7f167419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671e00640 1 -- 172.21.15.84:0/3005830940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1674105130 msgr2=0x7f167419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671e00640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1674105130 0x7f167419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671e00640 1 -- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f167410dc40 msgr2=0x7f167419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671e00640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f167410dc40 0x7f167419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671e00640 1 -- 172.21.15.84:0/3005830940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16741a02a0 con 0x7f16741047e0 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1671400640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1674105130 0x7f167419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.577+0000 7f1672800640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f167410dc40 0x7f167419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.578+0000 7f1671e00640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16741047e0 0x7f167419a330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f166400e9f0 tx=0x7f166400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.578+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166400cd80 con 0x7f16741047e0 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.578+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16741a0590 con 0x7f16741047e0 2024-09-21T02:41:22.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.578+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f16640054f0 con 0x7f16741047e0 2024-09-21T02:41:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.578+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664010690 con 0x7f16741047e0 2024-09-21T02:41:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.578+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16741a6cf0 con 0x7f16741047e0 2024-09-21T02:41:22.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.579+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1674108130 con 0x7f16741047e0 2024-09-21T02:41:22.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.582+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f16640046c0 con 0x7f16741047e0 2024-09-21T02:41:22.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.583+0000 7f166aa00640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f16580b65a0 0x7f16580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.583+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f16640e7ff0 con 0x7f16741047e0 2024-09-21T02:41:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.584+0000 7f1671400640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f16580b65a0 0x7f16580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.584+0000 7f166aa00640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] conn(0x7f16580c16b0 0x7f16580c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.584+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 --> [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1664009030 con 0x7f16580c16b0 2024-09-21T02:41:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.584+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f16640e83a0 con 0x7f16741047e0 2024-09-21T02:41:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.584+0000 7f1671400640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f16580b65a0 0x7f16580b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f167410ffc0 tx=0x7f1660005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:22.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.584+0000 7f1672800640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] conn(0x7f16580c16b0 0x7f16580c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.585+0000 7f1672800640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] conn(0x7f16580c16b0 0x7f16580c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.586+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 <== osd.2 v2:172.21.15.172:6800/105113584 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1664009030 con 0x7f16580c16b0 2024-09-21T02:41:22.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.601+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 --> [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f167406c040 con 0x7f16580c16b0 2024-09-21T02:41:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.602+0000 7f166aa00640 1 -- 172.21.15.84:0/3005830940 <== osd.2 v2:172.21.15.172:6800/105113584 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f167406c040 con 0x7f16580c16b0 2024-09-21T02:41:22.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.602+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 >> [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] conn(0x7f16580c16b0 msgr2=0x7f16580c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.602+0000 7f1673200640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] conn(0x7f16580c16b0 0x7f16580c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f16580b65a0 msgr2=0x7f16580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1673200640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f16580b65a0 0x7f16580b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f167410ffc0 tx=0x7f1660005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16741047e0 msgr2=0x7f167419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1673200640 1 --2- 172.21.15.84:0/3005830940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16741047e0 0x7f167419a330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f166400e9f0 tx=0x7f166400edf0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1672800640 1 -- 172.21.15.84:0/3005830940 reap_dead start 2024-09-21T02:41:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 shutdown_connections 2024-09-21T02:41:22.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 >> 172.21.15.84:0/3005830940 conn(0x7f16740fe300 msgr2=0x7f16741076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 shutdown_connections 2024-09-21T02:41:22.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.603+0000 7f1673200640 1 -- 172.21.15.84:0/3005830940 wait complete. 2024-09-21T02:41:22.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 -- 172.21.15.84:0/138037016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c109c40 msgr2=0x7faf9c110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 --2- 172.21.15.84:0/138037016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c109c40 0x7faf9c110470 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf94009ca0 tx=0x7faf9402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 -- 172.21.15.84:0/138037016 shutdown_connections 2024-09-21T02:41:22.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 --2- 172.21.15.84:0/138037016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c109c40 0x7faf9c110470 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 --2- 172.21.15.84:0/138037016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf9c1092f0 0x7faf9c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 --2- 172.21.15.84:0/138037016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf9c1039b0 0x7faf9c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 -- 172.21.15.84:0/138037016 >> 172.21.15.84:0/138037016 conn(0x7faf9c0ff440 msgr2=0x7faf9c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:22.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 -- 172.21.15.84:0/138037016 shutdown_connections 2024-09-21T02:41:22.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.772+0000 7fafa1600640 1 -- 172.21.15.84:0/138037016 wait complete. 2024-09-21T02:41:22.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.774+0000 7fafa1600640 1 Processor -- start 2024-09-21T02:41:22.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.774+0000 7fafa1600640 1 -- start start 2024-09-21T02:41:22.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.774+0000 7fafa1600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf9c1039b0 0x7faf9c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.774+0000 7fafa1600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c1092f0 0x7faf9c19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.774+0000 7fafa1600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf9c109c40 0x7faf9c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.774+0000 7fafa1600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c113a20 con 0x7faf9c1092f0 2024-09-21T02:41:22.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.774+0000 7fafa1600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1138a0 con 0x7faf9c1039b0 2024-09-21T02:41:22.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.774+0000 7fafa1600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c113ba0 con 0x7faf9c109c40 2024-09-21T02:41:22.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c1092f0 0x7faf9c19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c1092f0 0x7faf9c19a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37654/0 (socket says 172.21.15.84:37654) 2024-09-21T02:41:22.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 -- 172.21.15.84:0/320131955 learned_addr learned my addr 172.21.15.84:0/320131955 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:22.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9be00640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf9c1039b0 0x7faf9c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7fafa0c00640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf9c109c40 0x7faf9c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 -- 172.21.15.84:0/320131955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf9c109c40 msgr2=0x7faf9c19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf9c109c40 0x7faf9c19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 -- 172.21.15.84:0/320131955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf9c1039b0 msgr2=0x7faf9c19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf9c1039b0 0x7faf9c19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 -- 172.21.15.84:0/320131955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c1a02e0 con 0x7faf9c1092f0 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.775+0000 7faf9b400640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c1092f0 0x7faf9c19a910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf8800d950 tx=0x7faf8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.776+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88017070 con 0x7faf9c1092f0 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.776+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c1a05d0 con 0x7faf9c1092f0 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.776+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faf88009c30 con 0x7faf9c1092f0 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.776+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c1a6d30 con 0x7faf9c1092f0 2024-09-21T02:41:22.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.776+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf880047a0 con 0x7faf9c1092f0 2024-09-21T02:41:22.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.777+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf9c063b50 con 0x7faf9c1092f0 2024-09-21T02:41:22.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.780+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7faf88004020 con 0x7faf9c1092f0 2024-09-21T02:41:22.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.782+0000 7faf98c00640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faf800b65a0 0x7faf800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.782+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7faf880e77d0 con 0x7faf9c1092f0 2024-09-21T02:41:22.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.782+0000 7faf9be00640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faf800b65a0 0x7faf800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.782+0000 7faf98c00640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] conn(0x7faf800c16b0 0x7faf800c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:22.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.782+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 --> [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf800c4270 con 0x7faf800c16b0 2024-09-21T02:41:22.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.782+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7faf880e7b80 con 0x7faf9c1092f0 2024-09-21T02:41:22.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.783+0000 7fafa0c00640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] conn(0x7faf800c16b0 0x7faf800c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:22.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.783+0000 7faf9be00640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faf800b65a0 0x7faf800b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009bd0 tx=0x7faf8c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:22.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.783+0000 7fafa0c00640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] conn(0x7faf800c16b0 0x7faf800c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:22.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.784+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 <== osd.9 v2:172.21.15.84:6826/3727244874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf800c4270 con 0x7faf800c16b0 2024-09-21T02:41:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.799+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 --> [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf9c063f50 con 0x7faf800c16b0 2024-09-21T02:41:22.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.799+0000 7faf98c00640 1 -- 172.21.15.84:0/320131955 <== osd.9 v2:172.21.15.84:6826/3727244874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faf9c063f50 con 0x7faf800c16b0 2024-09-21T02:41:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.799+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] conn(0x7faf800c16b0 msgr2=0x7faf800c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.799+0000 7fafa1600640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] conn(0x7faf800c16b0 0x7faf800c3ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.799+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faf800b65a0 msgr2=0x7faf800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.799+0000 7fafa1600640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7faf800b65a0 0x7faf800b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009bd0 tx=0x7faf8c005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.799+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c1092f0 msgr2=0x7faf9c19a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.800+0000 7fafa1600640 1 --2- 172.21.15.84:0/320131955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf9c1092f0 0x7faf9c19a910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf8800d950 tx=0x7faf8800de10 comp rx=0 tx=0).stop 2024-09-21T02:41:22.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.800+0000 7fafa0c00640 1 -- 172.21.15.84:0/320131955 reap_dead start 2024-09-21T02:41:22.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.800+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 shutdown_connections 2024-09-21T02:41:22.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.800+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 >> 172.21.15.84:0/320131955 conn(0x7faf9c0ff440 msgr2=0x7faf9c106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:22.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.800+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 shutdown_connections 2024-09-21T02:41:22.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:22.800+0000 7fafa1600640 1 -- 172.21.15.84:0/320131955 wait complete. 2024-09-21T02:41:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 -- 172.21.15.84:0/273140567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a4105bb0 msgr2=0x7f13a4105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 --2- 172.21.15.84:0/273140567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a4105bb0 0x7f13a4105fc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1394009900 tx=0x7f139402a410 comp rx=0 tx=0).stop 2024-09-21T02:41:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 -- 172.21.15.84:0/273140567 shutdown_connections 2024-09-21T02:41:23.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 --2- 172.21.15.84:0/273140567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a410be40 0x7f13a4112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 --2- 172.21.15.84:0/273140567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13a410b4f0 0x7f13a410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 --2- 172.21.15.84:0/273140567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a4105bb0 0x7f13a4105fc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 -- 172.21.15.84:0/273140567 >> 172.21.15.84:0/273140567 conn(0x7f13a4101680 msgr2=0x7f13a4103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 -- 172.21.15.84:0/273140567 shutdown_connections 2024-09-21T02:41:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.755+0000 7f13a9c00640 1 -- 172.21.15.84:0/273140567 wait complete. 2024-09-21T02:41:23.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.756+0000 7f13a9c00640 1 Processor -- start 2024-09-21T02:41:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.756+0000 7f13a9c00640 1 -- start start 2024-09-21T02:41:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.756+0000 7f13a9c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13a4105bb0 0x7f13a419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.756+0000 7f13a9c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a410b4f0 0x7f13a419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.756+0000 7f13a9c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a410be40 0x7f13a41a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.756+0000 7f13a9c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f13a4115c90 con 0x7f13a410be40 2024-09-21T02:41:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.756+0000 7f13a9c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13a4115b10 con 0x7f13a4105bb0 2024-09-21T02:41:23.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.756+0000 7f13a9c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13a4115e10 con 0x7f13a410b4f0 2024-09-21T02:41:23.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a410be40 0x7f13a41a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13a4105bb0 0x7f13a419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a410be40 0x7f13a41a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37664/0 (socket says 172.21.15.84:37664) 2024-09-21T02:41:23.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a9200640 1 -- 172.21.15.84:0/1189908991 learned_addr learned my addr 172.21.15.84:0/1189908991 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f139b400640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a410b4f0 0x7f13a419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a9200640 1 -- 172.21.15.84:0/1189908991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a410b4f0 msgr2=0x7f13a419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a9200640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13a410b4f0 0x7f13a419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a9200640 1 -- 172.21.15.84:0/1189908991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13a4105bb0 msgr2=0x7f13a419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a9200640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13a4105bb0 0x7f13a419c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a9200640 1 -- 172.21.15.84:0/1189908991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a41a2570 con 0x7f13a410be40 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.757+0000 7f13a3e00640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13a4105bb0 0x7f13a419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.758+0000 7f13a9200640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a410be40 0x7f13a41a1e40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f139c00e970 tx=0x7f139c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:23.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.758+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c00ccc0 con 0x7f13a410be40 2024-09-21T02:41:23.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.758+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f139c00ce60 con 0x7f13a410be40 2024-09-21T02:41:23.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.758+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a41a2860 con 0x7f13a410be40 2024-09-21T02:41:23.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.758+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c010430 con 0x7f13a410be40 2024-09-21T02:41:23.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.758+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a41a8fc0 con 0x7f13a410be40 2024-09-21T02:41:23.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.759+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13a4063b50 con 0x7f13a410be40 2024-09-21T02:41:23.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.762+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f139c005000 con 0x7f13a410be40 2024-09-21T02:41:23.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.763+0000 7f13a1600640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13880b65a0 0x7f13880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.763+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f139c0e7fe0 con 0x7f13a410be40 2024-09-21T02:41:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.763+0000 7f13a3e00640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13880b65a0 0x7f13880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.764+0000 7f13a1600640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] conn(0x7f13880c16b0 0x7f13880c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.764+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 --> [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f139c0056a0 con 0x7f13880c16b0 2024-09-21T02:41:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.764+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f139c0e8390 con 0x7f13a410be40 2024-09-21T02:41:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.764+0000 7f139b400640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] conn(0x7f13880c16b0 0x7f13880c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.764+0000 7f13a3e00640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13880b65a0 0x7f13880b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1394006010 tx=0x7f1394000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.765+0000 7f139b400640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] conn(0x7f13880c16b0 0x7f13880c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:23.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.766+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 <== osd.5 v2:172.21.15.172:6808/3941830817 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f139c0056a0 con 0x7f13880c16b0 2024-09-21T02:41:23.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.780+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 --> [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f13a4063fd0 con 0x7f13880c16b0 2024-09-21T02:41:23.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a1600640 1 -- 172.21.15.84:0/1189908991 <== osd.5 v2:172.21.15.172:6808/3941830817 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f13a4063fd0 con 0x7f13880c16b0 2024-09-21T02:41:23.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 >> [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] conn(0x7f13880c16b0 msgr2=0x7f13880c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] conn(0x7f13880c16b0 0x7f13880c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13880b65a0 msgr2=0x7f13880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13880b65a0 0x7f13880b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1394006010 tx=0x7f1394000bc0 comp rx=0 tx=0).stop 2024-09-21T02:41:23.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a410be40 msgr2=0x7f13a41a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:23.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 --2- 172.21.15.84:0/1189908991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13a410be40 0x7f13a41a1e40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f139c00e970 tx=0x7f139c00ed70 comp rx=0 tx=0).stop 2024-09-21T02:41:23.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9200640 1 -- 172.21.15.84:0/1189908991 reap_dead start 2024-09-21T02:41:23.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 shutdown_connections 2024-09-21T02:41:23.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 >> 172.21.15.84:0/1189908991 conn(0x7f13a4101680 msgr2=0x7f13a410ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:23.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.781+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 shutdown_connections 2024-09-21T02:41:23.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:23.782+0000 7f13a9c00640 1 -- 172.21.15.84:0/1189908991 wait complete. 2024-09-21T02:41:23.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:23 smithi084 ceph-mon[30747]: pgmap v367: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:24.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:23 smithi172 ceph-mon[35067]: pgmap v367: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:24.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:23 smithi090 ceph-mon[34571]: pgmap v367: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:24.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 -- 172.21.15.84:0/2152177467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf0114260 msgr2=0x7fcaf0116730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 --2- 172.21.15.84:0/2152177467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf0114260 0x7fcaf0116730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009be0 tx=0x7fcae802a6c0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 -- 172.21.15.84:0/2152177467 shutdown_connections 2024-09-21T02:41:24.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 --2- 172.21.15.84:0/2152177467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf0114260 0x7fcaf0116730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 --2- 172.21.15.84:0/2152177467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcaf0075dd0 0x7fcaf00761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 --2- 172.21.15.84:0/2152177467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaf0077380 0x7fcaf00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 -- 172.21.15.84:0/2152177467 >> 172.21.15.84:0/2152177467 conn(0x7fcaf00ff3e0 msgr2=0x7fcaf0101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 -- 172.21.15.84:0/2152177467 shutdown_connections 2024-09-21T02:41:24.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.766+0000 7fcaefe00640 1 -- 172.21.15.84:0/2152177467 wait complete. 2024-09-21T02:41:24.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.767+0000 7fcaefe00640 1 Processor -- start 2024-09-21T02:41:24.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.767+0000 7fcaefe00640 1 -- start start 2024-09-21T02:41:24.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaefe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcaf0075dd0 0x7fcaf01a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaefe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaf0077380 0x7fcaf01a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaefe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf0114260 0x7fcaf01a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaefe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0119fc0 con 0x7fcaf0077380 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaefe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0119e40 con 0x7fcaf0075dd0 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaefe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf011a140 con 0x7fcaf0114260 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaeea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcaf0075dd0 0x7fcaf01a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaee000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaf0077380 0x7fcaf01a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaeea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcaf0075dd0 0x7fcaf01a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:60000/0 (socket says 172.21.15.84:60000) 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaeea00640 1 -- 172.21.15.84:0/132643514 learned_addr learned my addr 172.21.15.84:0/132643514 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaef400640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf0114260 0x7fcaf01a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaeea00640 1 -- 172.21.15.84:0/132643514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf0114260 msgr2=0x7fcaf01a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaeea00640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf0114260 0x7fcaf01a6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaeea00640 1 -- 172.21.15.84:0/132643514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaf0077380 msgr2=0x7fcaf01a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaeea00640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaf0077380 0x7fcaf01a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaeea00640 1 -- 172.21.15.84:0/132643514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf01a68a0 con 0x7fcaf0075dd0 2024-09-21T02:41:24.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.768+0000 7fcaef400640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcaf0114260 0x7fcaf01a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:41:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.769+0000 7fcaeea00640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcaf0075dd0 0x7fcaf01a0930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9c0 tx=0x7fcae000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.769+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae000cde0 con 0x7fcaf0075dd0 2024-09-21T02:41:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.769+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcae00035f0 con 0x7fcaf0075dd0 2024-09-21T02:41:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.769+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf01a6b90 con 0x7fcaf0075dd0 2024-09-21T02:41:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.769+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0010690 con 0x7fcaf0075dd0 2024-09-21T02:41:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.769+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf01ad2f0 con 0x7fcaf0075dd0 2024-09-21T02:41:24.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.770+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcaf0063b50 con 0x7fcaf0075dd0 2024-09-21T02:41:24.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.773+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcae00037a0 con 0x7fcaf0075dd0 2024-09-21T02:41:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.774+0000 7fcae7400640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcad40b65a0 0x7fcad40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.774+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fcae00e7e70 con 0x7fcaf0075dd0 2024-09-21T02:41:24.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.774+0000 7fcaee000640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcad40b65a0 0x7fcad40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.774+0000 7fcae7400640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] conn(0x7fcad40c16a0 0x7fcad40c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.775+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 --> [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcad40c4260 con 0x7fcad40c16a0 2024-09-21T02:41:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.775+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fcae00e8220 con 0x7fcaf0075dd0 2024-09-21T02:41:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.775+0000 7fcaef400640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] conn(0x7fcad40c16a0 0x7fcad40c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.775+0000 7fcaee000640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcad40b65a0 0x7fcad40b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcaf01001f0 tx=0x7fcadc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.775+0000 7fcaef400640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] conn(0x7fcad40c16a0 0x7fcad40c3b90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.776+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 <== osd.10 v2:172.21.15.90:6824/1478210023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcad40c4260 con 0x7fcad40c16a0 2024-09-21T02:41:24.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.790+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 --> [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcaf0063fd0 con 0x7fcad40c16a0 2024-09-21T02:41:24.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.791+0000 7fcae7400640 1 -- 172.21.15.84:0/132643514 <== osd.10 v2:172.21.15.90:6824/1478210023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcaf0063fd0 con 0x7fcad40c16a0 2024-09-21T02:41:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.791+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 >> [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] conn(0x7fcad40c16a0 msgr2=0x7fcad40c3b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.791+0000 7fcaefe00640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] conn(0x7fcad40c16a0 0x7fcad40c3b90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.791+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcad40b65a0 msgr2=0x7fcad40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.791+0000 7fcaefe00640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcad40b65a0 0x7fcad40b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcaf01001f0 tx=0x7fcadc00b390 comp rx=0 tx=0).stop 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.791+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcaf0075dd0 msgr2=0x7fcaf01a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.791+0000 7fcaefe00640 1 --2- 172.21.15.84:0/132643514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcaf0075dd0 0x7fcaf01a0930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e9c0 tx=0x7fcae000ee80 comp rx=0 tx=0).stop 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.792+0000 7fcaef400640 1 -- 172.21.15.84:0/132643514 reap_dead start 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.792+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 shutdown_connections 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.792+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 >> 172.21.15.84:0/132643514 conn(0x7fcaf00ff3e0 msgr2=0x7fcaf0110160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.792+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 shutdown_connections 2024-09-21T02:41:24.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.792+0000 7fcaefe00640 1 -- 172.21.15.84:0/132643514 wait complete. 2024-09-21T02:41:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 -- 172.21.15.84:0/3388801441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56481039b0 msgr2=0x7f5648103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 --2- 172.21.15.84:0/3388801441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56481039b0 0x7f5648103dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5638009900 tx=0x7f563802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 -- 172.21.15.84:0/3388801441 shutdown_connections 2024-09-21T02:41:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 --2- 172.21.15.84:0/3388801441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56481092f0 0x7f5648109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 --2- 172.21.15.84:0/3388801441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5648109c40 0x7f5648110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 --2- 172.21.15.84:0/3388801441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56481039b0 0x7f5648103dc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 -- 172.21.15.84:0/3388801441 >> 172.21.15.84:0/3388801441 conn(0x7f56480ff440 msgr2=0x7f5648101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 -- 172.21.15.84:0/3388801441 shutdown_connections 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.661+0000 7f5647200640 1 -- 172.21.15.84:0/3388801441 wait complete. 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.662+0000 7f5647200640 1 Processor -- start 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.662+0000 7f5647200640 1 -- start start 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5647200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481039b0 0x7f564819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5647200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56481092f0 0x7f564819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5647200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5648109c40 0x7f56481a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5647200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5648113a90 con 0x7f5648109c40 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5647200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5648113910 con 0x7f56481039b0 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5647200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5648113c10 con 0x7f56481092f0 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5645e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481039b0 0x7f564819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5645e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481039b0 0x7f564819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:59974/0 (socket says 172.21.15.84:59974) 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5645e00640 1 -- 172.21.15.84:0/2465667617 learned_addr learned my addr 172.21.15.84:0/2465667617 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5646800640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5648109c40 0x7f56481a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5645400640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56481092f0 0x7f564819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5645e00640 1 -- 172.21.15.84:0/2465667617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56481092f0 msgr2=0x7f564819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5645e00640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56481092f0 0x7f564819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5645e00640 1 -- 172.21.15.84:0/2465667617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5648109c40 msgr2=0x7f56481a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.663+0000 7f5645e00640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5648109c40 0x7f56481a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.664+0000 7f5645e00640 1 -- 172.21.15.84:0/2465667617 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56481a25b0 con 0x7f56481039b0 2024-09-21T02:41:24.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.664+0000 7f5645e00640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481039b0 0x7f564819c640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f56380314b0 tx=0x7f5638003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.664+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563803f070 con 0x7f56481039b0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.664+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56481a2840 con 0x7f56481039b0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.664+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5638031bf0 con 0x7f56481039b0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.664+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638035030 con 0x7f56481039b0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.664+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56481a9000 con 0x7f56481039b0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.665+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f564810fa70 con 0x7f56481039b0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.668+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5638042070 con 0x7f56481039b0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.670+0000 7f563ea00640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f562c0b6620 0x7f562c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.670+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f5638108160 con 0x7f56481039b0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.670+0000 7f5645400640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f562c0b6620 0x7f562c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.670+0000 7f563ea00640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] conn(0x7f562c0c1730 0x7f562c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:24.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.670+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 --> [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f562c0c42f0 con 0x7f562c0c1730 2024-09-21T02:41:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.670+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5638108510 con 0x7f56481039b0 2024-09-21T02:41:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.670+0000 7f5646800640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] conn(0x7f562c0c1730 0x7f562c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.671+0000 7f5645400640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f562c0b6620 0x7f562c0b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5648109b60 tx=0x7f5634005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.671+0000 7f5646800640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] conn(0x7f562c0c1730 0x7f562c0c3c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.672+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 <== osd.11 v2:172.21.15.172:6824/1518672432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f562c0c42f0 con 0x7f562c0c1730 2024-09-21T02:41:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.686+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 --> [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5648104c30 con 0x7f562c0c1730 2024-09-21T02:41:24.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.687+0000 7f563ea00640 1 -- 172.21.15.84:0/2465667617 <== osd.11 v2:172.21.15.172:6824/1518672432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5648104c30 con 0x7f562c0c1730 2024-09-21T02:41:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 >> [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] conn(0x7f562c0c1730 msgr2=0x7f562c0c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] conn(0x7f562c0c1730 0x7f562c0c3c20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f562c0b6620 msgr2=0x7f562c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f562c0b6620 0x7f562c0b8b30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5648109b60 tx=0x7f5634005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481039b0 msgr2=0x7f564819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 --2- 172.21.15.84:0/2465667617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56481039b0 0x7f564819c640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f56380314b0 tx=0x7f5638003c10 comp rx=0 tx=0).stop 2024-09-21T02:41:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5646800640 1 -- 172.21.15.84:0/2465667617 reap_dead start 2024-09-21T02:41:24.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 shutdown_connections 2024-09-21T02:41:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 >> 172.21.15.84:0/2465667617 conn(0x7f56480ff440 msgr2=0x7f5648108920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 shutdown_connections 2024-09-21T02:41:24.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:24.688+0000 7f5647200640 1 -- 172.21.15.84:0/2465667617 wait complete. 2024-09-21T02:41:26.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:25 smithi172 ceph-mon[35067]: pgmap v368: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T02:41:26.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:25 smithi084 ceph-mon[30747]: pgmap v368: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T02:41:26.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:25 smithi090 ceph-mon[34571]: pgmap v368: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T02:41:26.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.598+0000 7fc259c00640 1 -- 172.21.15.84:0/4177817301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc254109c40 msgr2=0x7fc254110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.598+0000 7fc259c00640 1 --2- 172.21.15.84:0/4177817301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc254109c40 0x7fc254110470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009ca0 tx=0x7fc24c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.598+0000 7fc259c00640 1 -- 172.21.15.84:0/4177817301 shutdown_connections 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.598+0000 7fc259c00640 1 --2- 172.21.15.84:0/4177817301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2541092f0 0x7fc254109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.598+0000 7fc259c00640 1 --2- 172.21.15.84:0/4177817301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc254109c40 0x7fc254110470 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.598+0000 7fc259c00640 1 --2- 172.21.15.84:0/4177817301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2541039b0 0x7fc254103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.598+0000 7fc259c00640 1 -- 172.21.15.84:0/4177817301 >> 172.21.15.84:0/4177817301 conn(0x7fc2540ff440 msgr2=0x7fc254101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.599+0000 7fc259c00640 1 -- 172.21.15.84:0/4177817301 shutdown_connections 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.599+0000 7fc259c00640 1 -- 172.21.15.84:0/4177817301 wait complete. 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc259c00640 1 Processor -- start 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc259c00640 1 -- start start 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc259c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2541039b0 0x7fc25419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:26.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc259c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2541092f0 0x7fc25419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc259c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc254109c40 0x7fc25419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc259c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc254113a90 con 0x7fc254109c40 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc259c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc254113910 con 0x7fc2541092f0 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc259c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc254113c10 con 0x7fc2541039b0 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.600+0000 7fc253e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2541039b0 0x7fc25419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc259200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc254109c40 0x7fc25419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc253e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2541039b0 0x7fc25419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:60850/0 (socket says 172.21.15.84:60850) 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc253e00640 1 -- 172.21.15.84:0/3445416629 learned_addr learned my addr 172.21.15.84:0/3445416629 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc24b400640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2541092f0 0x7fc25419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc253e00640 1 -- 172.21.15.84:0/3445416629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2541092f0 msgr2=0x7fc25419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc253e00640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2541092f0 0x7fc25419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc253e00640 1 -- 172.21.15.84:0/3445416629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc254109c40 msgr2=0x7fc25419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:26.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc253e00640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc254109c40 0x7fc25419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc253e00640 1 -- 172.21.15.84:0/3445416629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2541a03b0 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc253e00640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2541039b0 0x7fc25419a440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc24400e9f0 tx=0x7fc24400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.601+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24400cd80 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.602+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2541a06a0 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.602+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc244010900 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.602+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2440188d0 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.602+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2541a6e00 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.602+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc254063b50 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.605+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc244010ab0 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.607+0000 7fc251600640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc2380b65a0 0x7fc2380b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.607+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fc2440e83f0 con 0x7fc2541039b0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.607+0000 7fc24b400640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc2380b65a0 0x7fc2380b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.607+0000 7fc251600640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] conn(0x7fc2380c16b0 0x7fc2380c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:26.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.607+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 --> [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc244001d30 con 0x7fc2380c16b0 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.607+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fc2440e8840 con 0x7fc2541039b0 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.608+0000 7fc259200640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] conn(0x7fc2380c16b0 0x7fc2380c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.608+0000 7fc24b400640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc2380b65a0 0x7fc2380b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc254102cf0 tx=0x7fc23c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.608+0000 7fc259200640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] conn(0x7fc2380c16b0 0x7fc2380c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.609+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 <== osd.4 v2:172.21.15.90:6808/1991269390 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc244001d30 con 0x7fc2380c16b0 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.624+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 --> [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc254063f50 con 0x7fc2380c16b0 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.624+0000 7fc251600640 1 -- 172.21.15.84:0/3445416629 <== osd.4 v2:172.21.15.90:6808/1991269390 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc254063f50 con 0x7fc2380c16b0 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 >> [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] conn(0x7fc2380c16b0 msgr2=0x7fc2380c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:26.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] conn(0x7fc2380c16b0 0x7fc2380c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc2380b65a0 msgr2=0x7fc2380b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc2380b65a0 0x7fc2380b8ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc254102cf0 tx=0x7fc23c005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2541039b0 msgr2=0x7fc25419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 --2- 172.21.15.84:0/3445416629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2541039b0 0x7fc25419a440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc24400e9f0 tx=0x7fc24400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259200640 1 -- 172.21.15.84:0/3445416629 reap_dead start 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 shutdown_connections 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 >> 172.21.15.84:0/3445416629 conn(0x7fc2540ff440 msgr2=0x7fc254106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 shutdown_connections 2024-09-21T02:41:26.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:25.625+0000 7fc259c00640 1 -- 172.21.15.84:0/3445416629 wait complete. 2024-09-21T02:41:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.609+0000 7f396d400640 1 -- 172.21.15.84:0/3805118535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f396810de30 msgr2=0x7f3968110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.609+0000 7f396d400640 1 --2- 172.21.15.84:0/3805118535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f396810de30 0x7f3968110320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3960009ca0 tx=0x7f396002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.610+0000 7f396d400640 1 -- 172.21.15.84:0/3805118535 shutdown_connections 2024-09-21T02:41:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.610+0000 7f396d400640 1 --2- 172.21.15.84:0/3805118535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f396810de30 0x7f3968110320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:27.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.610+0000 7f396d400640 1 --2- 172.21.15.84:0/3805118535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3968105320 0x7f396810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.610+0000 7f396d400640 1 --2- 172.21.15.84:0/3805118535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39681049d0 0x7f3968104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.610+0000 7f396d400640 1 -- 172.21.15.84:0/3805118535 >> 172.21.15.84:0/3805118535 conn(0x7f3968079740 msgr2=0x7f3968079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.610+0000 7f396d400640 1 -- 172.21.15.84:0/3805118535 shutdown_connections 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.610+0000 7f396d400640 1 -- 172.21.15.84:0/3805118535 wait complete. 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.611+0000 7f396d400640 1 Processor -- start 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.611+0000 7f396d400640 1 -- start start 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f396d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39681049d0 0x7f396819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f396d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3968105320 0x7f396819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f396d400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f396810de30 0x7f39681a2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f396d400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3968113c40 con 0x7f39681049d0 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f396d400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3968113ac0 con 0x7f3968105320 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f396d400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3968113dc0 con 0x7f396810de30 2024-09-21T02:41:27.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f3967200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f396810de30 0x7f39681a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f3966800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39681049d0 0x7f396819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f3967200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f396810de30 0x7f39681a2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:60858/0 (socket says 172.21.15.84:60858) 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f3967200640 1 -- 172.21.15.84:0/3401883054 learned_addr learned my addr 172.21.15.84:0/3401883054 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.612+0000 7f395fe00640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3968105320 0x7f396819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.613+0000 7f3967200640 1 -- 172.21.15.84:0/3401883054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3968105320 msgr2=0x7f396819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.613+0000 7f3967200640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3968105320 0x7f396819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.613+0000 7f3967200640 1 -- 172.21.15.84:0/3401883054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39681049d0 msgr2=0x7f396819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.613+0000 7f3967200640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39681049d0 0x7f396819c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.613+0000 7f3967200640 1 -- 172.21.15.84:0/3401883054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39681a2740 con 0x7f396810de30 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.613+0000 7f3966800640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39681049d0 0x7f396819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.613+0000 7f3967200640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f396810de30 0x7f39681a2010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3960033040 tx=0x7f3960003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.614+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960031650 con 0x7f396810de30 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.614+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39681a29d0 con 0x7f396810de30 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.614+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f39600317f0 con 0x7f396810de30 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.614+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396002f9c0 con 0x7f396810de30 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.614+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39681a9190 con 0x7f396810de30 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.615+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f396810d810 con 0x7f396810de30 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.617+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f396002fb60 con 0x7f396810de30 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.619+0000 7f395f400640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f394c0b65a0 0x7f394c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.619+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f3960108bb0 con 0x7f396810de30 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.619+0000 7f3966800640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f394c0b65a0 0x7f394c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.619+0000 7f395f400640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] conn(0x7f394c0c16b0 0x7f394c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.619+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 --> [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3960044e50 con 0x7f394c0c16b0 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.619+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f3960109000 con 0x7f396810de30 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.620+0000 7f395fe00640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] conn(0x7f394c0c16b0 0x7f394c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:27.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.620+0000 7f3966800640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f394c0b65a0 0x7f394c0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f396806c940 tx=0x7f3958005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.620+0000 7f395fe00640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] conn(0x7f394c0c16b0 0x7f394c0c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.621+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 <== osd.8 v2:172.21.15.172:6816/3206361854 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3960044e50 con 0x7f394c0c16b0 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.650+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 --> [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f396806b390 con 0x7f394c0c16b0 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.650+0000 7f395f400640 1 -- 172.21.15.84:0/3401883054 <== osd.8 v2:172.21.15.172:6816/3206361854 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f396806b390 con 0x7f394c0c16b0 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 >> [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] conn(0x7f394c0c16b0 msgr2=0x7f394c0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f396d400640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] conn(0x7f394c0c16b0 0x7f394c0c3ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f394c0b65a0 msgr2=0x7f394c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f396d400640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f394c0b65a0 0x7f394c0b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f396806c940 tx=0x7f3958005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f396810de30 msgr2=0x7f39681a2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f396d400640 1 --2- 172.21.15.84:0/3401883054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f396810de30 0x7f39681a2010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3960033040 tx=0x7f3960003c10 comp rx=0 tx=0).stop 2024-09-21T02:41:27.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f3967200640 1 -- 172.21.15.84:0/3401883054 reap_dead start 2024-09-21T02:41:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 shutdown_connections 2024-09-21T02:41:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.651+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 >> 172.21.15.84:0/3401883054 conn(0x7f3968079740 msgr2=0x7f396810cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.652+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 shutdown_connections 2024-09-21T02:41:27.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:26.652+0000 7f396d400640 1 -- 172.21.15.84:0/3401883054 wait complete. 2024-09-21T02:41:27.704 INFO:teuthology.orchestra.run.smithi084.stdout:296352743458 2024-09-21T02:41:27.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T02:41:27.823 INFO:teuthology.orchestra.run.smithi084.stdout:150323855427 2024-09-21T02:41:27.824 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T02:41:27.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:27 smithi084 ceph-mon[30747]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:27 smithi172 ceph-mon[35067]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:27 smithi090 ceph-mon[34571]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:28.789 INFO:teuthology.orchestra.run.smithi084.stdout:223338299443 2024-09-21T02:41:28.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T02:41:29.153 INFO:teuthology.orchestra.run.smithi084.stdout:270582939686 2024-09-21T02:41:29.153 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T02:41:29.385 INFO:teuthology.orchestra.run.smithi084.stdout:77309411411 2024-09-21T02:41:29.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T02:41:29.725 INFO:teuthology.orchestra.run.smithi084.stdout:249108103211 2024-09-21T02:41:29.725 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T02:41:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:29 smithi172 ceph-mon[35067]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:29 smithi084 ceph-mon[30747]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:30.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:29 smithi090 ceph-mon[34571]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:30.120 INFO:teuthology.orchestra.run.smithi084.stdout:176093659196 2024-09-21T02:41:30.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T02:41:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:30.678 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:30.686 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:30.689 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:30.714 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:30.718 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:30.732 INFO:teuthology.orchestra.run.smithi084.stdout:133143986248 2024-09-21T02:41:30.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T02:41:30.825 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:30.825 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:30.825 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:31.960 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:31 smithi084 ceph-mon[30747]: pgmap v371: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:31 smithi172 ceph-mon[35067]: pgmap v371: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:32.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:31 smithi090 ceph-mon[34571]: pgmap v371: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:32.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 -- 172.21.15.84:0/358038763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88281094a0 msgr2=0x7f88281098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:32.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 --2- 172.21.15.84:0/358038763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88281094a0 0x7f88281098b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8810009900 tx=0x7f881002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 -- 172.21.15.84:0/358038763 shutdown_connections 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 --2- 172.21.15.84:0/358038763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8828109df0 0x7f8828110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 --2- 172.21.15.84:0/358038763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88281094a0 0x7f88281098b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 --2- 172.21.15.84:0/358038763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828103b60 0x7f8828103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 -- 172.21.15.84:0/358038763 >> 172.21.15.84:0/358038763 conn(0x7f882807b850 msgr2=0x7f882807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 -- 172.21.15.84:0/358038763 shutdown_connections 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.958+0000 7f882fc00640 1 -- 172.21.15.84:0/358038763 wait complete. 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.959+0000 7f882fc00640 1 Processor -- start 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882fc00640 1 -- start start 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882fc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828103b60 0x7f882819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882fc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88281094a0 0x7f882819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882fc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8828109df0 0x7f88281a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:32.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882fc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8828113bd0 con 0x7f8828109df0 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882fc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8828113a50 con 0x7f8828103b60 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882fc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8828113d50 con 0x7f88281094a0 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8828109df0 0x7f88281a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828103b60 0x7f882819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f881fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88281094a0 0x7f882819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828103b60 0x7f882819c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:36426/0 (socket says 172.21.15.84:36426) 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.960+0000 7f882d200640 1 -- 172.21.15.84:0/2307424455 learned_addr learned my addr 172.21.15.84:0/2307424455 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f882d200640 1 -- 172.21.15.84:0/2307424455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88281094a0 msgr2=0x7f882819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f882d200640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88281094a0 0x7f882819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f882d200640 1 -- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8828109df0 msgr2=0x7f88281a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f882d200640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8828109df0 0x7f88281a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f882d200640 1 -- 172.21.15.84:0/2307424455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88281a2730 con 0x7f8828103b60 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f882dc00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8828109df0 0x7f88281a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:32.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f882d200640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828103b60 0x7f882819c7c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f881800e9f0 tx=0x7f881800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f8826000640 1 -- 172.21.15.84:0/2307424455 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881800ccc0 con 0x7f8828103b60 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88281a2a20 con 0x7f8828103b60 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.961+0000 7f8826000640 1 -- 172.21.15.84:0/2307424455 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8818010900 con 0x7f8828103b60 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.962+0000 7f8826000640 1 -- 172.21.15.84:0/2307424455 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818018860 con 0x7f8828103b60 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.962+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88281a9180 con 0x7f8828103b60 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.963+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8828103f70 con 0x7f8828103b60 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.965+0000 7f8826000640 1 -- 172.21.15.84:0/2307424455 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8818010ab0 con 0x7f8828103b60 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.966+0000 7f8826000640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f880c0b65a0 0x7f880c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.966+0000 7f8826000640 1 -- 172.21.15.84:0/2307424455 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f88180e7fe0 con 0x7f8828103b60 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.967+0000 7f881fe00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f880c0b65a0 0x7f880c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.967+0000 7f881fe00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f880c0b65a0 0x7f880c0b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8810005940 tx=0x7f88100058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:32.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:31.968+0000 7f8826000640 1 -- 172.21.15.84:0/2307424455 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88180ae350 con 0x7f8828103b60 2024-09-21T02:41:32.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.166+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f88281a9420 con 0x7f8828103b60 2024-09-21T02:41:32.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.167+0000 7f8826000640 1 -- 172.21.15.84:0/2307424455 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f88180b2730 con 0x7f8828103b60 2024-09-21T02:41:32.168 INFO:teuthology.orchestra.run.smithi084.stdout:34359738464 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f880c0b65a0 msgr2=0x7f880c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f880c0b65a0 0x7f880c0b8ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8810005940 tx=0x7f88100058d0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828103b60 msgr2=0x7f882819c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828103b60 0x7f882819c7c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f881800e9f0 tx=0x7f881800edf0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 shutdown_connections 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f880c0b65a0 0x7f880c0b8ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88281094a0 0x7f882819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8828109df0 0x7f88281a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 --2- 172.21.15.84:0/2307424455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8828103b60 0x7f882819c7c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.169+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 >> 172.21.15.84:0/2307424455 conn(0x7f882807b850 msgr2=0x7f8828107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:32.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.170+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 shutdown_connections 2024-09-21T02:41:32.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.170+0000 7f882fc00640 1 -- 172.21.15.84:0/2307424455 wait complete. 2024-09-21T02:41:32.816 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:32 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2307424455' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:41:32.817 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:32 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3083032928' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:41:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:32 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2307424455' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:41:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:32 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3083032928' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:41:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:32 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2307424455' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T02:41:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:32 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3083032928' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T02:41:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 -- 172.21.15.84:0/4186838585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 msgr2=0x7fc984105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 --2- 172.21.15.84:0/4186838585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 0x7fc984105fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc978009ca0 tx=0x7fc97802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 -- 172.21.15.84:0/4186838585 shutdown_connections 2024-09-21T02:41:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 --2- 172.21.15.84:0/4186838585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc98410b500 0x7fc98410b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 --2- 172.21.15.84:0/4186838585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98410be50 0x7fc984112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 --2- 172.21.15.84:0/4186838585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 0x7fc984105fd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 -- 172.21.15.84:0/4186838585 >> 172.21.15.84:0/4186838585 conn(0x7fc984101670 msgr2=0x7fc984103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 -- 172.21.15.84:0/4186838585 shutdown_connections 2024-09-21T02:41:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.188+0000 7fc98ae00640 1 -- 172.21.15.84:0/4186838585 wait complete. 2024-09-21T02:41:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.189+0000 7fc98ae00640 1 Processor -- start 2024-09-21T02:41:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.189+0000 7fc98ae00640 1 -- start start 2024-09-21T02:41:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98ae00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 0x7fc98419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98ae00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc98410b500 0x7fc98419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98ae00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98410be50 0x7fc9841a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98ae00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc984115c50 con 0x7fc98410be50 2024-09-21T02:41:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98ae00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc984115ad0 con 0x7fc984105bc0 2024-09-21T02:41:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98ae00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc984115dd0 con 0x7fc98410b500 2024-09-21T02:41:33.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98410be50 0x7fc9841a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc989a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 0x7fc98419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98410be50 0x7fc9841a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34346/0 (socket says 172.21.15.84:34346) 2024-09-21T02:41:33.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc98a400640 1 -- 172.21.15.84:0/3633016161 learned_addr learned my addr 172.21.15.84:0/3633016161 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:33.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc989000640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc98410b500 0x7fc98419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc989a00640 1 -- 172.21.15.84:0/3633016161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc98410b500 msgr2=0x7fc98419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc989a00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc98410b500 0x7fc98419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc989a00640 1 -- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98410be50 msgr2=0x7fc9841a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc989a00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98410be50 0x7fc9841a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.190+0000 7fc989a00640 1 -- 172.21.15.84:0/3633016161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9841a2570 con 0x7fc984105bc0 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.191+0000 7fc989a00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 0x7fc98419c600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc978009ca0 tx=0x7fc978003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.191+0000 7fc982000640 1 -- 172.21.15.84:0/3633016161 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978031650 con 0x7fc984105bc0 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.191+0000 7fc982000640 1 -- 172.21.15.84:0/3633016161 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9780317f0 con 0x7fc984105bc0 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.191+0000 7fc982000640 1 -- 172.21.15.84:0/3633016161 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97802fa30 con 0x7fc984105bc0 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.191+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9841a2800 con 0x7fc984105bc0 2024-09-21T02:41:33.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.191+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9841a8fc0 con 0x7fc984105bc0 2024-09-21T02:41:33.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.192+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc984106e40 con 0x7fc984105bc0 2024-09-21T02:41:33.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.195+0000 7fc982000640 1 -- 172.21.15.84:0/3633016161 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc97802fbd0 con 0x7fc984105bc0 2024-09-21T02:41:33.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.197+0000 7fc982000640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc96c0b65a0 0x7fc96c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.198 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.197+0000 7fc982000640 1 -- 172.21.15.84:0/3633016161 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fc978108a00 con 0x7fc984105bc0 2024-09-21T02:41:33.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.197+0000 7fc989000640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc96c0b65a0 0x7fc96c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.198+0000 7fc989000640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc96c0b65a0 0x7fc96c0b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc984107f00 tx=0x7fc970005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:33.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.198+0000 7fc982000640 1 -- 172.21.15.84:0/3633016161 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9780ced70 con 0x7fc984105bc0 2024-09-21T02:41:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 -- 172.21.15.84:0/304425544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4104109500 msgr2=0x7f4104109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 --2- 172.21.15.84:0/304425544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4104109500 0x7f4104109910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009900 tx=0x7f40f002a400 comp rx=0 tx=0).stop 2024-09-21T02:41:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 -- 172.21.15.84:0/304425544 shutdown_connections 2024-09-21T02:41:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 --2- 172.21.15.84:0/304425544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4104109500 0x7f4104109910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 --2- 172.21.15.84:0/304425544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4104109e50 0x7f4104110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 --2- 172.21.15.84:0/304425544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4104101fc0 0x7f41041023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 -- 172.21.15.84:0/304425544 >> 172.21.15.84:0/304425544 conn(0x7f4104079f90 msgr2=0x7f410407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 -- 172.21.15.84:0/304425544 shutdown_connections 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.384+0000 7f4108a00640 1 -- 172.21.15.84:0/304425544 wait complete. 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.385+0000 7f4108a00640 1 Processor -- start 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.385+0000 7f4108a00640 1 -- start start 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.385+0000 7f4108a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4104101fc0 0x7f4104102f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4108a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4104109500 0x7f41041034a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4108a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4104109e50 0x7f41041039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4108a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4104113c30 con 0x7f4104109500 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4108a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4104113ab0 con 0x7f4104109e50 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4108a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4104113db0 con 0x7f4104101fc0 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4101400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4104109500 0x7f41041034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4102800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4104109e50 0x7f41041039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4102800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4104109e50 0x7f41041039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:36452/0 (socket says 172.21.15.84:36452) 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4102800640 1 -- 172.21.15.84:0/3083032928 learned_addr learned my addr 172.21.15.84:0/3083032928 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4101e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4104101fc0 0x7f4104102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4101400640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4104109500 0x7f41041034a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34306/0 (socket says 172.21.15.84:34306) 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4102800640 1 -- 172.21.15.84:0/3083032928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4104101fc0 msgr2=0x7f4104102f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4102800640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4104101fc0 0x7f4104102f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4102800640 1 -- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4104109500 msgr2=0x7f41041034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4102800640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4104109500 0x7f41041034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.386+0000 7f4102800640 1 -- 172.21.15.84:0/3083032928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41041a8840 con 0x7f4104109e50 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.387+0000 7f4102800640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4104109e50 0x7f41041039e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00eb10 tx=0x7f40fc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.387+0000 7f40faa00640 1 -- 172.21.15.84:0/3083032928 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc004b20 con 0x7f4104109e50 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.387+0000 7f40faa00640 1 -- 172.21.15.84:0/3083032928 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f40fc004cc0 con 0x7f4104109e50 2024-09-21T02:41:33.261 INFO:teuthology.orchestra.run.smithi084.stdout:223338299444 2024-09-21T02:41:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.387+0000 7f40faa00640 1 -- 172.21.15.84:0/3083032928 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc010720 con 0x7f4104109e50 2024-09-21T02:41:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.387+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41041a8b30 con 0x7f4104109e50 2024-09-21T02:41:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.387+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41041a8ff0 con 0x7f4104109e50 2024-09-21T02:41:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.388+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41041023d0 con 0x7f4104109e50 2024-09-21T02:41:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.391+0000 7f40faa00640 1 -- 172.21.15.84:0/3083032928 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f40fc0108c0 con 0x7f4104109e50 2024-09-21T02:41:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.392+0000 7f40faa00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40e80b65a0 0x7f40e80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.393+0000 7f40faa00640 1 -- 172.21.15.84:0/3083032928 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f40fc0e7ff0 con 0x7f4104109e50 2024-09-21T02:41:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.393+0000 7f4101e00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40e80b65a0 0x7f40e80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.393+0000 7f4101e00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40e80b65a0 0x7f40e80b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41041049b0 tx=0x7f40f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.394+0000 7f40faa00640 1 -- 172.21.15.84:0/3083032928 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40fc056710 con 0x7f4104109e50 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.598+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f4104104260 con 0x7f4104109e50 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.599+0000 7f40faa00640 1 -- 172.21.15.84:0/3083032928 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4104104260 con 0x7f4104109e50 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.601+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40e80b65a0 msgr2=0x7f40e80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.601+0000 7f4108a00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40e80b65a0 0x7f40e80b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41041049b0 tx=0x7f40f4005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.601+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4104109e50 msgr2=0x7f41041039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.601+0000 7f4108a00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4104109e50 0x7f41041039e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00eb10 tx=0x7f40fc00c2d0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.601+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 shutdown_connections 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.601+0000 7f4108a00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4104109e50 0x7f41041039e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.601+0000 7f4108a00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4104109500 0x7f41041034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.601+0000 7f4108a00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f40e80b65a0 0x7f40e80b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.602+0000 7f4108a00640 1 --2- 172.21.15.84:0/3083032928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4104101fc0 0x7f4104102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.602+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 >> 172.21.15.84:0/3083032928 conn(0x7f4104079f90 msgr2=0x7f4104107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:33.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.602+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 shutdown_connections 2024-09-21T02:41:33.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.602+0000 7f4108a00640 1 -- 172.21.15.84:0/3083032928 wait complete. 2024-09-21T02:41:33.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.391+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc98410dc20 con 0x7fc984105bc0 2024-09-21T02:41:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.392+0000 7fc982000640 1 -- 172.21.15.84:0/3633016161 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc9780d3150 con 0x7fc984105bc0 2024-09-21T02:41:33.393 INFO:teuthology.orchestra.run.smithi084.stdout:150323855429 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc96c0b65a0 msgr2=0x7fc96c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc96c0b65a0 0x7fc96c0b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc984107f00 tx=0x7fc970005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 msgr2=0x7fc98419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 0x7fc98419c600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc978009ca0 tx=0x7fc978003ce0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 shutdown_connections 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc96c0b65a0 0x7fc96c0b8ab0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc98410b500 0x7fc98419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc98410be50 0x7fc9841a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 --2- 172.21.15.84:0/3633016161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc984105bc0 0x7fc98419c600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.394+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 >> 172.21.15.84:0/3633016161 conn(0x7fc984101670 msgr2=0x7fc98410abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:33.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.395+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 shutdown_connections 2024-09-21T02:41:33.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.395+0000 7fc98ae00640 1 -- 172.21.15.84:0/3633016161 wait complete. 2024-09-21T02:41:33.833 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:33.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 -- 172.21.15.84:0/2384904750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 msgr2=0x7f9e28112540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 --2- 172.21.15.84:0/2384904750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 0x7f9e28112540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009ca0 tx=0x7f9e2002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 -- 172.21.15.84:0/2384904750 shutdown_connections 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 --2- 172.21.15.84:0/2384904750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 0x7f9e28112540 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 --2- 172.21.15.84:0/2384904750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e280760a0 0x7f9e2810fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 --2- 172.21.15.84:0/2384904750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e28075750 0x7f9e28075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 -- 172.21.15.84:0/2384904750 >> 172.21.15.84:0/2384904750 conn(0x7f9e2807b850 msgr2=0x7f9e2807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 -- 172.21.15.84:0/2384904750 shutdown_connections 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.772+0000 7f9e30400640 1 -- 172.21.15.84:0/2384904750 wait complete. 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.773+0000 7f9e30400640 1 Processor -- start 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.773+0000 7f9e30400640 1 -- start start 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e30400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e28075750 0x7f9e2819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e30400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e280760a0 0x7f9e2819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e30400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 0x7f9e281a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e30400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9e28115e00 con 0x7f9e28110120 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e30400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e28115c80 con 0x7f9e28075750 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e30400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9e28115f80 con 0x7f9e280760a0 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e2e400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 0x7f9e281a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e2e400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 0x7f9e281a1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34360/0 (socket says 172.21.15.84:34360) 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e2e400640 1 -- 172.21.15.84:0/1181885610 learned_addr learned my addr 172.21.15.84:0/1181885610 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e2d000640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e280760a0 0x7f9e2819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e2da00640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e28075750 0x7f9e2819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e2e400640 1 -- 172.21.15.84:0/1181885610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e280760a0 msgr2=0x7f9e2819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.774+0000 7f9e2e400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e280760a0 0x7f9e2819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e2e400640 1 -- 172.21.15.84:0/1181885610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e28075750 msgr2=0x7f9e2819c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e2e400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e28075750 0x7f9e2819c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e2e400640 1 -- 172.21.15.84:0/1181885610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e281a2720 con 0x7f9e28110120 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e2d000640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e280760a0 0x7f9e2819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e2da00640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e28075750 0x7f9e2819c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e2e400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 0x7f9e281a1ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e20033040 tx=0x7f9e20003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e26000640 1 -- 172.21.15.84:0/1181885610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20031650 con 0x7f9e28110120 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e26000640 1 -- 172.21.15.84:0/1181885610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e200317f0 con 0x7f9e28110120 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e26000640 1 -- 172.21.15.84:0/1181885610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2002f9c0 con 0x7f9e28110120 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e281a29b0 con 0x7f9e28110120 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.775+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e281a9170 con 0x7f9e28110120 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.776+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e28075b60 con 0x7f9e28110120 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.779+0000 7f9e26000640 1 -- 172.21.15.84:0/1181885610 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9e20004b40 con 0x7f9e28110120 2024-09-21T02:41:33.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.780+0000 7f9e26000640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e100b65a0 0x7f9e100b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:33.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.780+0000 7f9e26000640 1 -- 172.21.15.84:0/1181885610 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f9e20108b30 con 0x7f9e28110120 2024-09-21T02:41:33.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.781+0000 7f9e2da00640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e100b65a0 0x7f9e100b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:33.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.781+0000 7f9e2da00640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e100b65a0 0x7f9e100b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009fc0 tx=0x7f9e1c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:33.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.783+0000 7f9e26000640 1 -- 172.21.15.84:0/1181885610 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e200cef30 con 0x7f9e28110120 2024-09-21T02:41:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.978+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f9e281a93a0 con 0x7f9e28110120 2024-09-21T02:41:33.980 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:33 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/100922384' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:41:33.980 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:33 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3633016161' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:41:33.980 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:33 smithi084 ceph-mon[30747]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.979+0000 7f9e26000640 1 -- 172.21.15.84:0/1181885610 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9e200d3310 con 0x7f9e28110120 2024-09-21T02:41:33.981 INFO:teuthology.orchestra.run.smithi084.stdout:270582939688 2024-09-21T02:41:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e100b65a0 msgr2=0x7f9e100b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e100b65a0 0x7f9e100b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009fc0 tx=0x7f9e1c005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 msgr2=0x7f9e281a1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 0x7f9e281a1ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e20033040 tx=0x7f9e20003c10 comp rx=0 tx=0).stop 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 shutdown_connections 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9e100b65a0 0x7f9e100b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e280760a0 0x7f9e2819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e28110120 0x7f9e281a1ff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 --2- 172.21.15.84:0/1181885610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e28075750 0x7f9e2819c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 >> 172.21.15.84:0/1181885610 conn(0x7f9e2807b850 msgr2=0x7f9e28100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 shutdown_connections 2024-09-21T02:41:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.981+0000 7f9e30400640 1 -- 172.21.15.84:0/1181885610 wait complete. 2024-09-21T02:41:34.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:33 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/100922384' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:41:34.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:33 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3633016161' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:41:34.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:33 smithi172 ceph-mon[35067]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:34.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:33 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/100922384' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T02:41:34.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:33 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3633016161' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T02:41:34.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:33 smithi090 ceph-mon[34571]: pgmap v372: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:34.955 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:34 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1181885610' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:41:35.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:34 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1181885610' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:41:35.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:34 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1181885610' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T02:41:35.506 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939686 got 270582939688 for osd.10 2024-09-21T02:41:35.507 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:35.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 -- 172.21.15.84:0/4247099950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b4110040 msgr2=0x7fb9b4112550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:35.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 --2- 172.21.15.84:0/4247099950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b4110040 0x7fb9b4112550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009ca0 tx=0x7fb9ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 -- 172.21.15.84:0/4247099950 shutdown_connections 2024-09-21T02:41:35.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 --2- 172.21.15.84:0/4247099950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b4110040 0x7fb9b4112550 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 --2- 172.21.15.84:0/4247099950 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b406c0e0 0x7fb9b406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 --2- 172.21.15.84:0/4247099950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b41046a0 0x7fb9b406bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 -- 172.21.15.84:0/4247099950 >> 172.21.15.84:0/4247099950 conn(0x7fb9b40799a0 msgr2=0x7fb9b4079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 -- 172.21.15.84:0/4247099950 shutdown_connections 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.815+0000 7fb9bc200640 1 -- 172.21.15.84:0/4247099950 wait complete. 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.816+0000 7fb9bc200640 1 Processor -- start 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.816+0000 7fb9bc200640 1 -- start start 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9bc200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b406c0e0 0x7fb9b419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9bc200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b41046a0 0x7fb9b419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9bc200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b4110040 0x7fb9b41a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9bc200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4115e70 con 0x7fb9b41046a0 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9bc200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4115cf0 con 0x7fb9b4110040 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9bc200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4115ff0 con 0x7fb9b406c0e0 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b41046a0 0x7fb9b419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:35.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b41046a0 0x7fb9b419ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34328/0 (socket says 172.21.15.84:34328) 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b8e00640 1 -- 172.21.15.84:0/100922384 learned_addr learned my addr 172.21.15.84:0/100922384 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b9800640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b406c0e0 0x7fb9b419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9ba200640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b4110040 0x7fb9b41a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b8e00640 1 -- 172.21.15.84:0/100922384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b406c0e0 msgr2=0x7fb9b419c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b8e00640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b406c0e0 0x7fb9b419c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b8e00640 1 -- 172.21.15.84:0/100922384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b4110040 msgr2=0x7fb9b41a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b8e00640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b4110040 0x7fb9b41a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9b8e00640 1 -- 172.21.15.84:0/100922384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b41a2690 con 0x7fb9b41046a0 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.817+0000 7fb9ba200640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b4110040 0x7fb9b41a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.818+0000 7fb9b8e00640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b41046a0 0x7fb9b419ccc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000e9f0 tx=0x7fb9a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.818+0000 7fb9b2000640 1 -- 172.21.15.84:0/100922384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000ccc0 con 0x7fb9b41046a0 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.818+0000 7fb9b2000640 1 -- 172.21.15.84:0/100922384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb9a0010900 con 0x7fb9b41046a0 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.818+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b41a2980 con 0x7fb9b41046a0 2024-09-21T02:41:35.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.818+0000 7fb9b2000640 1 -- 172.21.15.84:0/100922384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0018900 con 0x7fb9b41046a0 2024-09-21T02:41:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.818+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b41a90e0 con 0x7fb9b41046a0 2024-09-21T02:41:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.820+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b406c4f0 con 0x7fb9b41046a0 2024-09-21T02:41:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.822+0000 7fb9b2000640 1 -- 172.21.15.84:0/100922384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb9a0010ab0 con 0x7fb9b41046a0 2024-09-21T02:41:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.824+0000 7fb9b2000640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb99c0b65a0 0x7fb99c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.824+0000 7fb9b2000640 1 -- 172.21.15.84:0/100922384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fb9a00e7fa0 con 0x7fb9b41046a0 2024-09-21T02:41:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:197568495672 2024-09-21T02:41:35.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.824+0000 7fb9b9800640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb99c0b65a0 0x7fb99c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.825+0000 7fb9b9800640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb99c0b65a0 0x7fb99c0b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009bd0 tx=0x7fb9a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:32.826+0000 7fb9b2000640 1 -- 172.21.15.84:0/100922384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9a00b26f0 con 0x7fb9b41046a0 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.023+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb9b419d850 con 0x7fb9b41046a0 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.024+0000 7fb9b2000640 1 -- 172.21.15.84:0/100922384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb9b419d850 con 0x7fb9b41046a0 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.026+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb99c0b65a0 msgr2=0x7fb99c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.026+0000 7fb9bc200640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb99c0b65a0 0x7fb99c0b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009bd0 tx=0x7fb9a8005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b41046a0 msgr2=0x7fb9b419ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b41046a0 0x7fb9b419ccc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000e9f0 tx=0x7fb9a000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 shutdown_connections 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b4110040 0x7fb9b41a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9b41046a0 0x7fb9b419ccc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb99c0b65a0 0x7fb99c0b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 --2- 172.21.15.84:0/100922384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9b406c0e0 0x7fb9b419c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:35.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 >> 172.21.15.84:0/100922384 conn(0x7fb9b40799a0 msgr2=0x7fb9b41014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:35.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 shutdown_connections 2024-09-21T02:41:35.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:33.027+0000 7fb9bc200640 1 -- 172.21.15.84:0/100922384 wait complete. 2024-09-21T02:41:36.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:35 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1450420896' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:41:36.023 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:35 smithi172 ceph-mon[35067]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:41:36.023 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:35 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1450420896' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:41:36.023 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:35 smithi090 ceph-mon[34571]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:41:36.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:35 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1450420896' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T02:41:36.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:35 smithi084 ceph-mon[30747]: pgmap v373: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 -- 172.21.15.84:0/1865052336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7670105bc0 msgr2=0x7f7670105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 --2- 172.21.15.84:0/1865052336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7670105bc0 0x7f7670105fd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7664009900 tx=0x7f766402a410 comp rx=0 tx=0).stop 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 -- 172.21.15.84:0/1865052336 shutdown_connections 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 --2- 172.21.15.84:0/1865052336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f767010be50 0x7f7670112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 --2- 172.21.15.84:0/1865052336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767010b500 0x7f767010b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 --2- 172.21.15.84:0/1865052336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7670105bc0 0x7f7670105fd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 -- 172.21.15.84:0/1865052336 >> 172.21.15.84:0/1865052336 conn(0x7f7670101670 msgr2=0x7f7670103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 -- 172.21.15.84:0/1865052336 shutdown_connections 2024-09-21T02:41:36.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.922+0000 7f7677200640 1 -- 172.21.15.84:0/1865052336 wait complete. 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.923+0000 7f7677200640 1 Processor -- start 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7677200640 1 -- start start 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7677200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7670105bc0 0x7f767019c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7677200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f767010b500 0x7f767019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7677200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767010be50 0x7f76701a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7677200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7670115ca0 con 0x7f767010b500 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7677200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7670115b20 con 0x7f767010be50 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7677200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7670115e20 con 0x7f7670105bc0 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7675400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f767010b500 0x7f767019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7675400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f767010b500 0x7f767019cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34376/0 (socket says 172.21.15.84:34376) 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7675400640 1 -- 172.21.15.84:0/1450420896 learned_addr learned my addr 172.21.15.84:0/1450420896 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7675e00640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7670105bc0 0x7f767019c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.924+0000 7f7676800640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767010be50 0x7f76701a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:36.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f7675400640 1 -- 172.21.15.84:0/1450420896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7670105bc0 msgr2=0x7f767019c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f7675400640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7670105bc0 0x7f767019c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f7675400640 1 -- 172.21.15.84:0/1450420896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767010be50 msgr2=0x7f76701a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f7675400640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767010be50 0x7f76701a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f7675400640 1 -- 172.21.15.84:0/1450420896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76701a2540 con 0x7f767010b500 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f7675400640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f767010b500 0x7f767019cb70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f766000e9f0 tx=0x7f766000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f766aa00640 1 -- 172.21.15.84:0/1450420896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766000ccc0 con 0x7f767010b500 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f766aa00640 1 -- 172.21.15.84:0/1450420896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7660010900 con 0x7f767010b500 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76701a2830 con 0x7f767010b500 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.925+0000 7f766aa00640 1 -- 172.21.15.84:0/1450420896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7660018900 con 0x7f767010b500 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.926+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76701a8f90 con 0x7f767010b500 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.927+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7670105fd0 con 0x7f767010b500 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.929+0000 7f766aa00640 1 -- 172.21.15.84:0/1450420896 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7660010ab0 con 0x7f767010b500 2024-09-21T02:41:36.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.931+0000 7f766aa00640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f76580b6620 0x7f76580b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:36.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.932+0000 7f766aa00640 1 -- 172.21.15.84:0/1450420896 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f76600e7f00 con 0x7f767010b500 2024-09-21T02:41:36.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.932+0000 7f7675e00640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f76580b6620 0x7f76580b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:36.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.932+0000 7f7675e00640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f76580b6620 0x7f76580b8b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7664006010 tx=0x7f7664000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:36.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:34.933+0000 7f766aa00640 1 -- 172.21.15.84:0/1450420896 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76600b2650 con 0x7f767010b500 2024-09-21T02:41:36.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.131+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f767019d700 con 0x7f767010b500 2024-09-21T02:41:36.503 INFO:teuthology.orchestra.run.smithi084.stdout:296352743460 2024-09-21T02:41:36.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.131+0000 7f766aa00640 1 -- 172.21.15.84:0/1450420896 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f767019d700 con 0x7f767010b500 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.133+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f76580b6620 msgr2=0x7f76580b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.133+0000 7f7677200640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f76580b6620 0x7f76580b8b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7664006010 tx=0x7f7664000bc0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.133+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f767010b500 msgr2=0x7f767019cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.133+0000 7f7677200640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f767010b500 0x7f767019cb70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f766000e9f0 tx=0x7f766000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.133+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 shutdown_connections 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.133+0000 7f7677200640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f767010be50 0x7f76701a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.133+0000 7f7677200640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f767010b500 0x7f767019cb70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.134+0000 7f7677200640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f76580b6620 0x7f76580b8b30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.134+0000 7f7677200640 1 --2- 172.21.15.84:0/1450420896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7670105bc0 0x7f767019c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.134+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 >> 172.21.15.84:0/1450420896 conn(0x7f7670101670 msgr2=0x7f767010aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.134+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 shutdown_connections 2024-09-21T02:41:36.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:35.134+0000 7f7677200640 1 -- 172.21.15.84:0/1450420896 wait complete. 2024-09-21T02:41:37.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 -- 172.21.15.84:0/389070419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90200757b0 msgr2=0x7f9020075bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 --2- 172.21.15.84:0/389070419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90200757b0 0x7f9020075bc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9014009860 tx=0x7f901402a340 comp rx=0 tx=0).stop 2024-09-21T02:41:37.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 -- 172.21.15.84:0/389070419 shutdown_connections 2024-09-21T02:41:37.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 --2- 172.21.15.84:0/389070419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9020076100 0x7f902010f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 --2- 172.21.15.84:0/389070419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f902010ff10 0x7f9020112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 --2- 172.21.15.84:0/389070419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90200757b0 0x7f9020075bc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 -- 172.21.15.84:0/389070419 >> 172.21.15.84:0/389070419 conn(0x7f90200ff440 msgr2=0x7f9020101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:37.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 -- 172.21.15.84:0/389070419 shutdown_connections 2024-09-21T02:41:37.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.032+0000 7f9026600640 1 -- 172.21.15.84:0/389070419 wait complete. 2024-09-21T02:41:37.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.033+0000 7f9026600640 1 Processor -- start 2024-09-21T02:41:37.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.034+0000 7f9026600640 1 -- start start 2024-09-21T02:41:37.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.034+0000 7f9026600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90200757b0 0x7f902019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:37.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.034+0000 7f9026600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9020076100 0x7f902019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:37.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.034+0000 7f9026600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902010ff10 0x7f90201a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:37.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.034+0000 7f9026600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9020115be0 con 0x7f90200757b0 2024-09-21T02:41:37.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.034+0000 7f9026600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9020115a60 con 0x7f9020076100 2024-09-21T02:41:37.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.034+0000 7f9026600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9020115d60 con 0x7f902010ff10 2024-09-21T02:41:37.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9020076100 0x7f902019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:37.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f9025200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90200757b0 0x7f902019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:37.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9020076100 0x7f902019cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:36536/0 (socket says 172.21.15.84:36536) 2024-09-21T02:41:37.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 -- 172.21.15.84:0/1608461722 learned_addr learned my addr 172.21.15.84:0/1608461722 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:37.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f9025c00640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902010ff10 0x7f90201a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:37.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 -- 172.21.15.84:0/1608461722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902010ff10 msgr2=0x7f90201a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902010ff10 0x7f90201a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 -- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90200757b0 msgr2=0x7f902019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90200757b0 0x7f902019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 -- 172.21.15.84:0/1608461722 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90201a2520 con 0x7f9020076100 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.035+0000 7f901fe00640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9020076100 0x7f902019cb50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f900c00e9c0 tx=0x7f900c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.036+0000 7f901d600640 1 -- 172.21.15.84:0/1608461722 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c00cd80 con 0x7f9020076100 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.036+0000 7f901d600640 1 -- 172.21.15.84:0/1608461722 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f900c0035f0 con 0x7f9020076100 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.036+0000 7f901d600640 1 -- 172.21.15.84:0/1608461722 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c010690 con 0x7f9020076100 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.036+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90201a2810 con 0x7f9020076100 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.036+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90201a8f70 con 0x7f9020076100 2024-09-21T02:41:37.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.037+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9020075bc0 con 0x7f9020076100 2024-09-21T02:41:37.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.039+0000 7f901d600640 1 -- 172.21.15.84:0/1608461722 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f900c003b30 con 0x7f9020076100 2024-09-21T02:41:37.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.042+0000 7f901d600640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90080b6620 0x7f90080b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:37.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.042+0000 7f901d600640 1 -- 172.21.15.84:0/1608461722 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f900c0e7c20 con 0x7f9020076100 2024-09-21T02:41:37.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.042+0000 7f9025200640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90080b6620 0x7f90080b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:37.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.043+0000 7f9025200640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90080b6620 0x7f90080b8b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f901402a930 tx=0x7f90140058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:37.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.043+0000 7f901d600640 1 -- 172.21.15.84:0/1608461722 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f900c0adf90 con 0x7f9020076100 2024-09-21T02:41:37.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.243+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f90201a92a0 con 0x7f9020076100 2024-09-21T02:41:37.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.244+0000 7f901d600640 1 -- 172.21.15.84:0/1608461722 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f900c0b2370 con 0x7f9020076100 2024-09-21T02:41:37.245 INFO:teuthology.orchestra.run.smithi084.stdout:77309411413 2024-09-21T02:41:37.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.246+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90080b6620 msgr2=0x7f90080b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.246+0000 7f9026600640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90080b6620 0x7f90080b8b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f901402a930 tx=0x7f90140058d0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.246+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9020076100 msgr2=0x7f902019cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.246+0000 7f9026600640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9020076100 0x7f902019cb50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f900c00e9c0 tx=0x7f900c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:41:37.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.247+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 shutdown_connections 2024-09-21T02:41:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.247+0000 7f9026600640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f90080b6620 0x7f90080b8b30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.247+0000 7f9026600640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f902010ff10 0x7f90201a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.247+0000 7f9026600640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9020076100 0x7f902019cb50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.247+0000 7f9026600640 1 --2- 172.21.15.84:0/1608461722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90200757b0 0x7f902019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.247+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 >> 172.21.15.84:0/1608461722 conn(0x7f90200ff440 msgr2=0x7f9020109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.247+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 shutdown_connections 2024-09-21T02:41:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.247+0000 7f9026600640 1 -- 172.21.15.84:0/1608461722 wait complete. 2024-09-21T02:41:37.265 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495670 got 197568495672 for osd.7 2024-09-21T02:41:37.265 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:37.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.291+0000 7fb0a3c00640 1 -- 172.21.15.84:0/4197303916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c109e00 msgr2=0x7fb09c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.291+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/4197303916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c109e00 0x7fb09c110630 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb094009ca0 tx=0x7fb09402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.291+0000 7fb0a3c00640 1 -- 172.21.15.84:0/4197303916 shutdown_connections 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.291+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/4197303916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c109e00 0x7fb09c110630 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.291+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/4197303916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb09c1094b0 0x7fb09c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.291+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/4197303916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb09c103b70 0x7fb09c103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.292+0000 7fb0a3c00640 1 -- 172.21.15.84:0/4197303916 >> 172.21.15.84:0/4197303916 conn(0x7fb09c0ff5e0 msgr2=0x7fb09c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.292+0000 7fb0a3c00640 1 -- 172.21.15.84:0/4197303916 shutdown_connections 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.292+0000 7fb0a3c00640 1 -- 172.21.15.84:0/4197303916 wait complete. 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.293+0000 7fb0a3c00640 1 Processor -- start 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.293+0000 7fb0a3c00640 1 -- start start 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.293+0000 7fb0a3c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c103b70 0x7fb09c19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:37.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.293+0000 7fb0a3c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb09c1094b0 0x7fb09c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.293+0000 7fb0a3c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb09c109e00 0x7fb09c1a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.293+0000 7fb0a3c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c113c30 con 0x7fb09c103b70 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.293+0000 7fb0a3c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c113ab0 con 0x7fb09c1094b0 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.293+0000 7fb0a3c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c113db0 con 0x7fb09c109e00 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb0a1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c103b70 0x7fb09c19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb0a1200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c103b70 0x7fb09c19c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34416/0 (socket says 172.21.15.84:34416) 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb0a1200640 1 -- 172.21.15.84:0/1144262433 learned_addr learned my addr 172.21.15.84:0/1144262433 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb09be00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb09c1094b0 0x7fb09c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb0a1c00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb09c109e00 0x7fb09c1a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb09be00640 1 -- 172.21.15.84:0/1144262433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb09c109e00 msgr2=0x7fb09c1a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb09be00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb09c109e00 0x7fb09c1a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb09be00640 1 -- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c103b70 msgr2=0x7fb09c19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb09be00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c103b70 0x7fb09c19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb09be00640 1 -- 172.21.15.84:0/1144262433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09c1a2690 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.294+0000 7fb09be00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb09c1094b0 0x7fb09c19ccc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb09c06bd40 tx=0x7fb08800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.295+0000 7fb099600640 1 -- 172.21.15.84:0/1144262433 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08800cd00 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.295+0000 7fb099600640 1 -- 172.21.15.84:0/1144262433 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0880035f0 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.295+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb09c1a2980 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.295+0000 7fb099600640 1 -- 172.21.15.84:0/1144262433 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088010690 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.295+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb09c1a90e0 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.296+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb09c103f80 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.298+0000 7fb099600640 1 -- 172.21.15.84:0/1144262433 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb0880037a0 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.301+0000 7fb099600640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb0840b65a0 0x7fb0840b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.301+0000 7fb099600640 1 -- 172.21.15.84:0/1144262433 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fb0880e7ba0 con 0x7fb09c1094b0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.301+0000 7fb0a1200640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb0840b65a0 0x7fb0840b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.302+0000 7fb0a1200640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb0840b65a0 0x7fb0840b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb090009c90 tx=0x7fb090005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.305+0000 7fb099600640 1 -- 172.21.15.84:0/1144262433 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0880ae000 con 0x7fb09c1094b0 2024-09-21T02:41:37.456 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:37 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1608461722' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:41:37.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.506+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb09c19d850 con 0x7fb09c1094b0 2024-09-21T02:41:37.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.507+0000 7fb099600640 1 -- 172.21.15.84:0/1144262433 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb0880b23e0 con 0x7fb09c1094b0 2024-09-21T02:41:37.508 INFO:teuthology.orchestra.run.smithi084.stdout:55834574938 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb0840b65a0 msgr2=0x7fb0840b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb0840b65a0 0x7fb0840b8ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb090009c90 tx=0x7fb090005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb09c1094b0 msgr2=0x7fb09c19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb09c1094b0 0x7fb09c19ccc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb09c06bd40 tx=0x7fb08800ee50 comp rx=0 tx=0).stop 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 shutdown_connections 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb0840b65a0 0x7fb0840b8ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb09c109e00 0x7fb09c1a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb09c1094b0 0x7fb09c19ccc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 --2- 172.21.15.84:0/1144262433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb09c103b70 0x7fb09c19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 >> 172.21.15.84:0/1144262433 conn(0x7fb09c0ff5e0 msgr2=0x7fb09c1069c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.509+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 shutdown_connections 2024-09-21T02:41:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:37.510+0000 7fb0a3c00640 1 -- 172.21.15.84:0/1144262433 wait complete. 2024-09-21T02:41:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:37 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1608461722' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:41:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:37 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1608461722' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T02:41:38.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:38 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1144262433' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:41:38.463 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:38 smithi084 ceph-mon[30747]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T02:41:38.493 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574935 got 55834574938 for osd.1 2024-09-21T02:41:38.493 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:38 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1144262433' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:41:38.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:38 smithi172 ceph-mon[35067]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T02:41:38.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:38 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1144262433' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T02:41:38.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:38 smithi090 ceph-mon[34571]: pgmap v374: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.767+0000 7f484fe00640 1 -- 172.21.15.84:0/490080203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48501039b0 msgr2=0x7f4850103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.767+0000 7f484fe00640 1 --2- 172.21.15.84:0/490080203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48501039b0 0x7f4850103dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4840009900 tx=0x7f484002a410 comp rx=0 tx=0).stop 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.768+0000 7f484fe00640 1 -- 172.21.15.84:0/490080203 shutdown_connections 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.768+0000 7f484fe00640 1 --2- 172.21.15.84:0/490080203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48501092f0 0x7f4850109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.768+0000 7f484fe00640 1 --2- 172.21.15.84:0/490080203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4850109c40 0x7f4850110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.768+0000 7f484fe00640 1 --2- 172.21.15.84:0/490080203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48501039b0 0x7f4850103dc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.768+0000 7f484fe00640 1 -- 172.21.15.84:0/490080203 >> 172.21.15.84:0/490080203 conn(0x7f48500ff440 msgr2=0x7f4850101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.768+0000 7f484fe00640 1 -- 172.21.15.84:0/490080203 shutdown_connections 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.768+0000 7f484fe00640 1 -- 172.21.15.84:0/490080203 wait complete. 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484fe00640 1 Processor -- start 2024-09-21T02:41:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484fe00640 1 -- start start 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48501039b0 0x7f485019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48501092f0 0x7f485019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4850109c40 0x7f485019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4850113a90 con 0x7f4850109c40 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4850113910 con 0x7f48501039b0 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484fe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4850113c10 con 0x7f48501092f0 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484e000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48501092f0 0x7f485019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.769+0000 7f484f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4850109c40 0x7f485019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484e000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48501092f0 0x7f485019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:43202/0 (socket says 172.21.15.84:43202) 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484e000640 1 -- 172.21.15.84:0/1908628479 learned_addr learned my addr 172.21.15.84:0/1908628479 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484ea00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48501039b0 0x7f485019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484f400640 1 -- 172.21.15.84:0/1908628479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48501092f0 msgr2=0x7f485019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484f400640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48501092f0 0x7f485019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484f400640 1 -- 172.21.15.84:0/1908628479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48501039b0 msgr2=0x7f485019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484f400640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48501039b0 0x7f485019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484f400640 1 -- 172.21.15.84:0/1908628479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48501a03b0 con 0x7f4850109c40 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484e000640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48501092f0 0x7f485019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.770+0000 7f484f400640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4850109c40 0x7f485019fc80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f484800da10 tx=0x7f484800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.771+0000 7f4847400640 1 -- 172.21.15.84:0/1908628479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484800bd70 con 0x7f4850109c40 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.771+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48501a06a0 con 0x7f4850109c40 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.771+0000 7f4847400640 1 -- 172.21.15.84:0/1908628479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4848003e40 con 0x7f4850109c40 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.771+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48501a6e00 con 0x7f4850109c40 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.772+0000 7f4847400640 1 -- 172.21.15.84:0/1908628479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4848010660 con 0x7f4850109c40 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.772+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4850103dc0 con 0x7f4850109c40 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.774+0000 7f4847400640 1 -- 172.21.15.84:0/1908628479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4848003970 con 0x7f4850109c40 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.777+0000 7f4847400640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f48340b65a0 0x7f48340b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:38.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.777+0000 7f4847400640 1 -- 172.21.15.84:0/1908628479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f48480e7e60 con 0x7f4850109c40 2024-09-21T02:41:38.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.777+0000 7f484ea00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f48340b65a0 0x7f48340b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:38.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.778+0000 7f484ea00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f48340b65a0 0x7f48340b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4840006010 tx=0x7f4840000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:38.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.779+0000 7f4847400640 1 -- 172.21.15.84:0/1908628479 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4848003c60 con 0x7f4850109c40 2024-09-21T02:41:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.977+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f485019b570 con 0x7f4850109c40 2024-09-21T02:41:38.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.977+0000 7f4847400640 1 -- 172.21.15.84:0/1908628479 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f485019b570 con 0x7f4850109c40 2024-09-21T02:41:38.978 INFO:teuthology.orchestra.run.smithi084.stdout:107374182480 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f48340b65a0 msgr2=0x7f48340b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f48340b65a0 0x7f48340b8ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4840006010 tx=0x7f4840000bc0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4850109c40 msgr2=0x7f485019fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4850109c40 0x7f485019fc80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f484800da10 tx=0x7f484800ded0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 shutdown_connections 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f48340b65a0 0x7f48340b8ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48501092f0 0x7f485019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4850109c40 0x7f485019fc80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.979+0000 7f484fe00640 1 --2- 172.21.15.84:0/1908628479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48501039b0 0x7f485019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.980+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 >> 172.21.15.84:0/1908628479 conn(0x7f48500ff440 msgr2=0x7f4850101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.980+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 shutdown_connections 2024-09-21T02:41:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:38.980+0000 7f484fe00640 1 -- 172.21.15.84:0/1908628479 wait complete. 2024-09-21T02:41:39.697 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:39 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1908628479' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:41:39.734 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411411 got 77309411413 for osd.2 2024-09-21T02:41:39.734 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:39 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1908628479' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:41:39.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:39 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1908628479' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T02:41:40.188 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182476 got 107374182480 for osd.3 2024-09-21T02:41:40.188 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.438+0000 7f039be00640 1 -- 172.21.15.84:0/1350725462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 msgr2=0x7f039c10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.438+0000 7f039be00640 1 --2- 172.21.15.84:0/1350725462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 0x7f039c10f9d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0384009900 tx=0x7f038402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.439+0000 7f039be00640 1 -- 172.21.15.84:0/1350725462 shutdown_connections 2024-09-21T02:41:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.439+0000 7f039be00640 1 --2- 172.21.15.84:0/1350725462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f039c10ff10 0x7f039c112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.439+0000 7f039be00640 1 --2- 172.21.15.84:0/1350725462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 0x7f039c10f9d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.439+0000 7f039be00640 1 --2- 172.21.15.84:0/1350725462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039c0757b0 0x7f039c075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.439+0000 7f039be00640 1 -- 172.21.15.84:0/1350725462 >> 172.21.15.84:0/1350725462 conn(0x7f039c0ff440 msgr2=0x7f039c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.439+0000 7f039be00640 1 -- 172.21.15.84:0/1350725462 shutdown_connections 2024-09-21T02:41:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.439+0000 7f039be00640 1 -- 172.21.15.84:0/1350725462 wait complete. 2024-09-21T02:41:40.441 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:40 smithi084 ceph-mon[30747]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.440+0000 7f039be00640 1 Processor -- start 2024-09-21T02:41:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.440+0000 7f039be00640 1 -- start start 2024-09-21T02:41:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.440+0000 7f039be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039c0757b0 0x7f039c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.440+0000 7f039be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 0x7f039c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.440+0000 7f039be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f039c10ff10 0x7f039c1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.440+0000 7f039be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f039c115be0 con 0x7f039c076100 2024-09-21T02:41:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.440+0000 7f039be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f039c115a60 con 0x7f039c0757b0 2024-09-21T02:41:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.440+0000 7f039be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f039c115d60 con 0x7f039c10ff10 2024-09-21T02:41:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f0392000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 0x7f039c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f0392000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 0x7f039c19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41238/0 (socket says 172.21.15.84:41238) 2024-09-21T02:41:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f0392000640 1 -- 172.21.15.84:0/930450199 learned_addr learned my addr 172.21.15.84:0/930450199 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f039aa00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039c0757b0 0x7f039c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f039b400640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f039c10ff10 0x7f039c1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f0392000640 1 -- 172.21.15.84:0/930450199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f039c10ff10 msgr2=0x7f039c1a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f0392000640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f039c10ff10 0x7f039c1a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f0392000640 1 -- 172.21.15.84:0/930450199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039c0757b0 msgr2=0x7f039c19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f0392000640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039c0757b0 0x7f039c19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.441+0000 7f0392000640 1 -- 172.21.15.84:0/930450199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039c1a2580 con 0x7f039c076100 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.442+0000 7f0392000640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 0x7f039c19cbb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0384005940 tx=0x7f0384004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.442+0000 7f03a0a00640 1 -- 172.21.15.84:0/930450199 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038403f030 con 0x7f039c076100 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.442+0000 7f03a0a00640 1 -- 172.21.15.84:0/930450199 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0384004440 con 0x7f039c076100 2024-09-21T02:41:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.442+0000 7f03a0a00640 1 -- 172.21.15.84:0/930450199 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384035070 con 0x7f039c076100 2024-09-21T02:41:40.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.442+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f039c1a2810 con 0x7f039c076100 2024-09-21T02:41:40.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.442+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f039c1a8fd0 con 0x7f039c076100 2024-09-21T02:41:40.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.443+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f039c076cc0 con 0x7f039c076100 2024-09-21T02:41:40.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.445+0000 7f03a0a00640 1 -- 172.21.15.84:0/930450199 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0384042030 con 0x7f039c076100 2024-09-21T02:41:40.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.447+0000 7f03a0a00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f03800b65a0 0x7f03800b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:40.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.447+0000 7f03a0a00640 1 -- 172.21.15.84:0/930450199 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f0384107f60 con 0x7f039c076100 2024-09-21T02:41:40.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.447+0000 7f039aa00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f03800b65a0 0x7f03800b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:40.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.448+0000 7f039aa00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f03800b65a0 0x7f03800b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f038c009bd0 tx=0x7f038c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:40.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.449+0000 7f03a0a00640 1 -- 172.21.15.84:0/930450199 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03840d26b0 con 0x7f039c076100 2024-09-21T02:41:40.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.642+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f039c1a91a0 con 0x7f039c076100 2024-09-21T02:41:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.643+0000 7f03a0a00640 1 -- 172.21.15.84:0/930450199 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f03840d75f0 con 0x7f039c076100 2024-09-21T02:41:40.644 INFO:teuthology.orchestra.run.smithi084.stdout:249108103214 2024-09-21T02:41:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f03800b65a0 msgr2=0x7f03800b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f03800b65a0 0x7f03800b8ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f038c009bd0 tx=0x7f038c005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 msgr2=0x7f039c19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 0x7f039c19cbb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0384005940 tx=0x7f0384004040 comp rx=0 tx=0).stop 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 shutdown_connections 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f03800b65a0 0x7f03800b8ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f039c10ff10 0x7f039c1a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039c076100 0x7f039c19cbb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 --2- 172.21.15.84:0/930450199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039c0757b0 0x7f039c19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 >> 172.21.15.84:0/930450199 conn(0x7f039c0ff440 msgr2=0x7f039c109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 shutdown_connections 2024-09-21T02:41:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:40.645+0000 7f039be00640 1 -- 172.21.15.84:0/930450199 wait complete. 2024-09-21T02:41:40.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:40 smithi172 ceph-mon[35067]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:40.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:40 smithi090 ceph-mon[34571]: pgmap v375: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:41:40.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738461 got 34359738464 for osd.0 2024-09-21T02:41:40.785 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:41.585 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:41 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/930450199' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:41:41.621 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103211 got 249108103214 for osd.9 2024-09-21T02:41:41.621 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:41 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/930450199' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:41:41.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:41 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/930450199' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T02:41:41.930 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:41.950 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299443 got 223338299444 for osd.8 2024-09-21T02:41:41.950 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:42.552 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743458 got 296352743460 for osd.11 2024-09-21T02:41:42.552 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:42 smithi172 ceph-mon[35067]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:42.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:42 smithi084 ceph-mon[30747]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:42.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:42 smithi090 ceph-mon[34571]: pgmap v376: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:41:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:42.953 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855427 got 150323855429 for osd.5 2024-09-21T02:41:42.954 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:43.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]} : dispatch 2024-09-21T02:41:43.507 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:43 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]} : dispatch 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 -- 172.21.15.84:0/2305159726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f438810c010 msgr2=0x7f4388112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 --2- 172.21.15.84:0/2305159726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f438810c010 0x7f4388112840 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4380009900 tx=0x7f438002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 -- 172.21.15.84:0/2305159726 shutdown_connections 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 --2- 172.21.15.84:0/2305159726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f438810c010 0x7f4388112840 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 --2- 172.21.15.84:0/2305159726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f438810b6c0 0x7f438810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 --2- 172.21.15.84:0/2305159726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4388105d80 0x7f4388106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 -- 172.21.15.84:0/2305159726 >> 172.21.15.84:0/2305159726 conn(0x7f43881017d0 msgr2=0x7f4388103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 -- 172.21.15.84:0/2305159726 shutdown_connections 2024-09-21T02:41:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.676+0000 7f438ec00640 1 -- 172.21.15.84:0/2305159726 wait complete. 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.677+0000 7f438ec00640 1 Processor -- start 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.677+0000 7f438ec00640 1 -- start start 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f438ec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4388105d80 0x7f438807b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f438ec00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f438810b6c0 0x7f4388077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f438ec00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f438810c010 0x7f4388078040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f438ec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4388115e10 con 0x7f4388105d80 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f438ec00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4388115c90 con 0x7f438810b6c0 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f438ec00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4388115f90 con 0x7f438810c010 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f4387e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4388105d80 0x7f438807b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f4387e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4388105d80 0x7f438807b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41260/0 (socket says 172.21.15.84:41260) 2024-09-21T02:41:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f4387e00640 1 -- 172.21.15.84:0/351298206 learned_addr learned my addr 172.21.15.84:0/351298206 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f4387400640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f438810b6c0 0x7f4388077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f438cc00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f438810c010 0x7f4388078040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f4387e00640 1 -- 172.21.15.84:0/351298206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f438810c010 msgr2=0x7f4388078040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f4387e00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f438810c010 0x7f4388078040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f4387e00640 1 -- 172.21.15.84:0/351298206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f438810b6c0 msgr2=0x7f4388077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.678+0000 7f4387e00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f438810b6c0 0x7f4388077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.679+0000 7f4387e00640 1 -- 172.21.15.84:0/351298206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43881acd50 con 0x7f4388105d80 2024-09-21T02:41:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.679+0000 7f4387e00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4388105d80 0x7f438807b640 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f437800eb90 tx=0x7f437800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.679+0000 7f4384c00640 1 -- 172.21.15.84:0/351298206 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378004d20 con 0x7f4388105d80 2024-09-21T02:41:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.679+0000 7f4384c00640 1 -- 172.21.15.84:0/351298206 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f437800ee90 con 0x7f4388105d80 2024-09-21T02:41:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.679+0000 7f4384c00640 1 -- 172.21.15.84:0/351298206 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378010720 con 0x7f4388105d80 2024-09-21T02:41:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.679+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43881acf80 con 0x7f4388105d80 2024-09-21T02:41:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.679+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43881ad380 con 0x7f4388105d80 2024-09-21T02:41:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.681+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4388106190 con 0x7f4388105d80 2024-09-21T02:41:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.683+0000 7f4384c00640 1 -- 172.21.15.84:0/351298206 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4378005580 con 0x7f4388105d80 2024-09-21T02:41:43.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.684+0000 7f4384c00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f436c0b65a0 0x7f436c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.684+0000 7f4384c00640 1 -- 172.21.15.84:0/351298206 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9150+0+0 (secure 0 0 0) 0x7f43780e7f50 con 0x7f4388105d80 2024-09-21T02:41:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.684+0000 7f4387400640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f436c0b65a0 0x7f436c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.685+0000 7f4387400640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f436c0b65a0 0x7f436c0b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4388104ed0 tx=0x7f4374005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.689+0000 7f4384c00640 1 -- 172.21.15.84:0/351298206 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43780ae290 con 0x7f4388105d80 2024-09-21T02:41:43.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]} : dispatch 2024-09-21T02:41:43.758 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:43 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]} : dispatch 2024-09-21T02:41:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]} : dispatch 2024-09-21T02:41:43.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:43 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]} : dispatch 2024-09-21T02:41:43.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.886+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f438802e640 con 0x7f4388105d80 2024-09-21T02:41:43.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.886+0000 7f4384c00640 1 -- 172.21.15.84:0/351298206 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f43780b2670 con 0x7f4388105d80 2024-09-21T02:41:43.889 INFO:teuthology.orchestra.run.smithi084.stdout:176093659201 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f436c0b65a0 msgr2=0x7f436c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f436c0b65a0 0x7f436c0b8ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4388104ed0 tx=0x7f4374005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4388105d80 msgr2=0x7f438807b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4388105d80 0x7f438807b640 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f437800eb90 tx=0x7f437800c6a0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 shutdown_connections 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f436c0b65a0 0x7f436c0b8ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f438810c010 0x7f4388078040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f438810b6c0 0x7f4388077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 --2- 172.21.15.84:0/351298206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4388105d80 0x7f438807b640 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 >> 172.21.15.84:0/351298206 conn(0x7f43881017d0 msgr2=0x7f4388108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:43.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 shutdown_connections 2024-09-21T02:41:43.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.889+0000 7f438ec00640 1 -- 172.21.15.84:0/351298206 wait complete. 2024-09-21T02:41:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 -- 172.21.15.84:0/3583583837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3541094b0 msgr2=0x7ff3541098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 --2- 172.21.15.84:0/3583583837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3541094b0 0x7ff3541098c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff340009900 tx=0x7ff34002a410 comp rx=0 tx=0).stop 2024-09-21T02:41:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 -- 172.21.15.84:0/3583583837 shutdown_connections 2024-09-21T02:41:43.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 --2- 172.21.15.84:0/3583583837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff354109e00 0x7ff354110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 --2- 172.21.15.84:0/3583583837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3541094b0 0x7ff3541098c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 --2- 172.21.15.84:0/3583583837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff354103b70 0x7ff354103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 -- 172.21.15.84:0/3583583837 >> 172.21.15.84:0/3583583837 conn(0x7ff3540ff5e0 msgr2=0x7ff354101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 -- 172.21.15.84:0/3583583837 shutdown_connections 2024-09-21T02:41:43.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.904+0000 7ff35c600640 1 -- 172.21.15.84:0/3583583837 wait complete. 2024-09-21T02:41:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.905+0000 7ff35c600640 1 Processor -- start 2024-09-21T02:41:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.906+0000 7ff35c600640 1 -- start start 2024-09-21T02:41:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.906+0000 7ff35c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff354103b70 0x7ff35419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.906+0000 7ff35c600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3541094b0 0x7ff35419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.906+0000 7ff35c600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff354109e00 0x7ff35419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.906+0000 7ff35c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff354113be0 con 0x7ff354103b70 2024-09-21T02:41:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.906+0000 7ff35c600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff354113a60 con 0x7ff354109e00 2024-09-21T02:41:43.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.906+0000 7ff35c600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff354113d60 con 0x7ff3541094b0 2024-09-21T02:41:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3541094b0 0x7ff35419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff354103b70 0x7ff35419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3541094b0 0x7ff35419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:34682/0 (socket says 172.21.15.84:34682) 2024-09-21T02:41:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359200640 1 -- 172.21.15.84:0/554239314 learned_addr learned my addr 172.21.15.84:0/554239314 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff35a600640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff354109e00 0x7ff35419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359200640 1 -- 172.21.15.84:0/554239314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff354109e00 msgr2=0x7ff35419fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359200640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff354109e00 0x7ff35419fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359200640 1 -- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff354103b70 msgr2=0x7ff35419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359200640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff354103b70 0x7ff35419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359200640 1 -- 172.21.15.84:0/554239314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3541a0500 con 0x7ff3541094b0 2024-09-21T02:41:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff359c00640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff354103b70 0x7ff35419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.907+0000 7ff35a600640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff354109e00 0x7ff35419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.908+0000 7ff359200640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3541094b0 0x7ff35419ab30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff340005940 tx=0x7ff3400042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.908+0000 7ff352000640 1 -- 172.21.15.84:0/554239314 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34003f030 con 0x7ff3541094b0 2024-09-21T02:41:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.908+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3541a0790 con 0x7ff3541094b0 2024-09-21T02:41:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.908+0000 7ff352000640 1 -- 172.21.15.84:0/554239314 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3400318f0 con 0x7ff3541094b0 2024-09-21T02:41:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.908+0000 7ff352000640 1 -- 172.21.15.84:0/554239314 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340035070 con 0x7ff3541094b0 2024-09-21T02:41:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.908+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3541a6f50 con 0x7ff3541094b0 2024-09-21T02:41:43.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.910+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff354104df0 con 0x7ff3541094b0 2024-09-21T02:41:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.912+0000 7ff352000640 1 -- 172.21.15.84:0/554239314 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff340042030 con 0x7ff3541094b0 2024-09-21T02:41:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.914+0000 7ff352000640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff33c0b65a0 0x7ff33c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.915+0000 7ff352000640 1 -- 172.21.15.84:0/554239314 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9150+0+0 (secure 0 0 0) 0x7ff340107e80 con 0x7ff3541094b0 2024-09-21T02:41:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.915+0000 7ff359c00640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff33c0b65a0 0x7ff33c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.915+0000 7ff352000640 1 -- 172.21.15.84:0/554239314 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3400d25a0 con 0x7ff3541094b0 2024-09-21T02:41:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:43.916+0000 7ff359c00640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff33c0b65a0 0x7ff33c0b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff34800bfd0 tx=0x7ff34800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:44.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.110+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff35410bbf0 con 0x7ff3541094b0 2024-09-21T02:41:44.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.110+0000 7ff352000640 1 -- 172.21.15.84:0/554239314 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff3400d74e0 con 0x7ff3541094b0 2024-09-21T02:41:44.113 INFO:teuthology.orchestra.run.smithi084.stdout:133143986251 2024-09-21T02:41:44.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff33c0b65a0 msgr2=0x7ff33c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff33c0b65a0 0x7ff33c0b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff34800bfd0 tx=0x7ff34800b390 comp rx=0 tx=0).stop 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3541094b0 msgr2=0x7ff35419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3541094b0 0x7ff35419ab30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff340005940 tx=0x7ff3400042f0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 shutdown_connections 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff33c0b65a0 0x7ff33c0b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3541094b0 0x7ff35419ab30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff354109e00 0x7ff35419fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 --2- 172.21.15.84:0/554239314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff354103b70 0x7ff35419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 >> 172.21.15.84:0/554239314 conn(0x7ff3540ff5e0 msgr2=0x7ff354101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 shutdown_connections 2024-09-21T02:41:44.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:44.113+0000 7ff35c600640 1 -- 172.21.15.84:0/554239314 wait complete. 2024-09-21T02:41:44.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-21T02:41:44.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:44 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-21T02:41:44.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:44 smithi084 ceph-mon[30747]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T02:41:44.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:44 smithi084 ceph-mon[30747]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:41:44.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:44 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/351298206' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:41:44.480 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:44 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/554239314' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:41:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-21T02:41:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:44 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-21T02:41:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:44 smithi172 ceph-mon[35067]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T02:41:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:44 smithi172 ceph-mon[35067]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:41:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:44 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/351298206' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:41:44.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:44 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/554239314' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:41:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [5, 8]}]': finished 2024-09-21T02:41:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:44 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-21T02:41:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:44 smithi090 ceph-mon[34571]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T02:41:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:44 smithi090 ceph-mon[34571]: pgmap v378: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T02:41:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:44 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/351298206' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T02:41:44.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:44 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/554239314' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T02:41:44.849 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659196 got 176093659201 for osd.6 2024-09-21T02:41:44.850 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:45.374 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986248 got 133143986251 for osd.4 2024-09-21T02:41:45.375 DEBUG:teuthology.parallel:result is None 2024-09-21T02:41:45.375 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T02:41:45.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:41:45.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:45 smithi172 ceph-mon[35067]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T02:41:45.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:45 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:41:45.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:45 smithi084 ceph-mon[30747]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T02:41:45.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:45 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:41:45.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:45 smithi090 ceph-mon[34571]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T02:41:45.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:45 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:41:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.411+0000 7f39b2e00640 1 -- 172.21.15.84:0/481428703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac1094a0 msgr2=0x7f39ac1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.411+0000 7f39b2e00640 1 --2- 172.21.15.84:0/481428703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac1094a0 0x7f39ac1098b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3998009900 tx=0x7f399802a410 comp rx=0 tx=0).stop 2024-09-21T02:41:46.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.411+0000 7f39b2e00640 1 -- 172.21.15.84:0/481428703 shutdown_connections 2024-09-21T02:41:46.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.411+0000 7f39b2e00640 1 --2- 172.21.15.84:0/481428703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39ac109df0 0x7f39ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.412+0000 7f39b2e00640 1 --2- 172.21.15.84:0/481428703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac1094a0 0x7f39ac1098b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.412+0000 7f39b2e00640 1 --2- 172.21.15.84:0/481428703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ac103b60 0x7f39ac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.412+0000 7f39b2e00640 1 -- 172.21.15.84:0/481428703 >> 172.21.15.84:0/481428703 conn(0x7f39ac07b850 msgr2=0x7f39ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:46.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.412+0000 7f39b2e00640 1 -- 172.21.15.84:0/481428703 shutdown_connections 2024-09-21T02:41:46.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.412+0000 7f39b2e00640 1 -- 172.21.15.84:0/481428703 wait complete. 2024-09-21T02:41:46.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.413+0000 7f39b2e00640 1 Processor -- start 2024-09-21T02:41:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.413+0000 7f39b2e00640 1 -- start start 2024-09-21T02:41:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.414+0000 7f39b2e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac103b60 0x7f39ac19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.414+0000 7f39b2e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ac1094a0 0x7f39ac19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.414+0000 7f39b2e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39ac109df0 0x7f39ac1a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.414+0000 7f39b2e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac113bd0 con 0x7f39ac1094a0 2024-09-21T02:41:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.414+0000 7f39b2e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac113a50 con 0x7f39ac103b60 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.414+0000 7f39b2e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac113d50 con 0x7f39ac109df0 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.414+0000 7f39b0e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39ac109df0 0x7f39ac1a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39b0e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39ac109df0 0x7f39ac1a2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:34694/0 (socket says 172.21.15.84:34694) 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39b0e00640 1 -- 172.21.15.84:0/3052396271 learned_addr learned my addr 172.21.15.84:0/3052396271 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39ab400640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ac1094a0 0x7f39ac19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39abe00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac103b60 0x7f39ac19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39b0e00640 1 -- 172.21.15.84:0/3052396271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac103b60 msgr2=0x7f39ac19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39b0e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac103b60 0x7f39ac19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39b0e00640 1 -- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ac1094a0 msgr2=0x7f39ac19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39b0e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ac1094a0 0x7f39ac19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39b0e00640 1 -- 172.21.15.84:0/3052396271 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac1a2730 con 0x7f39ac109df0 2024-09-21T02:41:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39abe00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac103b60 0x7f39ac19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.415+0000 7f39b0e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39ac109df0 0x7f39ac1a2000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39a400eb10 tx=0x7f39a400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.416+0000 7f39a8c00640 1 -- 172.21.15.84:0/3052396271 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4004b20 con 0x7f39ac109df0 2024-09-21T02:41:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.416+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ac1a2a20 con 0x7f39ac109df0 2024-09-21T02:41:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.416+0000 7f39a8c00640 1 -- 172.21.15.84:0/3052396271 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f39a4004cc0 con 0x7f39ac109df0 2024-09-21T02:41:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.416+0000 7f39a8c00640 1 -- 172.21.15.84:0/3052396271 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4010720 con 0x7f39ac109df0 2024-09-21T02:41:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.416+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ac1a9180 con 0x7f39ac109df0 2024-09-21T02:41:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.417+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ac103f70 con 0x7f39ac109df0 2024-09-21T02:41:46.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.419+0000 7f39a8c00640 1 -- 172.21.15.84:0/3052396271 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f39a40108c0 con 0x7f39ac109df0 2024-09-21T02:41:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.421+0000 7f39a8c00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f39900b65a0 0x7f39900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.421+0000 7f39a8c00640 1 -- 172.21.15.84:0/3052396271 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f39a40e7d70 con 0x7f39ac109df0 2024-09-21T02:41:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.422+0000 7f39abe00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f39900b65a0 0x7f39900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.422+0000 7f39abe00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f39900b65a0 0x7f39900b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f399c009fc0 tx=0x7f399c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:46.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.425+0000 7f39a8c00640 1 -- 172.21.15.84:0/3052396271 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39a40ae0b0 con 0x7f39ac109df0 2024-09-21T02:41:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.628+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39ac1079c0 con 0x7f39900b65a0 2024-09-21T02:41:46.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.634+0000 7f39a8c00640 1 -- 172.21.15.84:0/3052396271 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340350 (secure 0 0 0) 0x7f39ac1079c0 con 0x7f39900b65a0 2024-09-21T02:41:46.640 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:46.649 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T02:41:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f39900b65a0 msgr2=0x7f39900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f39900b65a0 0x7f39900b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f399c009fc0 tx=0x7f399c005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:46.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39ac109df0 msgr2=0x7f39ac1a2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39ac109df0 0x7f39ac1a2000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39a400eb10 tx=0x7f39a400c2d0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 shutdown_connections 2024-09-21T02:41:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f39900b65a0 0x7f39900b8ab0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39ac109df0 0x7f39ac1a2000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39ac1094a0 0x7f39ac19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 --2- 172.21.15.84:0/3052396271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39ac103b60 0x7f39ac19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:46.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.639+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 >> 172.21.15.84:0/3052396271 conn(0x7f39ac07b850 msgr2=0x7f39ac1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.640+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 shutdown_connections 2024-09-21T02:41:46.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:46.640+0000 7f39b2e00640 1 -- 172.21.15.84:0/3052396271 wait complete. 2024-09-21T02:41:46.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.769 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.770 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:46 smithi090 ceph-mon[34571]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-21T02:41:46.770 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.770 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.770 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.770 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:46 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.845 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.845 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.845 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:46 smithi084 ceph-mon[30747]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-21T02:41:46.846 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.846 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.846 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:46.846 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:46 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:47.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:47.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:47.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:46 smithi172 ceph-mon[35067]: pgmap v380: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-21T02:41:47.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:47.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:47.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:47.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:46 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:47.673 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-21T02:41:45.612385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662132,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":461,"num_read_kb":329,"num_write":292,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392072,"kb_used_data":13676,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549752,"statfs":{"total":1151940427776,"available":1151538946048,"internally_reserved":0,"allocated":14004224,"data_stored":7893680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002282"},"pg_stats":[{"pgid":"2.1f","version":"84'9","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413175+0000","last_change":"2024-09-21T02:39:43.823658+0000","last_active":"2024-09-21T02:40:43.413175+0000","last_peered":"2024-09-21T02:40:43.413175+0000","last_clean":"2024-09-21T02:40:43.413175+0000","last_became_active":"2024-09-21T02:39:43.823211+0000","last_became_peered":"2024-09-21T02:39:43.823211+0000","last_unstale":"2024-09-21T02:40:43.413175+0000","last_undegraded":"2024-09-21T02:40:43.413175+0000","last_fullsized":"2024-09-21T02:40:43.413175+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:00.505552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397896+0000","last_change":"2024-09-21T02:39:46.850819+0000","last_active":"2024-09-21T02:40:43.397896+0000","last_peered":"2024-09-21T02:40:43.397896+0000","last_clean":"2024-09-21T02:40:43.397896+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:40:43.397896+0000","last_undegraded":"2024-09-21T02:40:43.397896+0000","last_fullsized":"2024-09-21T02:40:43.397896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:21.280788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399113+0000","last_change":"2024-09-21T02:39:56.937452+0000","last_active":"2024-09-21T02:40:43.399113+0000","last_peered":"2024-09-21T02:40:43.399113+0000","last_clean":"2024-09-21T02:40:43.399113+0000","last_became_active":"2024-09-21T02:39:56.936985+0000","last_became_peered":"2024-09-21T02:39:56.936985+0000","last_unstale":"2024-09-21T02:40:43.399113+0000","last_undegraded":"2024-09-21T02:40:43.399113+0000","last_fullsized":"2024-09-21T02:40:43.399113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:39.614222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398131+0000","last_change":"2024-09-21T02:39:43.828030+0000","last_active":"2024-09-21T02:40:43.398131+0000","last_peered":"2024-09-21T02:40:43.398131+0000","last_clean":"2024-09-21T02:40:43.398131+0000","last_became_active":"2024-09-21T02:39:43.827692+0000","last_became_peered":"2024-09-21T02:39:43.827692+0000","last_unstale":"2024-09-21T02:40:43.398131+0000","last_undegraded":"2024-09-21T02:40:43.398131+0000","last_fullsized":"2024-09-21T02:40:43.398131+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:32.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400251+0000","last_change":"2024-09-21T02:39:46.854718+0000","last_active":"2024-09-21T02:40:43.400251+0000","last_peered":"2024-09-21T02:40:43.400251+0000","last_clean":"2024-09-21T02:40:43.400251+0000","last_became_active":"2024-09-21T02:39:46.854355+0000","last_became_peered":"2024-09-21T02:39:46.854355+0000","last_unstale":"2024-09-21T02:40:43.400251+0000","last_undegraded":"2024-09-21T02:40:43.400251+0000","last_fullsized":"2024-09-21T02:40:43.400251+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:58.894397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486213+0000","last_change":"2024-09-21T02:39:56.930764+0000","last_active":"2024-09-21T02:41:44.486213+0000","last_peered":"2024-09-21T02:41:44.486213+0000","last_clean":"2024-09-21T02:41:44.486213+0000","last_became_active":"2024-09-21T02:39:56.930243+0000","last_became_peered":"2024-09-21T02:39:56.930243+0000","last_unstale":"2024-09-21T02:41:44.486213+0000","last_undegraded":"2024-09-21T02:41:44.486213+0000","last_fullsized":"2024-09-21T02:41:44.486213+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:20.283102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697427+0000","last_change":"2024-09-21T02:39:43.824749+0000","last_active":"2024-09-21T02:41:44.697427+0000","last_peered":"2024-09-21T02:41:44.697427+0000","last_clean":"2024-09-21T02:41:44.697427+0000","last_became_active":"2024-09-21T02:39:43.824385+0000","last_became_peered":"2024-09-21T02:39:43.824385+0000","last_unstale":"2024-09-21T02:41:44.697427+0000","last_undegraded":"2024-09-21T02:41:44.697427+0000","last_fullsized":"2024-09-21T02:41:44.697427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395265+0000","last_change":"2024-09-21T02:39:46.856048+0000","last_active":"2024-09-21T02:40:43.395265+0000","last_peered":"2024-09-21T02:40:43.395265+0000","last_clean":"2024-09-21T02:40:43.395265+0000","last_became_active":"2024-09-21T02:39:46.855687+0000","last_became_peered":"2024-09-21T02:39:46.855687+0000","last_unstale":"2024-09-21T02:40:43.395265+0000","last_undegraded":"2024-09-21T02:40:43.395265+0000","last_fullsized":"2024-09-21T02:40:43.395265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:11.708028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487626+0000","last_change":"2024-09-21T02:39:56.931495+0000","last_active":"2024-09-21T02:41:44.487626+0000","last_peered":"2024-09-21T02:41:44.487626+0000","last_clean":"2024-09-21T02:41:44.487626+0000","last_became_active":"2024-09-21T02:39:56.930586+0000","last_became_peered":"2024-09-21T02:39:56.930586+0000","last_unstale":"2024-09-21T02:41:44.487626+0000","last_undegraded":"2024-09-21T02:41:44.487626+0000","last_fullsized":"2024-09-21T02:41:44.487626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:56.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.409321+0000","last_change":"2024-09-21T02:40:43.408517+0000","last_active":"2024-09-21T02:40:43.409321+0000","last_peered":"2024-09-21T02:40:43.409321+0000","last_clean":"2024-09-21T02:40:43.409321+0000","last_became_active":"2024-09-21T02:40:43.402800+0000","last_became_peered":"2024-09-21T02:40:43.402800+0000","last_unstale":"2024-09-21T02:40:43.409321+0000","last_undegraded":"2024-09-21T02:40:43.409321+0000","last_fullsized":"2024-09-21T02:40:43.409321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:46.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395583+0000","last_change":"2024-09-21T02:39:46.855990+0000","last_active":"2024-09-21T02:40:43.395583+0000","last_peered":"2024-09-21T02:40:43.395583+0000","last_clean":"2024-09-21T02:40:43.395583+0000","last_became_active":"2024-09-21T02:39:46.855602+0000","last_became_peered":"2024-09-21T02:39:46.855602+0000","last_unstale":"2024-09-21T02:40:43.395583+0000","last_undegraded":"2024-09-21T02:40:43.395583+0000","last_fullsized":"2024-09-21T02:40:43.395583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:43.207141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487094+0000","last_change":"2024-09-21T02:39:56.924868+0000","last_active":"2024-09-21T02:41:44.487094+0000","last_peered":"2024-09-21T02:41:44.487094+0000","last_clean":"2024-09-21T02:41:44.487094+0000","last_became_active":"2024-09-21T02:39:56.924353+0000","last_became_peered":"2024-09-21T02:39:56.924353+0000","last_unstale":"2024-09-21T02:41:44.487094+0000","last_undegraded":"2024-09-21T02:41:44.487094+0000","last_fullsized":"2024-09-21T02:41:44.487094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:48.095244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401917+0000","last_change":"2024-09-21T02:39:46.853077+0000","last_active":"2024-09-21T02:40:43.401917+0000","last_peered":"2024-09-21T02:40:43.401917+0000","last_clean":"2024-09-21T02:40:43.401917+0000","last_became_active":"2024-09-21T02:39:46.852691+0000","last_became_peered":"2024-09-21T02:39:46.852691+0000","last_unstale":"2024-09-21T02:40:43.401917+0000","last_undegraded":"2024-09-21T02:40:43.401917+0000","last_fullsized":"2024-09-21T02:40:43.401917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:12.427934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696807+0000","last_change":"2024-09-21T02:40:43.411229+0000","last_active":"2024-09-21T02:41:44.696807+0000","last_peered":"2024-09-21T02:41:44.696807+0000","last_clean":"2024-09-21T02:41:44.696807+0000","last_became_active":"2024-09-21T02:40:43.404833+0000","last_became_peered":"2024-09-21T02:40:43.404833+0000","last_unstale":"2024-09-21T02:41:44.696807+0000","last_undegraded":"2024-09-21T02:41:44.696807+0000","last_fullsized":"2024-09-21T02:41:44.696807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:22.812239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487241+0000","last_change":"2024-09-21T02:39:56.922205+0000","last_active":"2024-09-21T02:41:44.487241+0000","last_peered":"2024-09-21T02:41:44.487241+0000","last_clean":"2024-09-21T02:41:44.487241+0000","last_became_active":"2024-09-21T02:39:56.921702+0000","last_became_peered":"2024-09-21T02:39:56.921702+0000","last_unstale":"2024-09-21T02:41:44.487241+0000","last_undegraded":"2024-09-21T02:41:44.487241+0000","last_fullsized":"2024-09-21T02:41:44.487241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:07.622691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397425+0000","last_change":"2024-09-21T02:39:46.846380+0000","last_active":"2024-09-21T02:40:43.397425+0000","last_peered":"2024-09-21T02:40:43.397425+0000","last_clean":"2024-09-21T02:40:43.397425+0000","last_became_active":"2024-09-21T02:39:46.845972+0000","last_became_peered":"2024-09-21T02:39:46.845972+0000","last_unstale":"2024-09-21T02:40:43.397425+0000","last_undegraded":"2024-09-21T02:40:43.397425+0000","last_fullsized":"2024-09-21T02:40:43.397425+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:44.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398145+0000","last_change":"2024-09-21T02:39:43.824394+0000","last_active":"2024-09-21T02:40:43.398145+0000","last_peered":"2024-09-21T02:40:43.398145+0000","last_clean":"2024-09-21T02:40:43.398145+0000","last_became_active":"2024-09-21T02:39:43.823947+0000","last_became_peered":"2024-09-21T02:39:43.823947+0000","last_unstale":"2024-09-21T02:40:43.398145+0000","last_undegraded":"2024-09-21T02:40:43.398145+0000","last_fullsized":"2024-09-21T02:40:43.398145+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.083281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487375+0000","last_change":"2024-09-21T02:40:43.413833+0000","last_active":"2024-09-21T02:41:44.487375+0000","last_peered":"2024-09-21T02:41:44.487375+0000","last_clean":"2024-09-21T02:41:44.487375+0000","last_became_active":"2024-09-21T02:40:43.413319+0000","last_became_peered":"2024-09-21T02:40:43.413319+0000","last_unstale":"2024-09-21T02:41:44.487375+0000","last_undegraded":"2024-09-21T02:41:44.487375+0000","last_fullsized":"2024-09-21T02:41:44.487375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:40.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400514+0000","last_change":"2024-09-21T02:39:46.845544+0000","last_active":"2024-09-21T02:40:43.400514+0000","last_peered":"2024-09-21T02:40:43.400514+0000","last_clean":"2024-09-21T02:40:43.400514+0000","last_became_active":"2024-09-21T02:39:46.845162+0000","last_became_peered":"2024-09-21T02:39:46.845162+0000","last_unstale":"2024-09-21T02:40:43.400514+0000","last_undegraded":"2024-09-21T02:40:43.400514+0000","last_fullsized":"2024-09-21T02:40:43.400514+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:46.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397239+0000","last_change":"2024-09-21T02:39:43.825182+0000","last_active":"2024-09-21T02:40:43.397239+0000","last_peered":"2024-09-21T02:40:43.397239+0000","last_clean":"2024-09-21T02:40:43.397239+0000","last_became_active":"2024-09-21T02:39:43.824774+0000","last_became_peered":"2024-09-21T02:39:43.824774+0000","last_unstale":"2024-09-21T02:40:43.397239+0000","last_undegraded":"2024-09-21T02:40:43.397239+0000","last_fullsized":"2024-09-21T02:40:43.397239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:41.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413181+0000","last_change":"2024-09-21T02:39:56.935765+0000","last_active":"2024-09-21T02:40:43.413181+0000","last_peered":"2024-09-21T02:40:43.413181+0000","last_clean":"2024-09-21T02:40:43.413181+0000","last_became_active":"2024-09-21T02:39:56.933218+0000","last_became_peered":"2024-09-21T02:39:56.933218+0000","last_unstale":"2024-09-21T02:40:43.413181+0000","last_undegraded":"2024-09-21T02:40:43.413181+0000","last_fullsized":"2024-09-21T02:40:43.413181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:28.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696937+0000","last_change":"2024-09-21T02:39:46.853769+0000","last_active":"2024-09-21T02:41:44.696937+0000","last_peered":"2024-09-21T02:41:44.696937+0000","last_clean":"2024-09-21T02:41:44.696937+0000","last_became_active":"2024-09-21T02:39:46.853347+0000","last_became_peered":"2024-09-21T02:39:46.853347+0000","last_unstale":"2024-09-21T02:41:44.696937+0000","last_undegraded":"2024-09-21T02:41:44.696937+0000","last_fullsized":"2024-09-21T02:41:44.696937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:01.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.408415+0000","last_change":"2024-09-21T02:40:43.408316+0000","last_active":"2024-09-21T02:40:43.408415+0000","last_peered":"2024-09-21T02:40:43.408415+0000","last_clean":"2024-09-21T02:40:43.408415+0000","last_became_active":"2024-09-21T02:40:43.402877+0000","last_became_peered":"2024-09-21T02:40:43.402877+0000","last_unstale":"2024-09-21T02:40:43.408415+0000","last_undegraded":"2024-09-21T02:40:43.408415+0000","last_fullsized":"2024-09-21T02:40:43.408415+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.712477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487439+0000","last_change":"2024-09-21T02:39:56.928251+0000","last_active":"2024-09-21T02:41:44.487439+0000","last_peered":"2024-09-21T02:41:44.487439+0000","last_clean":"2024-09-21T02:41:44.487439+0000","last_became_active":"2024-09-21T02:39:56.927772+0000","last_became_peered":"2024-09-21T02:39:56.927772+0000","last_unstale":"2024-09-21T02:41:44.487439+0000","last_undegraded":"2024-09-21T02:41:44.487439+0000","last_fullsized":"2024-09-21T02:41:44.487439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:40.762245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.418346+0000","last_change":"2024-09-21T02:40:43.418238+0000","last_active":"2024-09-21T02:40:43.418346+0000","last_peered":"2024-09-21T02:40:43.418346+0000","last_clean":"2024-09-21T02:40:43.418346+0000","last_became_active":"2024-09-21T02:40:43.417728+0000","last_became_peered":"2024-09-21T02:40:43.417728+0000","last_unstale":"2024-09-21T02:40:43.418346+0000","last_undegraded":"2024-09-21T02:40:43.418346+0000","last_fullsized":"2024-09-21T02:40:43.418346+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:35.244275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487581+0000","last_change":"2024-09-21T02:39:43.840567+0000","last_active":"2024-09-21T02:41:44.487581+0000","last_peered":"2024-09-21T02:41:44.487581+0000","last_clean":"2024-09-21T02:41:44.487581+0000","last_became_active":"2024-09-21T02:39:43.840279+0000","last_became_peered":"2024-09-21T02:39:43.840279+0000","last_unstale":"2024-09-21T02:41:44.487581+0000","last_undegraded":"2024-09-21T02:41:44.487581+0000","last_fullsized":"2024-09-21T02:41:44.487581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:42.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399752+0000","last_change":"2024-09-21T02:39:56.920425+0000","last_active":"2024-09-21T02:40:43.399752+0000","last_peered":"2024-09-21T02:40:43.399752+0000","last_clean":"2024-09-21T02:40:43.399752+0000","last_became_active":"2024-09-21T02:39:56.919610+0000","last_became_peered":"2024-09-21T02:39:56.919610+0000","last_unstale":"2024-09-21T02:40:43.399752+0000","last_undegraded":"2024-09-21T02:40:43.399752+0000","last_fullsized":"2024-09-21T02:40:43.399752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398383+0000","last_change":"2024-09-21T02:39:46.845188+0000","last_active":"2024-09-21T02:40:43.398383+0000","last_peered":"2024-09-21T02:40:43.398383+0000","last_clean":"2024-09-21T02:40:43.398383+0000","last_became_active":"2024-09-21T02:39:46.844818+0000","last_became_peered":"2024-09-21T02:39:46.844818+0000","last_unstale":"2024-09-21T02:40:43.398383+0000","last_undegraded":"2024-09-21T02:40:43.398383+0000","last_fullsized":"2024-09-21T02:40:43.398383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.853370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:58.861993+0000","last_change":"2024-09-21T02:39:43.822226+0000","last_active":"2024-09-21T02:40:58.861993+0000","last_peered":"2024-09-21T02:40:58.861993+0000","last_clean":"2024-09-21T02:40:58.861993+0000","last_became_active":"2024-09-21T02:39:43.821798+0000","last_became_peered":"2024-09-21T02:39:43.821798+0000","last_unstale":"2024-09-21T02:40:58.861993+0000","last_undegraded":"2024-09-21T02:40:58.861993+0000","last_fullsized":"2024-09-21T02:40:58.861993+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:38.822330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.396683+0000","last_change":"2024-09-21T02:39:56.919521+0000","last_active":"2024-09-21T02:40:43.396683+0000","last_peered":"2024-09-21T02:40:43.396683+0000","last_clean":"2024-09-21T02:40:43.396683+0000","last_became_active":"2024-09-21T02:39:56.918042+0000","last_became_peered":"2024-09-21T02:39:56.918042+0000","last_unstale":"2024-09-21T02:40:43.396683+0000","last_undegraded":"2024-09-21T02:40:43.396683+0000","last_fullsized":"2024-09-21T02:40:43.396683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:21.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416234+0000","last_change":"2024-09-21T02:39:46.861856+0000","last_active":"2024-09-21T02:40:43.416234+0000","last_peered":"2024-09-21T02:40:43.416234+0000","last_clean":"2024-09-21T02:40:43.416234+0000","last_became_active":"2024-09-21T02:39:46.861416+0000","last_became_peered":"2024-09-21T02:39:46.861416+0000","last_unstale":"2024-09-21T02:40:43.416234+0000","last_undegraded":"2024-09-21T02:40:43.416234+0000","last_fullsized":"2024-09-21T02:40:43.416234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:46.547988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697454+0000","last_change":"2024-09-21T02:39:43.826232+0000","last_active":"2024-09-21T02:41:44.697454+0000","last_peered":"2024-09-21T02:41:44.697454+0000","last_clean":"2024-09-21T02:41:44.697454+0000","last_became_active":"2024-09-21T02:39:43.825789+0000","last_became_peered":"2024-09-21T02:39:43.825789+0000","last_unstale":"2024-09-21T02:41:44.697454+0000","last_undegraded":"2024-09-21T02:41:44.697454+0000","last_fullsized":"2024-09-21T02:41:44.697454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:19.465106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398765+0000","last_change":"2024-09-21T02:39:56.917802+0000","last_active":"2024-09-21T02:40:43.398765+0000","last_peered":"2024-09-21T02:40:43.398765+0000","last_clean":"2024-09-21T02:40:43.398765+0000","last_became_active":"2024-09-21T02:39:56.917286+0000","last_became_peered":"2024-09-21T02:39:56.917286+0000","last_unstale":"2024-09-21T02:40:43.398765+0000","last_undegraded":"2024-09-21T02:40:43.398765+0000","last_fullsized":"2024-09-21T02:40:43.398765+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:19.055218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411876+0000","last_change":"2024-09-21T02:39:46.858829+0000","last_active":"2024-09-21T02:40:43.411876+0000","last_peered":"2024-09-21T02:40:43.411876+0000","last_clean":"2024-09-21T02:40:43.411876+0000","last_became_active":"2024-09-21T02:39:46.858392+0000","last_became_peered":"2024-09-21T02:39:46.858392+0000","last_unstale":"2024-09-21T02:40:43.411876+0000","last_undegraded":"2024-09-21T02:40:43.411876+0000","last_fullsized":"2024-09-21T02:40:43.411876+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:29.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412401+0000","last_change":"2024-09-21T02:39:43.825129+0000","last_active":"2024-09-21T02:40:43.412401+0000","last_peered":"2024-09-21T02:40:43.412401+0000","last_clean":"2024-09-21T02:40:43.412401+0000","last_became_active":"2024-09-21T02:39:43.824756+0000","last_became_peered":"2024-09-21T02:39:43.824756+0000","last_unstale":"2024-09-21T02:40:43.412401+0000","last_undegraded":"2024-09-21T02:40:43.412401+0000","last_fullsized":"2024-09-21T02:40:43.412401+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:28.771033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696627+0000","last_change":"2024-09-21T02:39:56.929186+0000","last_active":"2024-09-21T02:41:44.696627+0000","last_peered":"2024-09-21T02:41:44.696627+0000","last_clean":"2024-09-21T02:41:44.696627+0000","last_became_active":"2024-09-21T02:39:56.928608+0000","last_became_peered":"2024-09-21T02:39:56.928608+0000","last_unstale":"2024-09-21T02:41:44.696627+0000","last_undegraded":"2024-09-21T02:41:44.696627+0000","last_fullsized":"2024-09-21T02:41:44.696627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:47.860230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412131+0000","last_change":"2024-09-21T02:39:46.860375+0000","last_active":"2024-09-21T02:40:43.412131+0000","last_peered":"2024-09-21T02:40:43.412131+0000","last_clean":"2024-09-21T02:40:43.412131+0000","last_became_active":"2024-09-21T02:39:46.860035+0000","last_became_peered":"2024-09-21T02:39:46.860035+0000","last_unstale":"2024-09-21T02:40:43.412131+0000","last_undegraded":"2024-09-21T02:40:43.412131+0000","last_fullsized":"2024-09-21T02:40:43.412131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:07.761203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402127+0000","last_change":"2024-09-21T02:39:43.827869+0000","last_active":"2024-09-21T02:40:43.402127+0000","last_peered":"2024-09-21T02:40:43.402127+0000","last_clean":"2024-09-21T02:40:43.402127+0000","last_became_active":"2024-09-21T02:39:43.827375+0000","last_became_peered":"2024-09-21T02:39:43.827375+0000","last_unstale":"2024-09-21T02:40:43.402127+0000","last_undegraded":"2024-09-21T02:40:43.402127+0000","last_fullsized":"2024-09-21T02:40:43.402127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:48.257387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416024+0000","last_change":"2024-09-21T02:39:56.917766+0000","last_active":"2024-09-21T02:40:43.416024+0000","last_peered":"2024-09-21T02:40:43.416024+0000","last_clean":"2024-09-21T02:40:43.416024+0000","last_became_active":"2024-09-21T02:39:56.917309+0000","last_became_peered":"2024-09-21T02:39:56.917309+0000","last_unstale":"2024-09-21T02:40:43.416024+0000","last_undegraded":"2024-09-21T02:40:43.416024+0000","last_fullsized":"2024-09-21T02:40:43.416024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:36.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395127+0000","last_change":"2024-09-21T02:39:46.851416+0000","last_active":"2024-09-21T02:40:43.395127+0000","last_peered":"2024-09-21T02:40:43.395127+0000","last_clean":"2024-09-21T02:40:43.395127+0000","last_became_active":"2024-09-21T02:39:46.851055+0000","last_became_peered":"2024-09-21T02:39:46.851055+0000","last_unstale":"2024-09-21T02:40:43.395127+0000","last_undegraded":"2024-09-21T02:40:43.395127+0000","last_fullsized":"2024-09-21T02:40:43.395127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:50.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":104,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:41:39.500858+0000","last_change":"2024-09-21T02:39:43.825162+0000","last_active":"2024-09-21T02:41:39.500858+0000","last_peered":"2024-09-21T02:41:39.500858+0000","last_clean":"2024-09-21T02:41:39.500858+0000","last_became_active":"2024-09-21T02:39:43.824811+0000","last_became_peered":"2024-09-21T02:39:43.824811+0000","last_unstale":"2024-09-21T02:41:39.500858+0000","last_undegraded":"2024-09-21T02:41:39.500858+0000","last_fullsized":"2024-09-21T02:41:39.500858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:10.020902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417125+0000","last_change":"2024-09-21T02:39:56.920750+0000","last_active":"2024-09-21T02:40:43.417125+0000","last_peered":"2024-09-21T02:40:43.417125+0000","last_clean":"2024-09-21T02:40:43.417125+0000","last_became_active":"2024-09-21T02:39:56.920245+0000","last_became_peered":"2024-09-21T02:39:56.920245+0000","last_unstale":"2024-09-21T02:40:43.417125+0000","last_undegraded":"2024-09-21T02:40:43.417125+0000","last_fullsized":"2024-09-21T02:40:43.417125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:53.718596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416626+0000","last_change":"2024-09-21T02:39:46.854202+0000","last_active":"2024-09-21T02:40:43.416626+0000","last_peered":"2024-09-21T02:40:43.416626+0000","last_clean":"2024-09-21T02:40:43.416626+0000","last_became_active":"2024-09-21T02:39:46.853076+0000","last_became_peered":"2024-09-21T02:39:46.853076+0000","last_unstale":"2024-09-21T02:40:43.416626+0000","last_undegraded":"2024-09-21T02:40:43.416626+0000","last_fullsized":"2024-09-21T02:40:43.416626+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:59.729777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401523+0000","last_change":"2024-09-21T02:39:43.826351+0000","last_active":"2024-09-21T02:40:43.401523+0000","last_peered":"2024-09-21T02:40:43.401523+0000","last_clean":"2024-09-21T02:40:43.401523+0000","last_became_active":"2024-09-21T02:39:43.825683+0000","last_became_peered":"2024-09-21T02:39:43.825683+0000","last_unstale":"2024-09-21T02:40:43.401523+0000","last_undegraded":"2024-09-21T02:40:43.401523+0000","last_fullsized":"2024-09-21T02:40:43.401523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:16.934280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395931+0000","last_change":"2024-09-21T02:39:56.937591+0000","last_active":"2024-09-21T02:40:43.395931+0000","last_peered":"2024-09-21T02:40:43.395931+0000","last_clean":"2024-09-21T02:40:43.395931+0000","last_became_active":"2024-09-21T02:39:56.937178+0000","last_became_peered":"2024-09-21T02:39:56.937178+0000","last_unstale":"2024-09-21T02:40:43.395931+0000","last_undegraded":"2024-09-21T02:40:43.395931+0000","last_fullsized":"2024-09-21T02:40:43.395931+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:21.218393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397507+0000","last_change":"2024-09-21T02:39:46.858255+0000","last_active":"2024-09-21T02:40:43.397507+0000","last_peered":"2024-09-21T02:40:43.397507+0000","last_clean":"2024-09-21T02:40:43.397507+0000","last_became_active":"2024-09-21T02:39:46.856726+0000","last_became_peered":"2024-09-21T02:39:46.856726+0000","last_unstale":"2024-09-21T02:40:43.397507+0000","last_undegraded":"2024-09-21T02:40:43.397507+0000","last_fullsized":"2024-09-21T02:40:43.397507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:33.890538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487741+0000","last_change":"2024-09-21T02:39:43.823562+0000","last_active":"2024-09-21T02:41:44.487741+0000","last_peered":"2024-09-21T02:41:44.487741+0000","last_clean":"2024-09-21T02:41:44.487741+0000","last_became_active":"2024-09-21T02:39:43.823142+0000","last_became_peered":"2024-09-21T02:39:43.823142+0000","last_unstale":"2024-09-21T02:41:44.487741+0000","last_undegraded":"2024-09-21T02:41:44.487741+0000","last_fullsized":"2024-09-21T02:41:44.487741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:36.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401814+0000","last_change":"2024-09-21T02:38:27.972237+0000","last_active":"2024-09-21T02:40:43.401814+0000","last_peered":"2024-09-21T02:40:43.401814+0000","last_clean":"2024-09-21T02:40:43.401814+0000","last_became_active":"2024-09-21T02:38:27.966297+0000","last_became_peered":"2024-09-21T02:38:27.966297+0000","last_unstale":"2024-09-21T02:40:43.401814+0000","last_undegraded":"2024-09-21T02:40:43.401814+0000","last_fullsized":"2024-09-21T02:40:43.401814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_clean_scrub_stamp":"2024-09-21T02:34:42.292034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:24.592682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402820+0000","last_change":"2024-09-21T02:39:56.930418+0000","last_active":"2024-09-21T02:40:43.402820+0000","last_peered":"2024-09-21T02:40:43.402820+0000","last_clean":"2024-09-21T02:40:43.402820+0000","last_became_active":"2024-09-21T02:39:56.929920+0000","last_became_peered":"2024-09-21T02:39:56.929920+0000","last_unstale":"2024-09-21T02:40:43.402820+0000","last_undegraded":"2024-09-21T02:40:43.402820+0000","last_fullsized":"2024-09-21T02:40:43.402820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:15.195020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403073+0000","last_change":"2024-09-21T02:39:46.851466+0000","last_active":"2024-09-21T02:40:43.403073+0000","last_peered":"2024-09-21T02:40:43.403073+0000","last_clean":"2024-09-21T02:40:43.403073+0000","last_became_active":"2024-09-21T02:39:46.849945+0000","last_became_peered":"2024-09-21T02:39:46.849945+0000","last_unstale":"2024-09-21T02:40:43.403073+0000","last_undegraded":"2024-09-21T02:40:43.403073+0000","last_fullsized":"2024-09-21T02:40:43.403073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:07.424794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398775+0000","last_change":"2024-09-21T02:39:43.840894+0000","last_active":"2024-09-21T02:40:43.398775+0000","last_peered":"2024-09-21T02:40:43.398775+0000","last_clean":"2024-09-21T02:40:43.398775+0000","last_became_active":"2024-09-21T02:39:43.840437+0000","last_became_peered":"2024-09-21T02:39:43.840437+0000","last_unstale":"2024-09-21T02:40:43.398775+0000","last_undegraded":"2024-09-21T02:40:43.398775+0000","last_fullsized":"2024-09-21T02:40:43.398775+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:31.741218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395084+0000","last_change":"2024-09-21T02:39:56.924563+0000","last_active":"2024-09-21T02:40:43.395084+0000","last_peered":"2024-09-21T02:40:43.395084+0000","last_clean":"2024-09-21T02:40:43.395084+0000","last_became_active":"2024-09-21T02:39:56.923791+0000","last_became_peered":"2024-09-21T02:39:56.923791+0000","last_unstale":"2024-09-21T02:40:43.395084+0000","last_undegraded":"2024-09-21T02:40:43.395084+0000","last_fullsized":"2024-09-21T02:40:43.395084+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:03.409737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402629+0000","last_change":"2024-09-21T02:39:46.858712+0000","last_active":"2024-09-21T02:40:43.402629+0000","last_peered":"2024-09-21T02:40:43.402629+0000","last_clean":"2024-09-21T02:40:43.402629+0000","last_became_active":"2024-09-21T02:39:46.858339+0000","last_became_peered":"2024-09-21T02:39:46.858339+0000","last_unstale":"2024-09-21T02:40:43.402629+0000","last_undegraded":"2024-09-21T02:40:43.402629+0000","last_fullsized":"2024-09-21T02:40:43.402629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.015904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395766+0000","last_change":"2024-09-21T02:39:43.829127+0000","last_active":"2024-09-21T02:40:43.395766+0000","last_peered":"2024-09-21T02:40:43.395766+0000","last_clean":"2024-09-21T02:40:43.395766+0000","last_became_active":"2024-09-21T02:39:43.828136+0000","last_became_peered":"2024-09-21T02:39:43.828136+0000","last_unstale":"2024-09-21T02:40:43.395766+0000","last_undegraded":"2024-09-21T02:40:43.395766+0000","last_fullsized":"2024-09-21T02:40:43.395766+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:39.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399781+0000","last_change":"2024-09-21T02:39:56.930823+0000","last_active":"2024-09-21T02:40:43.399781+0000","last_peered":"2024-09-21T02:40:43.399781+0000","last_clean":"2024-09-21T02:40:43.399781+0000","last_became_active":"2024-09-21T02:39:56.930379+0000","last_became_peered":"2024-09-21T02:39:56.930379+0000","last_unstale":"2024-09-21T02:40:43.399781+0000","last_undegraded":"2024-09-21T02:40:43.399781+0000","last_fullsized":"2024-09-21T02:40:43.399781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:01.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402678+0000","last_change":"2024-09-21T02:39:46.846873+0000","last_active":"2024-09-21T02:40:43.402678+0000","last_peered":"2024-09-21T02:40:43.402678+0000","last_clean":"2024-09-21T02:40:43.402678+0000","last_became_active":"2024-09-21T02:39:46.846502+0000","last_became_peered":"2024-09-21T02:39:46.846502+0000","last_unstale":"2024-09-21T02:40:43.402678+0000","last_undegraded":"2024-09-21T02:40:43.402678+0000","last_fullsized":"2024-09-21T02:40:43.402678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:20.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417234+0000","last_change":"2024-09-21T02:39:43.832273+0000","last_active":"2024-09-21T02:40:43.417234+0000","last_peered":"2024-09-21T02:40:43.417234+0000","last_clean":"2024-09-21T02:40:43.417234+0000","last_became_active":"2024-09-21T02:39:43.831705+0000","last_became_peered":"2024-09-21T02:39:43.831705+0000","last_unstale":"2024-09-21T02:40:43.417234+0000","last_undegraded":"2024-09-21T02:40:43.417234+0000","last_fullsized":"2024-09-21T02:40:43.417234+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:31.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395009+0000","last_change":"2024-09-21T02:39:56.920277+0000","last_active":"2024-09-21T02:40:43.395009+0000","last_peered":"2024-09-21T02:40:43.395009+0000","last_clean":"2024-09-21T02:40:43.395009+0000","last_became_active":"2024-09-21T02:39:56.919885+0000","last_became_peered":"2024-09-21T02:39:56.919885+0000","last_unstale":"2024-09-21T02:40:43.395009+0000","last_undegraded":"2024-09-21T02:40:43.395009+0000","last_fullsized":"2024-09-21T02:40:43.395009+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:32.750878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413604+0000","last_change":"2024-09-21T02:40:43.413459+0000","last_active":"2024-09-21T02:40:43.413604+0000","last_peered":"2024-09-21T02:40:43.413604+0000","last_clean":"2024-09-21T02:40:43.413604+0000","last_became_active":"2024-09-21T02:40:43.413012+0000","last_became_peered":"2024-09-21T02:40:43.413012+0000","last_unstale":"2024-09-21T02:40:43.413604+0000","last_undegraded":"2024-09-21T02:40:43.413604+0000","last_fullsized":"2024-09-21T02:40:43.413604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:23.971450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697424+0000","last_change":"2024-09-21T02:39:43.821955+0000","last_active":"2024-09-21T02:41:44.697424+0000","last_peered":"2024-09-21T02:41:44.697424+0000","last_clean":"2024-09-21T02:41:44.697424+0000","last_became_active":"2024-09-21T02:39:43.820480+0000","last_became_peered":"2024-09-21T02:39:43.820480+0000","last_unstale":"2024-09-21T02:41:44.697424+0000","last_undegraded":"2024-09-21T02:41:44.697424+0000","last_fullsized":"2024-09-21T02:41:44.697424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:51.201528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394840+0000","last_change":"2024-09-21T02:39:56.922017+0000","last_active":"2024-09-21T02:40:43.394840+0000","last_peered":"2024-09-21T02:40:43.394840+0000","last_clean":"2024-09-21T02:40:43.394840+0000","last_became_active":"2024-09-21T02:39:56.921616+0000","last_became_peered":"2024-09-21T02:39:56.921616+0000","last_unstale":"2024-09-21T02:40:43.394840+0000","last_undegraded":"2024-09-21T02:40:43.394840+0000","last_fullsized":"2024-09-21T02:40:43.394840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:38.499302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395072+0000","last_change":"2024-09-21T02:39:46.855445+0000","last_active":"2024-09-21T02:40:43.395072+0000","last_peered":"2024-09-21T02:40:43.395072+0000","last_clean":"2024-09-21T02:40:43.395072+0000","last_became_active":"2024-09-21T02:39:46.855053+0000","last_became_peered":"2024-09-21T02:39:46.855053+0000","last_unstale":"2024-09-21T02:40:43.395072+0000","last_undegraded":"2024-09-21T02:40:43.395072+0000","last_fullsized":"2024-09-21T02:40:43.395072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:19.122862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696560+0000","last_change":"2024-09-21T02:39:43.822744+0000","last_active":"2024-09-21T02:41:44.696560+0000","last_peered":"2024-09-21T02:41:44.696560+0000","last_clean":"2024-09-21T02:41:44.696560+0000","last_became_active":"2024-09-21T02:39:43.822339+0000","last_became_peered":"2024-09-21T02:39:43.822339+0000","last_unstale":"2024-09-21T02:41:44.696560+0000","last_undegraded":"2024-09-21T02:41:44.696560+0000","last_fullsized":"2024-09-21T02:41:44.696560+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:21.370224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417172+0000","last_change":"2024-09-21T02:39:56.929280+0000","last_active":"2024-09-21T02:40:43.417172+0000","last_peered":"2024-09-21T02:40:43.417172+0000","last_clean":"2024-09-21T02:40:43.417172+0000","last_became_active":"2024-09-21T02:39:56.928826+0000","last_became_peered":"2024-09-21T02:39:56.928826+0000","last_unstale":"2024-09-21T02:40:43.417172+0000","last_undegraded":"2024-09-21T02:40:43.417172+0000","last_fullsized":"2024-09-21T02:40:43.417172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:01.597772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401350+0000","last_change":"2024-09-21T02:39:46.852466+0000","last_active":"2024-09-21T02:40:43.401350+0000","last_peered":"2024-09-21T02:40:43.401350+0000","last_clean":"2024-09-21T02:40:43.401350+0000","last_became_active":"2024-09-21T02:39:46.852113+0000","last_became_peered":"2024-09-21T02:39:46.852113+0000","last_unstale":"2024-09-21T02:40:43.401350+0000","last_undegraded":"2024-09-21T02:40:43.401350+0000","last_fullsized":"2024-09-21T02:40:43.401350+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:26.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'4","reported_seq":115,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.511038+0000","last_change":"2024-09-21T02:39:43.822241+0000","last_active":"2024-09-21T02:41:44.511038+0000","last_peered":"2024-09-21T02:41:44.511038+0000","last_clean":"2024-09-21T02:41:44.511038+0000","last_became_active":"2024-09-21T02:39:43.820813+0000","last_became_peered":"2024-09-21T02:39:43.820813+0000","last_unstale":"2024-09-21T02:41:44.511038+0000","last_undegraded":"2024-09-21T02:41:44.511038+0000","last_fullsized":"2024-09-21T02:41:44.511038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:09.749207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697239+0000","last_change":"2024-09-21T02:40:43.405942+0000","last_active":"2024-09-21T02:41:44.697239+0000","last_peered":"2024-09-21T02:41:44.697239+0000","last_clean":"2024-09-21T02:41:44.697239+0000","last_became_active":"2024-09-21T02:40:43.405455+0000","last_became_peered":"2024-09-21T02:40:43.405455+0000","last_unstale":"2024-09-21T02:41:44.697239+0000","last_undegraded":"2024-09-21T02:41:44.697239+0000","last_fullsized":"2024-09-21T02:41:44.697239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:28.594724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417584+0000","last_change":"2024-09-21T02:40:43.417498+0000","last_active":"2024-09-21T02:40:43.417584+0000","last_peered":"2024-09-21T02:40:43.417584+0000","last_clean":"2024-09-21T02:40:43.417584+0000","last_became_active":"2024-09-21T02:40:43.417203+0000","last_became_peered":"2024-09-21T02:40:43.417203+0000","last_unstale":"2024-09-21T02:40:43.417584+0000","last_undegraded":"2024-09-21T02:40:43.417584+0000","last_fullsized":"2024-09-21T02:40:43.417584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:43.618931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395287+0000","last_change":"2024-09-21T02:39:43.827493+0000","last_active":"2024-09-21T02:40:43.395287+0000","last_peered":"2024-09-21T02:40:43.395287+0000","last_clean":"2024-09-21T02:40:43.395287+0000","last_became_active":"2024-09-21T02:39:43.826824+0000","last_became_peered":"2024-09-21T02:39:43.826824+0000","last_unstale":"2024-09-21T02:40:43.395287+0000","last_undegraded":"2024-09-21T02:40:43.395287+0000","last_fullsized":"2024-09-21T02:40:43.395287+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:21.320101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399019+0000","last_change":"2024-09-21T02:39:56.929122+0000","last_active":"2024-09-21T02:40:43.399019+0000","last_peered":"2024-09-21T02:40:43.399019+0000","last_clean":"2024-09-21T02:40:43.399019+0000","last_became_active":"2024-09-21T02:39:56.928633+0000","last_became_peered":"2024-09-21T02:39:56.928633+0000","last_unstale":"2024-09-21T02:40:43.399019+0000","last_undegraded":"2024-09-21T02:40:43.399019+0000","last_fullsized":"2024-09-21T02:40:43.399019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:56.599982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.415668+0000","last_change":"2024-09-21T02:39:46.866922+0000","last_active":"2024-09-21T02:40:43.415668+0000","last_peered":"2024-09-21T02:40:43.415668+0000","last_clean":"2024-09-21T02:40:43.415668+0000","last_became_active":"2024-09-21T02:39:46.866061+0000","last_became_peered":"2024-09-21T02:39:46.866061+0000","last_unstale":"2024-09-21T02:40:43.415668+0000","last_undegraded":"2024-09-21T02:40:43.415668+0000","last_fullsized":"2024-09-21T02:40:43.415668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:02.707212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398542+0000","last_change":"2024-09-21T02:39:43.824188+0000","last_active":"2024-09-21T02:40:43.398542+0000","last_peered":"2024-09-21T02:40:43.398542+0000","last_clean":"2024-09-21T02:40:43.398542+0000","last_became_active":"2024-09-21T02:39:43.823760+0000","last_became_peered":"2024-09-21T02:39:43.823760+0000","last_unstale":"2024-09-21T02:40:43.398542+0000","last_undegraded":"2024-09-21T02:40:43.398542+0000","last_fullsized":"2024-09-21T02:40:43.398542+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:56.770947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395538+0000","last_change":"2024-09-21T02:39:56.920213+0000","last_active":"2024-09-21T02:40:43.395538+0000","last_peered":"2024-09-21T02:40:43.395538+0000","last_clean":"2024-09-21T02:40:43.395538+0000","last_became_active":"2024-09-21T02:39:56.919796+0000","last_became_peered":"2024-09-21T02:39:56.919796+0000","last_unstale":"2024-09-21T02:40:43.395538+0000","last_undegraded":"2024-09-21T02:40:43.395538+0000","last_fullsized":"2024-09-21T02:40:43.395538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:32.162844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697265+0000","last_change":"2024-09-21T02:39:46.846759+0000","last_active":"2024-09-21T02:41:44.697265+0000","last_peered":"2024-09-21T02:41:44.697265+0000","last_clean":"2024-09-21T02:41:44.697265+0000","last_became_active":"2024-09-21T02:39:46.846315+0000","last_became_peered":"2024-09-21T02:39:46.846315+0000","last_unstale":"2024-09-21T02:41:44.697265+0000","last_undegraded":"2024-09-21T02:41:44.697265+0000","last_fullsized":"2024-09-21T02:41:44.697265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:41.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'32","reported_seq":197,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:41:40.509677+0000","last_change":"2024-09-21T02:39:43.824564+0000","last_active":"2024-09-21T02:41:40.509677+0000","last_peered":"2024-09-21T02:41:40.509677+0000","last_clean":"2024-09-21T02:41:40.509677+0000","last_became_active":"2024-09-21T02:39:43.824190+0000","last_became_peered":"2024-09-21T02:39:43.824190+0000","last_unstale":"2024-09-21T02:41:40.509677+0000","last_undegraded":"2024-09-21T02:41:40.509677+0000","last_fullsized":"2024-09-21T02:41:40.509677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:45.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67138,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":127,"num_write":33,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412220+0000","last_change":"2024-09-21T02:39:56.928936+0000","last_active":"2024-09-21T02:40:43.412220+0000","last_peered":"2024-09-21T02:40:43.412220+0000","last_clean":"2024-09-21T02:40:43.412220+0000","last_became_active":"2024-09-21T02:39:56.927999+0000","last_became_peered":"2024-09-21T02:39:56.927999+0000","last_unstale":"2024-09-21T02:40:43.412220+0000","last_undegraded":"2024-09-21T02:40:43.412220+0000","last_fullsized":"2024-09-21T02:40:43.412220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:33.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395641+0000","last_change":"2024-09-21T02:39:46.860572+0000","last_active":"2024-09-21T02:40:43.395641+0000","last_peered":"2024-09-21T02:40:43.395641+0000","last_clean":"2024-09-21T02:40:43.395641+0000","last_became_active":"2024-09-21T02:39:46.860073+0000","last_became_peered":"2024-09-21T02:39:46.860073+0000","last_unstale":"2024-09-21T02:40:43.395641+0000","last_undegraded":"2024-09-21T02:40:43.395641+0000","last_fullsized":"2024-09-21T02:40:43.395641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:48.355107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395704+0000","last_change":"2024-09-21T02:39:43.828437+0000","last_active":"2024-09-21T02:40:43.395704+0000","last_peered":"2024-09-21T02:40:43.395704+0000","last_clean":"2024-09-21T02:40:43.395704+0000","last_became_active":"2024-09-21T02:39:43.828033+0000","last_became_peered":"2024-09-21T02:39:43.828033+0000","last_unstale":"2024-09-21T02:40:43.395704+0000","last_undegraded":"2024-09-21T02:40:43.395704+0000","last_fullsized":"2024-09-21T02:40:43.395704+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:24.065773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487293+0000","last_change":"2024-09-21T02:39:56.937714+0000","last_active":"2024-09-21T02:41:44.487293+0000","last_peered":"2024-09-21T02:41:44.487293+0000","last_clean":"2024-09-21T02:41:44.487293+0000","last_became_active":"2024-09-21T02:39:56.937145+0000","last_became_peered":"2024-09-21T02:39:56.937145+0000","last_unstale":"2024-09-21T02:41:44.487293+0000","last_undegraded":"2024-09-21T02:41:44.487293+0000","last_fullsized":"2024-09-21T02:41:44.487293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:59.265795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400347+0000","last_change":"2024-09-21T02:39:46.864600+0000","last_active":"2024-09-21T02:40:43.400347+0000","last_peered":"2024-09-21T02:40:43.400347+0000","last_clean":"2024-09-21T02:40:43.400347+0000","last_became_active":"2024-09-21T02:39:46.862043+0000","last_became_peered":"2024-09-21T02:39:46.862043+0000","last_unstale":"2024-09-21T02:40:43.400347+0000","last_undegraded":"2024-09-21T02:40:43.400347+0000","last_fullsized":"2024-09-21T02:40:43.400347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.119974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402322+0000","last_change":"2024-09-21T02:39:43.825910+0000","last_active":"2024-09-21T02:40:43.402322+0000","last_peered":"2024-09-21T02:40:43.402322+0000","last_clean":"2024-09-21T02:40:43.402322+0000","last_became_active":"2024-09-21T02:39:43.825370+0000","last_became_peered":"2024-09-21T02:39:43.825370+0000","last_unstale":"2024-09-21T02:40:43.402322+0000","last_undegraded":"2024-09-21T02:40:43.402322+0000","last_fullsized":"2024-09-21T02:40:43.402322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:05.410114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411733+0000","last_change":"2024-09-21T02:39:56.935321+0000","last_active":"2024-09-21T02:40:43.411733+0000","last_peered":"2024-09-21T02:40:43.411733+0000","last_clean":"2024-09-21T02:40:43.411733+0000","last_became_active":"2024-09-21T02:39:56.931669+0000","last_became_peered":"2024-09-21T02:39:56.931669+0000","last_unstale":"2024-09-21T02:40:43.411733+0000","last_undegraded":"2024-09-21T02:40:43.411733+0000","last_fullsized":"2024-09-21T02:40:43.411733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:20.323574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395730+0000","last_change":"2024-09-21T02:39:46.853469+0000","last_active":"2024-09-21T02:40:43.395730+0000","last_peered":"2024-09-21T02:40:43.395730+0000","last_clean":"2024-09-21T02:40:43.395730+0000","last_became_active":"2024-09-21T02:39:46.853133+0000","last_became_peered":"2024-09-21T02:39:46.853133+0000","last_unstale":"2024-09-21T02:40:43.395730+0000","last_undegraded":"2024-09-21T02:40:43.395730+0000","last_fullsized":"2024-09-21T02:40:43.395730+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.055341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":103,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:41:39.501367+0000","last_change":"2024-09-21T02:39:43.828678+0000","last_active":"2024-09-21T02:41:39.501367+0000","last_peered":"2024-09-21T02:41:39.501367+0000","last_clean":"2024-09-21T02:41:39.501367+0000","last_became_active":"2024-09-21T02:39:43.828281+0000","last_became_peered":"2024-09-21T02:39:43.828281+0000","last_unstale":"2024-09-21T02:41:39.501367+0000","last_undegraded":"2024-09-21T02:41:39.501367+0000","last_fullsized":"2024-09-21T02:41:39.501367+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:42.678028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":59,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397054+0000","last_change":"2024-09-21T02:39:56.920489+0000","last_active":"2024-09-21T02:40:43.397054+0000","last_peered":"2024-09-21T02:40:43.397054+0000","last_clean":"2024-09-21T02:40:43.397054+0000","last_became_active":"2024-09-21T02:39:56.920031+0000","last_became_peered":"2024-09-21T02:39:56.920031+0000","last_unstale":"2024-09-21T02:40:43.397054+0000","last_undegraded":"2024-09-21T02:40:43.397054+0000","last_fullsized":"2024-09-21T02:40:43.397054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:56.576113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399754+0000","last_change":"2024-09-21T02:39:56.922470+0000","last_active":"2024-09-21T02:40:43.399754+0000","last_peered":"2024-09-21T02:40:43.399754+0000","last_clean":"2024-09-21T02:40:43.399754+0000","last_became_active":"2024-09-21T02:39:56.922014+0000","last_became_peered":"2024-09-21T02:39:56.922014+0000","last_unstale":"2024-09-21T02:40:43.399754+0000","last_undegraded":"2024-09-21T02:40:43.399754+0000","last_fullsized":"2024-09-21T02:40:43.399754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:25.307835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412133+0000","last_change":"2024-09-21T02:39:46.852869+0000","last_active":"2024-09-21T02:40:43.412133+0000","last_peered":"2024-09-21T02:40:43.412133+0000","last_clean":"2024-09-21T02:40:43.412133+0000","last_became_active":"2024-09-21T02:39:46.852237+0000","last_became_peered":"2024-09-21T02:39:46.852237+0000","last_unstale":"2024-09-21T02:40:43.412133+0000","last_undegraded":"2024-09-21T02:40:43.412133+0000","last_fullsized":"2024-09-21T02:40:43.412133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:10.729381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395550+0000","last_change":"2024-09-21T02:39:43.827358+0000","last_active":"2024-09-21T02:40:43.395550+0000","last_peered":"2024-09-21T02:40:43.395550+0000","last_clean":"2024-09-21T02:40:43.395550+0000","last_became_active":"2024-09-21T02:39:43.826910+0000","last_became_peered":"2024-09-21T02:39:43.826910+0000","last_unstale":"2024-09-21T02:40:43.395550+0000","last_undegraded":"2024-09-21T02:40:43.395550+0000","last_fullsized":"2024-09-21T02:40:43.395550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:48.528314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398573+0000","last_change":"2024-09-21T02:39:56.930809+0000","last_active":"2024-09-21T02:40:43.398573+0000","last_peered":"2024-09-21T02:40:43.398573+0000","last_clean":"2024-09-21T02:40:43.398573+0000","last_became_active":"2024-09-21T02:39:56.930355+0000","last_became_peered":"2024-09-21T02:39:56.930355+0000","last_unstale":"2024-09-21T02:40:43.398573+0000","last_undegraded":"2024-09-21T02:40:43.398573+0000","last_fullsized":"2024-09-21T02:40:43.398573+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:41.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397031+0000","last_change":"2024-09-21T02:39:46.856046+0000","last_active":"2024-09-21T02:40:43.397031+0000","last_peered":"2024-09-21T02:40:43.397031+0000","last_clean":"2024-09-21T02:40:43.397031+0000","last_became_active":"2024-09-21T02:39:46.855675+0000","last_became_peered":"2024-09-21T02:39:46.855675+0000","last_unstale":"2024-09-21T02:40:43.397031+0000","last_undegraded":"2024-09-21T02:40:43.397031+0000","last_fullsized":"2024-09-21T02:40:43.397031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.547082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416633+0000","last_change":"2024-09-21T02:39:43.828888+0000","last_active":"2024-09-21T02:40:43.416633+0000","last_peered":"2024-09-21T02:40:43.416633+0000","last_clean":"2024-09-21T02:40:43.416633+0000","last_became_active":"2024-09-21T02:39:43.828340+0000","last_became_peered":"2024-09-21T02:39:43.828340+0000","last_unstale":"2024-09-21T02:40:43.416633+0000","last_undegraded":"2024-09-21T02:40:43.416633+0000","last_fullsized":"2024-09-21T02:40:43.416633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:09.017191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412206+0000","last_change":"2024-09-21T02:39:43.828957+0000","last_active":"2024-09-21T02:40:43.412206+0000","last_peered":"2024-09-21T02:40:43.412206+0000","last_clean":"2024-09-21T02:40:43.412206+0000","last_became_active":"2024-09-21T02:39:43.827899+0000","last_became_peered":"2024-09-21T02:39:43.827899+0000","last_unstale":"2024-09-21T02:40:43.412206+0000","last_undegraded":"2024-09-21T02:40:43.412206+0000","last_fullsized":"2024-09-21T02:40:43.412206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:36.727082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395361+0000","last_change":"2024-09-21T02:39:46.855278+0000","last_active":"2024-09-21T02:40:43.395361+0000","last_peered":"2024-09-21T02:40:43.395361+0000","last_clean":"2024-09-21T02:40:43.395361+0000","last_became_active":"2024-09-21T02:39:46.854905+0000","last_became_peered":"2024-09-21T02:39:46.854905+0000","last_unstale":"2024-09-21T02:40:43.395361+0000","last_undegraded":"2024-09-21T02:40:43.395361+0000","last_fullsized":"2024-09-21T02:40:43.395361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.244912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398327+0000","last_change":"2024-09-21T02:39:56.931183+0000","last_active":"2024-09-21T02:40:43.398327+0000","last_peered":"2024-09-21T02:40:43.398327+0000","last_clean":"2024-09-21T02:40:43.398327+0000","last_became_active":"2024-09-21T02:39:56.930776+0000","last_became_peered":"2024-09-21T02:39:56.930776+0000","last_unstale":"2024-09-21T02:40:43.398327+0000","last_undegraded":"2024-09-21T02:40:43.398327+0000","last_fullsized":"2024-09-21T02:40:43.398327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:56.272272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:41:39.502064+0000","last_change":"2024-09-21T02:39:43.823668+0000","last_active":"2024-09-21T02:41:39.502064+0000","last_peered":"2024-09-21T02:41:39.502064+0000","last_clean":"2024-09-21T02:41:39.502064+0000","last_became_active":"2024-09-21T02:39:43.823132+0000","last_became_peered":"2024-09-21T02:39:43.823132+0000","last_unstale":"2024-09-21T02:41:39.502064+0000","last_undegraded":"2024-09-21T02:41:39.502064+0000","last_fullsized":"2024-09-21T02:41:39.502064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:33.187554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696735+0000","last_change":"2024-09-21T02:39:46.845740+0000","last_active":"2024-09-21T02:41:44.696735+0000","last_peered":"2024-09-21T02:41:44.696735+0000","last_clean":"2024-09-21T02:41:44.696735+0000","last_became_active":"2024-09-21T02:39:46.845361+0000","last_became_peered":"2024-09-21T02:39:46.845361+0000","last_unstale":"2024-09-21T02:41:44.696735+0000","last_undegraded":"2024-09-21T02:41:44.696735+0000","last_fullsized":"2024-09-21T02:41:44.696735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.546769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399488+0000","last_change":"2024-09-21T02:39:56.919760+0000","last_active":"2024-09-21T02:40:43.399488+0000","last_peered":"2024-09-21T02:40:43.399488+0000","last_clean":"2024-09-21T02:40:43.399488+0000","last_became_active":"2024-09-21T02:39:56.919315+0000","last_became_peered":"2024-09-21T02:39:56.919315+0000","last_unstale":"2024-09-21T02:40:43.399488+0000","last_undegraded":"2024-09-21T02:40:43.399488+0000","last_fullsized":"2024-09-21T02:40:43.399488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:52.889707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400397+0000","last_change":"2024-09-21T02:39:46.848040+0000","last_active":"2024-09-21T02:40:43.400397+0000","last_peered":"2024-09-21T02:40:43.400397+0000","last_clean":"2024-09-21T02:40:43.400397+0000","last_became_active":"2024-09-21T02:39:46.847627+0000","last_became_peered":"2024-09-21T02:39:46.847627+0000","last_unstale":"2024-09-21T02:40:43.400397+0000","last_undegraded":"2024-09-21T02:40:43.400397+0000","last_fullsized":"2024-09-21T02:40:43.400397+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:14.139156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399887+0000","last_change":"2024-09-21T02:39:46.853208+0000","last_active":"2024-09-21T02:40:43.399887+0000","last_peered":"2024-09-21T02:40:43.399887+0000","last_clean":"2024-09-21T02:40:43.399887+0000","last_became_active":"2024-09-21T02:39:46.852821+0000","last_became_peered":"2024-09-21T02:39:46.852821+0000","last_unstale":"2024-09-21T02:40:43.399887+0000","last_undegraded":"2024-09-21T02:40:43.399887+0000","last_fullsized":"2024-09-21T02:40:43.399887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:24.597702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398270+0000","last_change":"2024-09-21T02:39:46.866239+0000","last_active":"2024-09-21T02:40:43.398270+0000","last_peered":"2024-09-21T02:40:43.398270+0000","last_clean":"2024-09-21T02:40:43.398270+0000","last_became_active":"2024-09-21T02:39:46.865935+0000","last_became_peered":"2024-09-21T02:39:46.865935+0000","last_unstale":"2024-09-21T02:40:43.398270+0000","last_undegraded":"2024-09-21T02:40:43.398270+0000","last_fullsized":"2024-09-21T02:40:43.398270+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.420521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399912+0000","last_change":"2024-09-21T02:39:46.861857+0000","last_active":"2024-09-21T02:40:43.399912+0000","last_peered":"2024-09-21T02:40:43.399912+0000","last_clean":"2024-09-21T02:40:43.399912+0000","last_became_active":"2024-09-21T02:39:46.861512+0000","last_became_peered":"2024-09-21T02:39:46.861512+0000","last_unstale":"2024-09-21T02:40:43.399912+0000","last_undegraded":"2024-09-21T02:40:43.399912+0000","last_fullsized":"2024-09-21T02:40:43.399912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.044159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416171+0000","last_change":"2024-09-21T02:39:46.858655+0000","last_active":"2024-09-21T02:40:43.416171+0000","last_peered":"2024-09-21T02:40:43.416171+0000","last_clean":"2024-09-21T02:40:43.416171+0000","last_became_active":"2024-09-21T02:39:46.858376+0000","last_became_peered":"2024-09-21T02:39:46.858376+0000","last_unstale":"2024-09-21T02:40:43.416171+0000","last_undegraded":"2024-09-21T02:40:43.416171+0000","last_fullsized":"2024-09-21T02:40:43.416171+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:16.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398999+0000","last_change":"2024-09-21T02:39:46.847973+0000","last_active":"2024-09-21T02:40:43.398999+0000","last_peered":"2024-09-21T02:40:43.398999+0000","last_clean":"2024-09-21T02:40:43.398999+0000","last_became_active":"2024-09-21T02:39:46.846957+0000","last_became_peered":"2024-09-21T02:39:46.846957+0000","last_unstale":"2024-09-21T02:40:43.398999+0000","last_undegraded":"2024-09-21T02:40:43.398999+0000","last_fullsized":"2024-09-21T02:40:43.398999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:44.077854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400226+0000","last_change":"2024-09-21T02:39:46.851310+0000","last_active":"2024-09-21T02:40:43.400226+0000","last_peered":"2024-09-21T02:40:43.400226+0000","last_clean":"2024-09-21T02:40:43.400226+0000","last_became_active":"2024-09-21T02:39:46.850666+0000","last_became_peered":"2024-09-21T02:39:46.850666+0000","last_unstale":"2024-09-21T02:40:43.400226+0000","last_undegraded":"2024-09-21T02:40:43.400226+0000","last_fullsized":"2024-09-21T02:40:43.400226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:48.354795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398248+0000","last_change":"2024-09-21T02:39:46.857409+0000","last_active":"2024-09-21T02:40:43.398248+0000","last_peered":"2024-09-21T02:40:43.398248+0000","last_clean":"2024-09-21T02:40:43.398248+0000","last_became_active":"2024-09-21T02:39:46.856974+0000","last_became_peered":"2024-09-21T02:39:46.856974+0000","last_unstale":"2024-09-21T02:40:43.398248+0000","last_undegraded":"2024-09-21T02:40:43.398248+0000","last_fullsized":"2024-09-21T02:40:43.398248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.140154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394920+0000","last_change":"2024-09-21T02:39:46.844168+0000","last_active":"2024-09-21T02:40:43.394920+0000","last_peered":"2024-09-21T02:40:43.394920+0000","last_clean":"2024-09-21T02:40:43.394920+0000","last_became_active":"2024-09-21T02:39:46.843509+0000","last_became_peered":"2024-09-21T02:39:46.843509+0000","last_unstale":"2024-09-21T02:40:43.394920+0000","last_undegraded":"2024-09-21T02:40:43.394920+0000","last_fullsized":"2024-09-21T02:40:43.394920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.899890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397174+0000","last_change":"2024-09-21T02:39:46.854805+0000","last_active":"2024-09-21T02:40:43.397174+0000","last_peered":"2024-09-21T02:40:43.397174+0000","last_clean":"2024-09-21T02:40:43.397174+0000","last_became_active":"2024-09-21T02:39:46.850248+0000","last_became_peered":"2024-09-21T02:39:46.850248+0000","last_unstale":"2024-09-21T02:40:43.397174+0000","last_undegraded":"2024-09-21T02:40:43.397174+0000","last_fullsized":"2024-09-21T02:40:43.397174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:45.628337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395405+0000","last_change":"2024-09-21T02:39:46.866278+0000","last_active":"2024-09-21T02:40:43.395405+0000","last_peered":"2024-09-21T02:40:43.395405+0000","last_clean":"2024-09-21T02:40:43.395405+0000","last_became_active":"2024-09-21T02:39:46.865810+0000","last_became_peered":"2024-09-21T02:39:46.865810+0000","last_unstale":"2024-09-21T02:40:43.395405+0000","last_undegraded":"2024-09-21T02:40:43.395405+0000","last_fullsized":"2024-09-21T02:40:43.395405+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.754340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416117+0000","last_change":"2024-09-21T02:39:46.857721+0000","last_active":"2024-09-21T02:40:43.416117+0000","last_peered":"2024-09-21T02:40:43.416117+0000","last_clean":"2024-09-21T02:40:43.416117+0000","last_became_active":"2024-09-21T02:39:46.853640+0000","last_became_peered":"2024-09-21T02:39:46.853640+0000","last_unstale":"2024-09-21T02:40:43.416117+0000","last_undegraded":"2024-09-21T02:40:43.416117+0000","last_fullsized":"2024-09-21T02:40:43.416117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:54.019607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413715+0000","last_change":"2024-09-21T02:40:43.413457+0000","last_active":"2024-09-21T02:40:43.413715+0000","last_peered":"2024-09-21T02:40:43.413715+0000","last_clean":"2024-09-21T02:40:43.413715+0000","last_became_active":"2024-09-21T02:40:43.413000+0000","last_became_peered":"2024-09-21T02:40:43.413000+0000","last_unstale":"2024-09-21T02:40:43.413715+0000","last_undegraded":"2024-09-21T02:40:43.413715+0000","last_fullsized":"2024-09-21T02:40:43.413715+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:27.775410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398785+0000","last_change":"2024-09-21T02:39:46.857169+0000","last_active":"2024-09-21T02:40:43.398785+0000","last_peered":"2024-09-21T02:40:43.398785+0000","last_clean":"2024-09-21T02:40:43.398785+0000","last_became_active":"2024-09-21T02:39:46.856757+0000","last_became_peered":"2024-09-21T02:39:46.856757+0000","last_unstale":"2024-09-21T02:40:43.398785+0000","last_undegraded":"2024-09-21T02:40:43.398785+0000","last_fullsized":"2024-09-21T02:40:43.398785+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:36.729746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.413017+0000","last_change":"2024-09-21T02:39:46.854162+0000","last_active":"2024-09-21T02:40:43.413017+0000","last_peered":"2024-09-21T02:40:43.413017+0000","last_clean":"2024-09-21T02:40:43.413017+0000","last_became_active":"2024-09-21T02:39:46.853697+0000","last_became_peered":"2024-09-21T02:39:46.853697+0000","last_unstale":"2024-09-21T02:40:43.413017+0000","last_undegraded":"2024-09-21T02:40:43.413017+0000","last_fullsized":"2024-09-21T02:40:43.413017+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.605606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399434+0000","last_change":"2024-09-21T02:39:46.853570+0000","last_active":"2024-09-21T02:40:43.399434+0000","last_peered":"2024-09-21T02:40:43.399434+0000","last_clean":"2024-09-21T02:40:43.399434+0000","last_became_active":"2024-09-21T02:39:46.853074+0000","last_became_peered":"2024-09-21T02:39:46.853074+0000","last_unstale":"2024-09-21T02:40:43.399434+0000","last_undegraded":"2024-09-21T02:40:43.399434+0000","last_fullsized":"2024-09-21T02:40:43.399434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:02.642887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.394962+0000","last_change":"2024-09-21T02:39:46.850070+0000","last_active":"2024-09-21T02:40:43.394962+0000","last_peered":"2024-09-21T02:40:43.394962+0000","last_clean":"2024-09-21T02:40:43.394962+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:40:43.394962+0000","last_undegraded":"2024-09-21T02:40:43.394962+0000","last_fullsized":"2024-09-21T02:40:43.394962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:59.185574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403838+0000","last_change":"2024-09-21T02:40:43.403735+0000","last_active":"2024-09-21T02:40:43.403838+0000","last_peered":"2024-09-21T02:40:43.403838+0000","last_clean":"2024-09-21T02:40:43.403838+0000","last_became_active":"2024-09-21T02:40:43.403330+0000","last_became_peered":"2024-09-21T02:40:43.403330+0000","last_unstale":"2024-09-21T02:40:43.403838+0000","last_undegraded":"2024-09-21T02:40:43.403838+0000","last_fullsized":"2024-09-21T02:40:43.403838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:35.043475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399591+0000","last_change":"2024-09-21T02:39:46.850811+0000","last_active":"2024-09-21T02:40:43.399591+0000","last_peered":"2024-09-21T02:40:43.399591+0000","last_clean":"2024-09-21T02:40:43.399591+0000","last_became_active":"2024-09-21T02:39:46.850423+0000","last_became_peered":"2024-09-21T02:39:46.850423+0000","last_unstale":"2024-09-21T02:40:43.399591+0000","last_undegraded":"2024-09-21T02:40:43.399591+0000","last_fullsized":"2024-09-21T02:40:43.399591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:47.343607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.416003+0000","last_change":"2024-09-21T02:39:46.851169+0000","last_active":"2024-09-21T02:40:43.416003+0000","last_peered":"2024-09-21T02:40:43.416003+0000","last_clean":"2024-09-21T02:40:43.416003+0000","last_became_active":"2024-09-21T02:39:46.850258+0000","last_became_peered":"2024-09-21T02:39:46.850258+0000","last_unstale":"2024-09-21T02:40:43.416003+0000","last_undegraded":"2024-09-21T02:40:43.416003+0000","last_fullsized":"2024-09-21T02:40:43.416003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:02.588325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487706+0000","last_change":"2024-09-21T02:39:46.854082+0000","last_active":"2024-09-21T02:41:44.487706+0000","last_peered":"2024-09-21T02:41:44.487706+0000","last_clean":"2024-09-21T02:41:44.487706+0000","last_became_active":"2024-09-21T02:39:46.852226+0000","last_became_peered":"2024-09-21T02:39:46.852226+0000","last_unstale":"2024-09-21T02:41:44.487706+0000","last_undegraded":"2024-09-21T02:41:44.487706+0000","last_fullsized":"2024-09-21T02:41:44.487706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:41.960472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402990+0000","last_change":"2024-09-21T02:39:46.856222+0000","last_active":"2024-09-21T02:40:43.402990+0000","last_peered":"2024-09-21T02:40:43.402990+0000","last_clean":"2024-09-21T02:40:43.402990+0000","last_became_active":"2024-09-21T02:39:46.855868+0000","last_became_peered":"2024-09-21T02:39:46.855868+0000","last_unstale":"2024-09-21T02:40:43.402990+0000","last_undegraded":"2024-09-21T02:40:43.402990+0000","last_fullsized":"2024-09-21T02:40:43.402990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:31.396030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.412359+0000","last_change":"2024-09-21T02:39:46.862312+0000","last_active":"2024-09-21T02:40:43.412359+0000","last_peered":"2024-09-21T02:40:43.412359+0000","last_clean":"2024-09-21T02:40:43.412359+0000","last_became_active":"2024-09-21T02:39:46.861921+0000","last_became_peered":"2024-09-21T02:39:46.861921+0000","last_unstale":"2024-09-21T02:40:43.412359+0000","last_undegraded":"2024-09-21T02:40:43.412359+0000","last_fullsized":"2024-09-21T02:40:43.412359+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:33.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.395777+0000","last_change":"2024-09-21T02:39:46.851155+0000","last_active":"2024-09-21T02:40:43.395777+0000","last_peered":"2024-09-21T02:40:43.395777+0000","last_clean":"2024-09-21T02:40:43.395777+0000","last_became_active":"2024-09-21T02:39:46.850809+0000","last_became_peered":"2024-09-21T02:39:46.850809+0000","last_unstale":"2024-09-21T02:40:43.395777+0000","last_undegraded":"2024-09-21T02:40:43.395777+0000","last_fullsized":"2024-09-21T02:40:43.395777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.396921+0000","last_change":"2024-09-21T02:39:46.850585+0000","last_active":"2024-09-21T02:40:43.396921+0000","last_peered":"2024-09-21T02:40:43.396921+0000","last_clean":"2024-09-21T02:40:43.396921+0000","last_became_active":"2024-09-21T02:39:46.850114+0000","last_became_peered":"2024-09-21T02:39:46.850114+0000","last_unstale":"2024-09-21T02:40:43.396921+0000","last_undegraded":"2024-09-21T02:40:43.396921+0000","last_fullsized":"2024-09-21T02:40:43.396921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:04.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402958+0000","last_change":"2024-09-21T02:39:46.850416+0000","last_active":"2024-09-21T02:40:43.402958+0000","last_peered":"2024-09-21T02:40:43.402958+0000","last_clean":"2024-09-21T02:40:43.402958+0000","last_became_active":"2024-09-21T02:39:46.850035+0000","last_became_peered":"2024-09-21T02:39:46.850035+0000","last_unstale":"2024-09-21T02:40:43.402958+0000","last_undegraded":"2024-09-21T02:40:43.402958+0000","last_fullsized":"2024-09-21T02:40:43.402958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:09.139331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.411802+0000","last_change":"2024-09-21T02:39:46.861376+0000","last_active":"2024-09-21T02:40:43.411802+0000","last_peered":"2024-09-21T02:40:43.411802+0000","last_clean":"2024-09-21T02:40:43.411802+0000","last_became_active":"2024-09-21T02:39:46.861011+0000","last_became_peered":"2024-09-21T02:39:46.861011+0000","last_unstale":"2024-09-21T02:40:43.411802+0000","last_undegraded":"2024-09-21T02:40:43.411802+0000","last_fullsized":"2024-09-21T02:40:43.411802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:45.123705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696726+0000","last_change":"2024-09-21T02:39:46.846135+0000","last_active":"2024-09-21T02:41:44.696726+0000","last_peered":"2024-09-21T02:41:44.696726+0000","last_clean":"2024-09-21T02:41:44.696726+0000","last_became_active":"2024-09-21T02:39:46.845693+0000","last_became_peered":"2024-09-21T02:39:46.845693+0000","last_unstale":"2024-09-21T02:41:44.696726+0000","last_undegraded":"2024-09-21T02:41:44.696726+0000","last_fullsized":"2024-09-21T02:41:44.696726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:55.830932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487799+0000","last_change":"2024-09-21T02:39:46.853300+0000","last_active":"2024-09-21T02:41:44.487799+0000","last_peered":"2024-09-21T02:41:44.487799+0000","last_clean":"2024-09-21T02:41:44.487799+0000","last_became_active":"2024-09-21T02:39:46.852953+0000","last_became_peered":"2024-09-21T02:39:46.852953+0000","last_unstale":"2024-09-21T02:41:44.487799+0000","last_undegraded":"2024-09-21T02:41:44.487799+0000","last_fullsized":"2024-09-21T02:41:44.487799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:04.475743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.400076+0000","last_change":"2024-09-21T02:39:46.854976+0000","last_active":"2024-09-21T02:40:43.400076+0000","last_peered":"2024-09-21T02:40:43.400076+0000","last_clean":"2024-09-21T02:40:43.400076+0000","last_became_active":"2024-09-21T02:39:46.852970+0000","last_became_peered":"2024-09-21T02:39:46.852970+0000","last_unstale":"2024-09-21T02:40:43.400076+0000","last_undegraded":"2024-09-21T02:40:43.400076+0000","last_fullsized":"2024-09-21T02:40:43.400076+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:54.654967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399898+0000","last_change":"2024-09-21T02:39:46.848698+0000","last_active":"2024-09-21T02:40:43.399898+0000","last_peered":"2024-09-21T02:40:43.399898+0000","last_clean":"2024-09-21T02:40:43.399898+0000","last_became_active":"2024-09-21T02:39:46.848374+0000","last_became_peered":"2024-09-21T02:39:46.848374+0000","last_unstale":"2024-09-21T02:40:43.399898+0000","last_undegraded":"2024-09-21T02:40:43.399898+0000","last_fullsized":"2024-09-21T02:40:43.399898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:59.589062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.399265+0000","last_change":"2024-09-21T02:39:46.851850+0000","last_active":"2024-09-21T02:40:43.399265+0000","last_peered":"2024-09-21T02:40:43.399265+0000","last_clean":"2024-09-21T02:40:43.399265+0000","last_became_active":"2024-09-21T02:39:46.851408+0000","last_became_peered":"2024-09-21T02:39:46.851408+0000","last_unstale":"2024-09-21T02:40:43.399265+0000","last_undegraded":"2024-09-21T02:40:43.399265+0000","last_fullsized":"2024-09-21T02:40:43.399265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:27.831504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":36864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71530,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":385,"num_read_kb":265,"num_write":167,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":214590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":491931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939690,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28668,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716484,"statfs":{"total":95995035648,"available":95965679616,"internally_reserved":0,"allocated":1683456,"data_stored":1150824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103215,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":492167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1015808,"data_stored":501495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495675,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1593344,"data_stored":1088387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659201,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":487343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855431,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1601536,"data_stored":1083584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":511158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":487537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":556132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":554391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":488731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:41:47.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:41:47.803 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:47 smithi084 ceph-mon[30747]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:47 smithi172 ceph-mon[35067]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:47 smithi090 ceph-mon[34571]: from='client.25117 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:48.228 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:48.692 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:48 smithi084 ceph-mon[30747]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T02:41:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.884+0000 7fa6ff200640 1 -- 172.21.15.84:0/2106886221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa700109c40 msgr2=0x7fa700110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.884+0000 7fa6ff200640 1 --2- 172.21.15.84:0/2106886221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa700109c40 0x7fa700110470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009900 tx=0x7fa6f802a410 comp rx=0 tx=0).stop 2024-09-21T02:41:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.885+0000 7fa6ff200640 1 -- 172.21.15.84:0/2106886221 shutdown_connections 2024-09-21T02:41:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.885+0000 7fa6ff200640 1 --2- 172.21.15.84:0/2106886221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa700109c40 0x7fa700110470 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.885+0000 7fa6ff200640 1 --2- 172.21.15.84:0/2106886221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7001092f0 0x7fa700109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.885+0000 7fa6ff200640 1 --2- 172.21.15.84:0/2106886221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7001039b0 0x7fa700103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.885+0000 7fa6ff200640 1 -- 172.21.15.84:0/2106886221 >> 172.21.15.84:0/2106886221 conn(0x7fa7000ff440 msgr2=0x7fa700101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:48.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.885+0000 7fa6ff200640 1 -- 172.21.15.84:0/2106886221 shutdown_connections 2024-09-21T02:41:48.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.885+0000 7fa6ff200640 1 -- 172.21.15.84:0/2106886221 wait complete. 2024-09-21T02:41:48.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.886+0000 7fa6ff200640 1 Processor -- start 2024-09-21T02:41:48.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.886+0000 7fa6ff200640 1 -- start start 2024-09-21T02:41:48.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.886+0000 7fa6ff200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7001039b0 0x7fa70019c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:48.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.886+0000 7fa6ff200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7001092f0 0x7fa70019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6ff200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa700109c40 0x7fa7001a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6ff200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa700113a20 con 0x7fa7001092f0 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6ff200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7001138a0 con 0x7fa700109c40 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6ff200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa700113ba0 con 0x7fa7001039b0 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7001092f0 0x7fa70019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fde00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7001039b0 0x7fa70019c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7001092f0 0x7fa70019cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41290/0 (socket says 172.21.15.84:41290) 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fd400640 1 -- 172.21.15.84:0/1245894895 learned_addr learned my addr 172.21.15.84:0/1245894895 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fe800640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa700109c40 0x7fa7001a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fd400640 1 -- 172.21.15.84:0/1245894895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7001039b0 msgr2=0x7fa70019c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fd400640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7001039b0 0x7fa70019c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fd400640 1 -- 172.21.15.84:0/1245894895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa700109c40 msgr2=0x7fa7001a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fd400640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa700109c40 0x7fa7001a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:48.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fd400640 1 -- 172.21.15.84:0/1245894895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7001a24e0 con 0x7fa7001092f0 2024-09-21T02:41:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.887+0000 7fa6fde00640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7001039b0 0x7fa70019c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.888+0000 7fa6fd400640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7001092f0 0x7fa70019cb10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e9f0 tx=0x7fa6ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.888+0000 7fa6f6a00640 1 -- 172.21.15.84:0/1245894895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00ccc0 con 0x7fa7001092f0 2024-09-21T02:41:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.888+0000 7fa6f6a00640 1 -- 172.21.15.84:0/1245894895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa6ec010900 con 0x7fa7001092f0 2024-09-21T02:41:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.888+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7001a27d0 con 0x7fa7001092f0 2024-09-21T02:41:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.888+0000 7fa6f6a00640 1 -- 172.21.15.84:0/1245894895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec018900 con 0x7fa7001092f0 2024-09-21T02:41:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.888+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7001a8f30 con 0x7fa7001092f0 2024-09-21T02:41:48.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.889+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa700103dc0 con 0x7fa7001092f0 2024-09-21T02:41:48.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.894+0000 7fa6f6a00640 1 -- 172.21.15.84:0/1245894895 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa6ec010ab0 con 0x7fa7001092f0 2024-09-21T02:41:48.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.895+0000 7fa6f6a00640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa6e40b65a0 0x7fa6e40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:48.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.895+0000 7fa6f6a00640 1 -- 172.21.15.84:0/1245894895 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa6ec0e7ff0 con 0x7fa7001092f0 2024-09-21T02:41:48.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.896+0000 7fa6fde00640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa6e40b65a0 0x7fa6e40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:48.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.896+0000 7fa6fde00640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa6e40b65a0 0x7fa6e40b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005fd0 tx=0x7fa6f0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:48.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:48.898+0000 7fa6f6a00640 1 -- 172.21.15.84:0/1245894895 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6ec0b2710 con 0x7fa7001092f0 2024-09-21T02:41:49.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:48 smithi172 ceph-mon[35067]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T02:41:49.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:48 smithi090 ceph-mon[34571]: pgmap v381: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T02:41:49.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.103+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa700076600 con 0x7fa6e40b65a0 2024-09-21T02:41:49.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.114+0000 7fa6f6a00640 1 -- 172.21.15.84:0/1245894895 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340349 (secure 0 0 0) 0x7fa700076600 con 0x7fa6e40b65a0 2024-09-21T02:41:49.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:49.120 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T02:41:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa6e40b65a0 msgr2=0x7fa6e40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa6e40b65a0 0x7fa6e40b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0005fd0 tx=0x7fa6f0009500 comp rx=0 tx=0).stop 2024-09-21T02:41:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7001092f0 msgr2=0x7fa70019cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7001092f0 0x7fa70019cb10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00e9f0 tx=0x7fa6ec00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 shutdown_connections 2024-09-21T02:41:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa700109c40 0x7fa7001a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7001092f0 0x7fa70019cb10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:49.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa6e40b65a0 0x7fa6e40b8ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 --2- 172.21.15.84:0/1245894895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7001039b0 0x7fa70019c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.119+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 >> 172.21.15.84:0/1245894895 conn(0x7fa7000ff440 msgr2=0x7fa7001078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.120+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 shutdown_connections 2024-09-21T02:41:49.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:49.120+0000 7fa6ff200640 1 -- 172.21.15.84:0/1245894895 wait complete. 2024-09-21T02:41:49.895 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":381,"stamp":"2024-09-21T02:41:47.612916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662132,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":486,"num_read_kb":344,"num_write":292,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":417,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392364,"kb_used_data":13928,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549460,"statfs":{"total":1151940427776,"available":1151538647040,"internally_reserved":0,"allocated":14262272,"data_stored":8039776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":29,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002107"},"pg_stats":[{"pgid":"2.1f","version":"84'9","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348601+0000","last_change":"2024-09-21T02:39:43.823658+0000","last_active":"2024-09-21T02:41:44.348601+0000","last_peered":"2024-09-21T02:41:44.348601+0000","last_clean":"2024-09-21T02:41:44.348601+0000","last_became_active":"2024-09-21T02:39:43.823211+0000","last_became_peered":"2024-09-21T02:39:43.823211+0000","last_unstale":"2024-09-21T02:41:44.348601+0000","last_undegraded":"2024-09-21T02:41:44.348601+0000","last_fullsized":"2024-09-21T02:41:44.348601+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:00.505552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397896+0000","last_change":"2024-09-21T02:39:46.850819+0000","last_active":"2024-09-21T02:40:43.397896+0000","last_peered":"2024-09-21T02:40:43.397896+0000","last_clean":"2024-09-21T02:40:43.397896+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:40:43.397896+0000","last_undegraded":"2024-09-21T02:40:43.397896+0000","last_fullsized":"2024-09-21T02:40:43.397896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:21.280788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.698927+0000","last_change":"2024-09-21T02:41:44.698816+0000","last_active":"2024-09-21T02:41:44.698927+0000","last_peered":"2024-09-21T02:41:44.698927+0000","last_clean":"2024-09-21T02:41:44.698927+0000","last_became_active":"2024-09-21T02:41:44.698135+0000","last_became_peered":"2024-09-21T02:41:44.698135+0000","last_unstale":"2024-09-21T02:41:44.698927+0000","last_undegraded":"2024-09-21T02:41:44.698927+0000","last_fullsized":"2024-09-21T02:41:44.698927+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:09.002148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398131+0000","last_change":"2024-09-21T02:39:43.828030+0000","last_active":"2024-09-21T02:40:43.398131+0000","last_peered":"2024-09-21T02:40:43.398131+0000","last_clean":"2024-09-21T02:40:43.398131+0000","last_became_active":"2024-09-21T02:39:43.827692+0000","last_became_peered":"2024-09-21T02:39:43.827692+0000","last_unstale":"2024-09-21T02:40:43.398131+0000","last_undegraded":"2024-09-21T02:40:43.398131+0000","last_fullsized":"2024-09-21T02:40:43.398131+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:32.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487300+0000","last_change":"2024-09-21T02:39:46.854718+0000","last_active":"2024-09-21T02:41:44.487300+0000","last_peered":"2024-09-21T02:41:44.487300+0000","last_clean":"2024-09-21T02:41:44.487300+0000","last_became_active":"2024-09-21T02:39:46.854355+0000","last_became_peered":"2024-09-21T02:39:46.854355+0000","last_unstale":"2024-09-21T02:41:44.487300+0000","last_undegraded":"2024-09-21T02:41:44.487300+0000","last_fullsized":"2024-09-21T02:41:44.487300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:58.894397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486213+0000","last_change":"2024-09-21T02:39:56.930764+0000","last_active":"2024-09-21T02:41:44.486213+0000","last_peered":"2024-09-21T02:41:44.486213+0000","last_clean":"2024-09-21T02:41:44.486213+0000","last_became_active":"2024-09-21T02:39:56.930243+0000","last_became_peered":"2024-09-21T02:39:56.930243+0000","last_unstale":"2024-09-21T02:41:44.486213+0000","last_undegraded":"2024-09-21T02:41:44.486213+0000","last_fullsized":"2024-09-21T02:41:44.486213+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:20.283102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697427+0000","last_change":"2024-09-21T02:39:43.824749+0000","last_active":"2024-09-21T02:41:44.697427+0000","last_peered":"2024-09-21T02:41:44.697427+0000","last_clean":"2024-09-21T02:41:44.697427+0000","last_became_active":"2024-09-21T02:39:43.824385+0000","last_became_peered":"2024-09-21T02:39:43.824385+0000","last_unstale":"2024-09-21T02:41:44.697427+0000","last_undegraded":"2024-09-21T02:41:44.697427+0000","last_fullsized":"2024-09-21T02:41:44.697427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487706+0000","last_change":"2024-09-21T02:39:46.856048+0000","last_active":"2024-09-21T02:41:44.487706+0000","last_peered":"2024-09-21T02:41:44.487706+0000","last_clean":"2024-09-21T02:41:44.487706+0000","last_became_active":"2024-09-21T02:39:46.855687+0000","last_became_peered":"2024-09-21T02:39:46.855687+0000","last_unstale":"2024-09-21T02:41:44.487706+0000","last_undegraded":"2024-09-21T02:41:44.487706+0000","last_fullsized":"2024-09-21T02:41:44.487706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:11.708028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487626+0000","last_change":"2024-09-21T02:39:56.931495+0000","last_active":"2024-09-21T02:41:44.487626+0000","last_peered":"2024-09-21T02:41:44.487626+0000","last_clean":"2024-09-21T02:41:44.487626+0000","last_became_active":"2024-09-21T02:39:56.930586+0000","last_became_peered":"2024-09-21T02:39:56.930586+0000","last_unstale":"2024-09-21T02:41:44.487626+0000","last_undegraded":"2024-09-21T02:41:44.487626+0000","last_fullsized":"2024-09-21T02:41:44.487626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:56.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343041+0000","last_change":"2024-09-21T02:40:43.408517+0000","last_active":"2024-09-21T02:41:44.343041+0000","last_peered":"2024-09-21T02:41:44.343041+0000","last_clean":"2024-09-21T02:41:44.343041+0000","last_became_active":"2024-09-21T02:40:43.402800+0000","last_became_peered":"2024-09-21T02:40:43.402800+0000","last_unstale":"2024-09-21T02:41:44.343041+0000","last_undegraded":"2024-09-21T02:41:44.343041+0000","last_fullsized":"2024-09-21T02:41:44.343041+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:46.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348946+0000","last_change":"2024-09-21T02:39:46.855990+0000","last_active":"2024-09-21T02:41:44.348946+0000","last_peered":"2024-09-21T02:41:44.348946+0000","last_clean":"2024-09-21T02:41:44.348946+0000","last_became_active":"2024-09-21T02:39:46.855602+0000","last_became_peered":"2024-09-21T02:39:46.855602+0000","last_unstale":"2024-09-21T02:41:44.348946+0000","last_undegraded":"2024-09-21T02:41:44.348946+0000","last_fullsized":"2024-09-21T02:41:44.348946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:43.207141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487094+0000","last_change":"2024-09-21T02:39:56.924868+0000","last_active":"2024-09-21T02:41:44.487094+0000","last_peered":"2024-09-21T02:41:44.487094+0000","last_clean":"2024-09-21T02:41:44.487094+0000","last_became_active":"2024-09-21T02:39:56.924353+0000","last_became_peered":"2024-09-21T02:39:56.924353+0000","last_unstale":"2024-09-21T02:41:44.487094+0000","last_undegraded":"2024-09-21T02:41:44.487094+0000","last_fullsized":"2024-09-21T02:41:44.487094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:48.095244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401917+0000","last_change":"2024-09-21T02:39:46.853077+0000","last_active":"2024-09-21T02:40:43.401917+0000","last_peered":"2024-09-21T02:40:43.401917+0000","last_clean":"2024-09-21T02:40:43.401917+0000","last_became_active":"2024-09-21T02:39:46.852691+0000","last_became_peered":"2024-09-21T02:39:46.852691+0000","last_unstale":"2024-09-21T02:40:43.401917+0000","last_undegraded":"2024-09-21T02:40:43.401917+0000","last_fullsized":"2024-09-21T02:40:43.401917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:12.427934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":63,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696807+0000","last_change":"2024-09-21T02:40:43.411229+0000","last_active":"2024-09-21T02:41:44.696807+0000","last_peered":"2024-09-21T02:41:44.696807+0000","last_clean":"2024-09-21T02:41:44.696807+0000","last_became_active":"2024-09-21T02:40:43.404833+0000","last_became_peered":"2024-09-21T02:40:43.404833+0000","last_unstale":"2024-09-21T02:41:44.696807+0000","last_undegraded":"2024-09-21T02:41:44.696807+0000","last_fullsized":"2024-09-21T02:41:44.696807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:22.812239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487241+0000","last_change":"2024-09-21T02:39:56.922205+0000","last_active":"2024-09-21T02:41:44.487241+0000","last_peered":"2024-09-21T02:41:44.487241+0000","last_clean":"2024-09-21T02:41:44.487241+0000","last_became_active":"2024-09-21T02:39:56.921702+0000","last_became_peered":"2024-09-21T02:39:56.921702+0000","last_unstale":"2024-09-21T02:41:44.487241+0000","last_undegraded":"2024-09-21T02:41:44.487241+0000","last_fullsized":"2024-09-21T02:41:44.487241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:07.622691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397425+0000","last_change":"2024-09-21T02:39:46.846380+0000","last_active":"2024-09-21T02:40:43.397425+0000","last_peered":"2024-09-21T02:40:43.397425+0000","last_clean":"2024-09-21T02:40:43.397425+0000","last_became_active":"2024-09-21T02:39:46.845972+0000","last_became_peered":"2024-09-21T02:39:46.845972+0000","last_unstale":"2024-09-21T02:40:43.397425+0000","last_undegraded":"2024-09-21T02:40:43.397425+0000","last_fullsized":"2024-09-21T02:40:43.397425+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:44.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344639+0000","last_change":"2024-09-21T02:39:43.824394+0000","last_active":"2024-09-21T02:41:44.344639+0000","last_peered":"2024-09-21T02:41:44.344639+0000","last_clean":"2024-09-21T02:41:44.344639+0000","last_became_active":"2024-09-21T02:39:43.823947+0000","last_became_peered":"2024-09-21T02:39:43.823947+0000","last_unstale":"2024-09-21T02:41:44.344639+0000","last_undegraded":"2024-09-21T02:41:44.344639+0000","last_fullsized":"2024-09-21T02:41:44.344639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.083281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487375+0000","last_change":"2024-09-21T02:40:43.413833+0000","last_active":"2024-09-21T02:41:44.487375+0000","last_peered":"2024-09-21T02:41:44.487375+0000","last_clean":"2024-09-21T02:41:44.487375+0000","last_became_active":"2024-09-21T02:40:43.413319+0000","last_became_peered":"2024-09-21T02:40:43.413319+0000","last_unstale":"2024-09-21T02:41:44.487375+0000","last_undegraded":"2024-09-21T02:41:44.487375+0000","last_fullsized":"2024-09-21T02:41:44.487375+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:40.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342920+0000","last_change":"2024-09-21T02:39:46.845544+0000","last_active":"2024-09-21T02:41:44.342920+0000","last_peered":"2024-09-21T02:41:44.342920+0000","last_clean":"2024-09-21T02:41:44.342920+0000","last_became_active":"2024-09-21T02:39:46.845162+0000","last_became_peered":"2024-09-21T02:39:46.845162+0000","last_unstale":"2024-09-21T02:41:44.342920+0000","last_undegraded":"2024-09-21T02:41:44.342920+0000","last_fullsized":"2024-09-21T02:41:44.342920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:46.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397239+0000","last_change":"2024-09-21T02:39:43.825182+0000","last_active":"2024-09-21T02:40:43.397239+0000","last_peered":"2024-09-21T02:40:43.397239+0000","last_clean":"2024-09-21T02:40:43.397239+0000","last_became_active":"2024-09-21T02:39:43.824774+0000","last_became_peered":"2024-09-21T02:39:43.824774+0000","last_unstale":"2024-09-21T02:40:43.397239+0000","last_undegraded":"2024-09-21T02:40:43.397239+0000","last_fullsized":"2024-09-21T02:40:43.397239+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:41.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348445+0000","last_change":"2024-09-21T02:39:56.935765+0000","last_active":"2024-09-21T02:41:44.348445+0000","last_peered":"2024-09-21T02:41:44.348445+0000","last_clean":"2024-09-21T02:41:44.348445+0000","last_became_active":"2024-09-21T02:39:56.933218+0000","last_became_peered":"2024-09-21T02:39:56.933218+0000","last_unstale":"2024-09-21T02:41:44.348445+0000","last_undegraded":"2024-09-21T02:41:44.348445+0000","last_fullsized":"2024-09-21T02:41:44.348445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:28.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696937+0000","last_change":"2024-09-21T02:39:46.853769+0000","last_active":"2024-09-21T02:41:44.696937+0000","last_peered":"2024-09-21T02:41:44.696937+0000","last_clean":"2024-09-21T02:41:44.696937+0000","last_became_active":"2024-09-21T02:39:46.853347+0000","last_became_peered":"2024-09-21T02:39:46.853347+0000","last_unstale":"2024-09-21T02:41:44.696937+0000","last_undegraded":"2024-09-21T02:41:44.696937+0000","last_fullsized":"2024-09-21T02:41:44.696937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:01.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486409+0000","last_change":"2024-09-21T02:40:43.408316+0000","last_active":"2024-09-21T02:41:44.486409+0000","last_peered":"2024-09-21T02:41:44.486409+0000","last_clean":"2024-09-21T02:41:44.486409+0000","last_became_active":"2024-09-21T02:40:43.402877+0000","last_became_peered":"2024-09-21T02:40:43.402877+0000","last_unstale":"2024-09-21T02:41:44.486409+0000","last_undegraded":"2024-09-21T02:41:44.486409+0000","last_fullsized":"2024-09-21T02:41:44.486409+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.712477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487439+0000","last_change":"2024-09-21T02:39:56.928251+0000","last_active":"2024-09-21T02:41:44.487439+0000","last_peered":"2024-09-21T02:41:44.487439+0000","last_clean":"2024-09-21T02:41:44.487439+0000","last_became_active":"2024-09-21T02:39:56.927772+0000","last_became_peered":"2024-09-21T02:39:56.927772+0000","last_unstale":"2024-09-21T02:41:44.487439+0000","last_undegraded":"2024-09-21T02:41:44.487439+0000","last_fullsized":"2024-09-21T02:41:44.487439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:40.762245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487109+0000","last_change":"2024-09-21T02:40:43.418238+0000","last_active":"2024-09-21T02:41:44.487109+0000","last_peered":"2024-09-21T02:41:44.487109+0000","last_clean":"2024-09-21T02:41:44.487109+0000","last_became_active":"2024-09-21T02:40:43.417728+0000","last_became_peered":"2024-09-21T02:40:43.417728+0000","last_unstale":"2024-09-21T02:41:44.487109+0000","last_undegraded":"2024-09-21T02:41:44.487109+0000","last_fullsized":"2024-09-21T02:41:44.487109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:35.244275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487581+0000","last_change":"2024-09-21T02:39:43.840567+0000","last_active":"2024-09-21T02:41:44.487581+0000","last_peered":"2024-09-21T02:41:44.487581+0000","last_clean":"2024-09-21T02:41:44.487581+0000","last_became_active":"2024-09-21T02:39:43.840279+0000","last_became_peered":"2024-09-21T02:39:43.840279+0000","last_unstale":"2024-09-21T02:41:44.487581+0000","last_undegraded":"2024-09-21T02:41:44.487581+0000","last_fullsized":"2024-09-21T02:41:44.487581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:42.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345516+0000","last_change":"2024-09-21T02:39:56.920425+0000","last_active":"2024-09-21T02:41:44.345516+0000","last_peered":"2024-09-21T02:41:44.345516+0000","last_clean":"2024-09-21T02:41:44.345516+0000","last_became_active":"2024-09-21T02:39:56.919610+0000","last_became_peered":"2024-09-21T02:39:56.919610+0000","last_unstale":"2024-09-21T02:41:44.345516+0000","last_undegraded":"2024-09-21T02:41:44.345516+0000","last_fullsized":"2024-09-21T02:41:44.345516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398383+0000","last_change":"2024-09-21T02:39:46.845188+0000","last_active":"2024-09-21T02:40:43.398383+0000","last_peered":"2024-09-21T02:40:43.398383+0000","last_clean":"2024-09-21T02:40:43.398383+0000","last_became_active":"2024-09-21T02:39:46.844818+0000","last_became_peered":"2024-09-21T02:39:46.844818+0000","last_unstale":"2024-09-21T02:40:43.398383+0000","last_undegraded":"2024-09-21T02:40:43.398383+0000","last_fullsized":"2024-09-21T02:40:43.398383+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.853370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'11","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348776+0000","last_change":"2024-09-21T02:39:43.822226+0000","last_active":"2024-09-21T02:41:44.348776+0000","last_peered":"2024-09-21T02:41:44.348776+0000","last_clean":"2024-09-21T02:41:44.348776+0000","last_became_active":"2024-09-21T02:39:43.821798+0000","last_became_peered":"2024-09-21T02:39:43.821798+0000","last_unstale":"2024-09-21T02:41:44.348776+0000","last_undegraded":"2024-09-21T02:41:44.348776+0000","last_fullsized":"2024-09-21T02:41:44.348776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:38.822330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.396683+0000","last_change":"2024-09-21T02:39:56.919521+0000","last_active":"2024-09-21T02:40:43.396683+0000","last_peered":"2024-09-21T02:40:43.396683+0000","last_clean":"2024-09-21T02:40:43.396683+0000","last_became_active":"2024-09-21T02:39:56.918042+0000","last_became_peered":"2024-09-21T02:39:56.918042+0000","last_unstale":"2024-09-21T02:40:43.396683+0000","last_undegraded":"2024-09-21T02:40:43.396683+0000","last_fullsized":"2024-09-21T02:40:43.396683+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:21.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346862+0000","last_change":"2024-09-21T02:39:46.861856+0000","last_active":"2024-09-21T02:41:44.346862+0000","last_peered":"2024-09-21T02:41:44.346862+0000","last_clean":"2024-09-21T02:41:44.346862+0000","last_became_active":"2024-09-21T02:39:46.861416+0000","last_became_peered":"2024-09-21T02:39:46.861416+0000","last_unstale":"2024-09-21T02:41:44.346862+0000","last_undegraded":"2024-09-21T02:41:44.346862+0000","last_fullsized":"2024-09-21T02:41:44.346862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:46.547988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697454+0000","last_change":"2024-09-21T02:39:43.826232+0000","last_active":"2024-09-21T02:41:44.697454+0000","last_peered":"2024-09-21T02:41:44.697454+0000","last_clean":"2024-09-21T02:41:44.697454+0000","last_became_active":"2024-09-21T02:39:43.825789+0000","last_became_peered":"2024-09-21T02:39:43.825789+0000","last_unstale":"2024-09-21T02:41:44.697454+0000","last_undegraded":"2024-09-21T02:41:44.697454+0000","last_fullsized":"2024-09-21T02:41:44.697454+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:19.465106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342871+0000","last_change":"2024-09-21T02:39:56.917802+0000","last_active":"2024-09-21T02:41:44.342871+0000","last_peered":"2024-09-21T02:41:44.342871+0000","last_clean":"2024-09-21T02:41:44.342871+0000","last_became_active":"2024-09-21T02:39:56.917286+0000","last_became_peered":"2024-09-21T02:39:56.917286+0000","last_unstale":"2024-09-21T02:41:44.342871+0000","last_undegraded":"2024-09-21T02:41:44.342871+0000","last_fullsized":"2024-09-21T02:41:44.342871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:19.055218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486612+0000","last_change":"2024-09-21T02:39:46.858829+0000","last_active":"2024-09-21T02:41:44.486612+0000","last_peered":"2024-09-21T02:41:44.486612+0000","last_clean":"2024-09-21T02:41:44.486612+0000","last_became_active":"2024-09-21T02:39:46.858392+0000","last_became_peered":"2024-09-21T02:39:46.858392+0000","last_unstale":"2024-09-21T02:41:44.486612+0000","last_undegraded":"2024-09-21T02:41:44.486612+0000","last_fullsized":"2024-09-21T02:41:44.486612+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:29.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348580+0000","last_change":"2024-09-21T02:39:43.825129+0000","last_active":"2024-09-21T02:41:44.348580+0000","last_peered":"2024-09-21T02:41:44.348580+0000","last_clean":"2024-09-21T02:41:44.348580+0000","last_became_active":"2024-09-21T02:39:43.824756+0000","last_became_peered":"2024-09-21T02:39:43.824756+0000","last_unstale":"2024-09-21T02:41:44.348580+0000","last_undegraded":"2024-09-21T02:41:44.348580+0000","last_fullsized":"2024-09-21T02:41:44.348580+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:28.771033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696627+0000","last_change":"2024-09-21T02:39:56.929186+0000","last_active":"2024-09-21T02:41:44.696627+0000","last_peered":"2024-09-21T02:41:44.696627+0000","last_clean":"2024-09-21T02:41:44.696627+0000","last_became_active":"2024-09-21T02:39:56.928608+0000","last_became_peered":"2024-09-21T02:39:56.928608+0000","last_unstale":"2024-09-21T02:41:44.696627+0000","last_undegraded":"2024-09-21T02:41:44.696627+0000","last_fullsized":"2024-09-21T02:41:44.696627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:47.860230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486664+0000","last_change":"2024-09-21T02:39:46.860375+0000","last_active":"2024-09-21T02:41:44.486664+0000","last_peered":"2024-09-21T02:41:44.486664+0000","last_clean":"2024-09-21T02:41:44.486664+0000","last_became_active":"2024-09-21T02:39:46.860035+0000","last_became_peered":"2024-09-21T02:39:46.860035+0000","last_unstale":"2024-09-21T02:41:44.486664+0000","last_undegraded":"2024-09-21T02:41:44.486664+0000","last_fullsized":"2024-09-21T02:41:44.486664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:07.761203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402127+0000","last_change":"2024-09-21T02:39:43.827869+0000","last_active":"2024-09-21T02:40:43.402127+0000","last_peered":"2024-09-21T02:40:43.402127+0000","last_clean":"2024-09-21T02:40:43.402127+0000","last_became_active":"2024-09-21T02:39:43.827375+0000","last_became_peered":"2024-09-21T02:39:43.827375+0000","last_unstale":"2024-09-21T02:40:43.402127+0000","last_undegraded":"2024-09-21T02:40:43.402127+0000","last_fullsized":"2024-09-21T02:40:43.402127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:48.257387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346673+0000","last_change":"2024-09-21T02:39:56.917766+0000","last_active":"2024-09-21T02:41:44.346673+0000","last_peered":"2024-09-21T02:41:44.346673+0000","last_clean":"2024-09-21T02:41:44.346673+0000","last_became_active":"2024-09-21T02:39:56.917309+0000","last_became_peered":"2024-09-21T02:39:56.917309+0000","last_unstale":"2024-09-21T02:41:44.346673+0000","last_undegraded":"2024-09-21T02:41:44.346673+0000","last_fullsized":"2024-09-21T02:41:44.346673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:36.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348147+0000","last_change":"2024-09-21T02:39:46.851416+0000","last_active":"2024-09-21T02:41:44.348147+0000","last_peered":"2024-09-21T02:41:44.348147+0000","last_clean":"2024-09-21T02:41:44.348147+0000","last_became_active":"2024-09-21T02:39:46.851055+0000","last_became_peered":"2024-09-21T02:39:46.851055+0000","last_unstale":"2024-09-21T02:41:44.348147+0000","last_undegraded":"2024-09-21T02:41:44.348147+0000","last_fullsized":"2024-09-21T02:41:44.348147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:50.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":113,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.510483+0000","last_change":"2024-09-21T02:39:43.825162+0000","last_active":"2024-09-21T02:41:44.510483+0000","last_peered":"2024-09-21T02:41:44.510483+0000","last_clean":"2024-09-21T02:41:44.510483+0000","last_became_active":"2024-09-21T02:39:43.824811+0000","last_became_peered":"2024-09-21T02:39:43.824811+0000","last_unstale":"2024-09-21T02:41:44.510483+0000","last_undegraded":"2024-09-21T02:41:44.510483+0000","last_fullsized":"2024-09-21T02:41:44.510483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:10.020902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346755+0000","last_change":"2024-09-21T02:39:56.920750+0000","last_active":"2024-09-21T02:41:44.346755+0000","last_peered":"2024-09-21T02:41:44.346755+0000","last_clean":"2024-09-21T02:41:44.346755+0000","last_became_active":"2024-09-21T02:39:56.920245+0000","last_became_peered":"2024-09-21T02:39:56.920245+0000","last_unstale":"2024-09-21T02:41:44.346755+0000","last_undegraded":"2024-09-21T02:41:44.346755+0000","last_fullsized":"2024-09-21T02:41:44.346755+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:53.718596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346341+0000","last_change":"2024-09-21T02:39:46.854202+0000","last_active":"2024-09-21T02:41:44.346341+0000","last_peered":"2024-09-21T02:41:44.346341+0000","last_clean":"2024-09-21T02:41:44.346341+0000","last_became_active":"2024-09-21T02:39:46.853076+0000","last_became_peered":"2024-09-21T02:39:46.853076+0000","last_unstale":"2024-09-21T02:41:44.346341+0000","last_undegraded":"2024-09-21T02:41:44.346341+0000","last_fullsized":"2024-09-21T02:41:44.346341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:59.729777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401523+0000","last_change":"2024-09-21T02:39:43.826351+0000","last_active":"2024-09-21T02:40:43.401523+0000","last_peered":"2024-09-21T02:40:43.401523+0000","last_clean":"2024-09-21T02:40:43.401523+0000","last_became_active":"2024-09-21T02:39:43.825683+0000","last_became_peered":"2024-09-21T02:39:43.825683+0000","last_unstale":"2024-09-21T02:40:43.401523+0000","last_undegraded":"2024-09-21T02:40:43.401523+0000","last_fullsized":"2024-09-21T02:40:43.401523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:16.934280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348861+0000","last_change":"2024-09-21T02:39:56.937591+0000","last_active":"2024-09-21T02:41:44.348861+0000","last_peered":"2024-09-21T02:41:44.348861+0000","last_clean":"2024-09-21T02:41:44.348861+0000","last_became_active":"2024-09-21T02:39:56.937178+0000","last_became_peered":"2024-09-21T02:39:56.937178+0000","last_unstale":"2024-09-21T02:41:44.348861+0000","last_undegraded":"2024-09-21T02:41:44.348861+0000","last_fullsized":"2024-09-21T02:41:44.348861+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:21.218393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397507+0000","last_change":"2024-09-21T02:39:46.858255+0000","last_active":"2024-09-21T02:40:43.397507+0000","last_peered":"2024-09-21T02:40:43.397507+0000","last_clean":"2024-09-21T02:40:43.397507+0000","last_became_active":"2024-09-21T02:39:46.856726+0000","last_became_peered":"2024-09-21T02:39:46.856726+0000","last_unstale":"2024-09-21T02:40:43.397507+0000","last_undegraded":"2024-09-21T02:40:43.397507+0000","last_fullsized":"2024-09-21T02:40:43.397507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:33.890538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487741+0000","last_change":"2024-09-21T02:39:43.823562+0000","last_active":"2024-09-21T02:41:44.487741+0000","last_peered":"2024-09-21T02:41:44.487741+0000","last_clean":"2024-09-21T02:41:44.487741+0000","last_became_active":"2024-09-21T02:39:43.823142+0000","last_became_peered":"2024-09-21T02:39:43.823142+0000","last_unstale":"2024-09-21T02:41:44.487741+0000","last_undegraded":"2024-09-21T02:41:44.487741+0000","last_fullsized":"2024-09-21T02:41:44.487741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:36.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401814+0000","last_change":"2024-09-21T02:38:27.972237+0000","last_active":"2024-09-21T02:40:43.401814+0000","last_peered":"2024-09-21T02:40:43.401814+0000","last_clean":"2024-09-21T02:40:43.401814+0000","last_became_active":"2024-09-21T02:38:27.966297+0000","last_became_peered":"2024-09-21T02:38:27.966297+0000","last_unstale":"2024-09-21T02:40:43.401814+0000","last_undegraded":"2024-09-21T02:40:43.401814+0000","last_fullsized":"2024-09-21T02:40:43.401814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_clean_scrub_stamp":"2024-09-21T02:34:42.292034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:24.592682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402820+0000","last_change":"2024-09-21T02:39:56.930418+0000","last_active":"2024-09-21T02:40:43.402820+0000","last_peered":"2024-09-21T02:40:43.402820+0000","last_clean":"2024-09-21T02:40:43.402820+0000","last_became_active":"2024-09-21T02:39:56.929920+0000","last_became_peered":"2024-09-21T02:39:56.929920+0000","last_unstale":"2024-09-21T02:40:43.402820+0000","last_undegraded":"2024-09-21T02:40:43.402820+0000","last_fullsized":"2024-09-21T02:40:43.402820+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:15.195020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.403073+0000","last_change":"2024-09-21T02:39:46.851466+0000","last_active":"2024-09-21T02:40:43.403073+0000","last_peered":"2024-09-21T02:40:43.403073+0000","last_clean":"2024-09-21T02:40:43.403073+0000","last_became_active":"2024-09-21T02:39:46.849945+0000","last_became_peered":"2024-09-21T02:39:46.849945+0000","last_unstale":"2024-09-21T02:40:43.403073+0000","last_undegraded":"2024-09-21T02:40:43.403073+0000","last_fullsized":"2024-09-21T02:40:43.403073+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:07.424794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345104+0000","last_change":"2024-09-21T02:39:43.840894+0000","last_active":"2024-09-21T02:41:44.345104+0000","last_peered":"2024-09-21T02:41:44.345104+0000","last_clean":"2024-09-21T02:41:44.345104+0000","last_became_active":"2024-09-21T02:39:43.840437+0000","last_became_peered":"2024-09-21T02:39:43.840437+0000","last_unstale":"2024-09-21T02:41:44.345104+0000","last_undegraded":"2024-09-21T02:41:44.345104+0000","last_fullsized":"2024-09-21T02:41:44.345104+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:31.741218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486381+0000","last_change":"2024-09-21T02:39:56.924563+0000","last_active":"2024-09-21T02:41:44.486381+0000","last_peered":"2024-09-21T02:41:44.486381+0000","last_clean":"2024-09-21T02:41:44.486381+0000","last_became_active":"2024-09-21T02:39:56.923791+0000","last_became_peered":"2024-09-21T02:39:56.923791+0000","last_unstale":"2024-09-21T02:41:44.486381+0000","last_undegraded":"2024-09-21T02:41:44.486381+0000","last_fullsized":"2024-09-21T02:41:44.486381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:03.409737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402629+0000","last_change":"2024-09-21T02:39:46.858712+0000","last_active":"2024-09-21T02:40:43.402629+0000","last_peered":"2024-09-21T02:40:43.402629+0000","last_clean":"2024-09-21T02:40:43.402629+0000","last_became_active":"2024-09-21T02:39:46.858339+0000","last_became_peered":"2024-09-21T02:39:46.858339+0000","last_unstale":"2024-09-21T02:40:43.402629+0000","last_undegraded":"2024-09-21T02:40:43.402629+0000","last_fullsized":"2024-09-21T02:40:43.402629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.015904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.349126+0000","last_change":"2024-09-21T02:39:43.829127+0000","last_active":"2024-09-21T02:41:44.349126+0000","last_peered":"2024-09-21T02:41:44.349126+0000","last_clean":"2024-09-21T02:41:44.349126+0000","last_became_active":"2024-09-21T02:39:43.828136+0000","last_became_peered":"2024-09-21T02:39:43.828136+0000","last_unstale":"2024-09-21T02:41:44.349126+0000","last_undegraded":"2024-09-21T02:41:44.349126+0000","last_fullsized":"2024-09-21T02:41:44.349126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:39.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486559+0000","last_change":"2024-09-21T02:39:56.930823+0000","last_active":"2024-09-21T02:41:44.486559+0000","last_peered":"2024-09-21T02:41:44.486559+0000","last_clean":"2024-09-21T02:41:44.486559+0000","last_became_active":"2024-09-21T02:39:56.930379+0000","last_became_peered":"2024-09-21T02:39:56.930379+0000","last_unstale":"2024-09-21T02:41:44.486559+0000","last_undegraded":"2024-09-21T02:41:44.486559+0000","last_fullsized":"2024-09-21T02:41:44.486559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:01.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402678+0000","last_change":"2024-09-21T02:39:46.846873+0000","last_active":"2024-09-21T02:40:43.402678+0000","last_peered":"2024-09-21T02:40:43.402678+0000","last_clean":"2024-09-21T02:40:43.402678+0000","last_became_active":"2024-09-21T02:39:46.846502+0000","last_became_peered":"2024-09-21T02:39:46.846502+0000","last_unstale":"2024-09-21T02:40:43.402678+0000","last_undegraded":"2024-09-21T02:40:43.402678+0000","last_fullsized":"2024-09-21T02:40:43.402678+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:20.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346935+0000","last_change":"2024-09-21T02:39:43.832273+0000","last_active":"2024-09-21T02:41:44.346935+0000","last_peered":"2024-09-21T02:41:44.346935+0000","last_clean":"2024-09-21T02:41:44.346935+0000","last_became_active":"2024-09-21T02:39:43.831705+0000","last_became_peered":"2024-09-21T02:39:43.831705+0000","last_unstale":"2024-09-21T02:41:44.346935+0000","last_undegraded":"2024-09-21T02:41:44.346935+0000","last_fullsized":"2024-09-21T02:41:44.346935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:31.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.347957+0000","last_change":"2024-09-21T02:39:56.920277+0000","last_active":"2024-09-21T02:41:44.347957+0000","last_peered":"2024-09-21T02:41:44.347957+0000","last_clean":"2024-09-21T02:41:44.347957+0000","last_became_active":"2024-09-21T02:39:56.919885+0000","last_became_peered":"2024-09-21T02:39:56.919885+0000","last_unstale":"2024-09-21T02:41:44.347957+0000","last_undegraded":"2024-09-21T02:41:44.347957+0000","last_fullsized":"2024-09-21T02:41:44.347957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:32.750878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343513+0000","last_change":"2024-09-21T02:40:43.413459+0000","last_active":"2024-09-21T02:41:44.343513+0000","last_peered":"2024-09-21T02:41:44.343513+0000","last_clean":"2024-09-21T02:41:44.343513+0000","last_became_active":"2024-09-21T02:40:43.413012+0000","last_became_peered":"2024-09-21T02:40:43.413012+0000","last_unstale":"2024-09-21T02:41:44.343513+0000","last_undegraded":"2024-09-21T02:41:44.343513+0000","last_fullsized":"2024-09-21T02:41:44.343513+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:23.971450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697424+0000","last_change":"2024-09-21T02:39:43.821955+0000","last_active":"2024-09-21T02:41:44.697424+0000","last_peered":"2024-09-21T02:41:44.697424+0000","last_clean":"2024-09-21T02:41:44.697424+0000","last_became_active":"2024-09-21T02:39:43.820480+0000","last_became_peered":"2024-09-21T02:39:43.820480+0000","last_unstale":"2024-09-21T02:41:44.697424+0000","last_undegraded":"2024-09-21T02:41:44.697424+0000","last_fullsized":"2024-09-21T02:41:44.697424+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:51.201528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.347985+0000","last_change":"2024-09-21T02:39:56.922017+0000","last_active":"2024-09-21T02:41:44.347985+0000","last_peered":"2024-09-21T02:41:44.347985+0000","last_clean":"2024-09-21T02:41:44.347985+0000","last_became_active":"2024-09-21T02:39:56.921616+0000","last_became_peered":"2024-09-21T02:39:56.921616+0000","last_unstale":"2024-09-21T02:41:44.347985+0000","last_undegraded":"2024-09-21T02:41:44.347985+0000","last_fullsized":"2024-09-21T02:41:44.347985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:38.499302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348433+0000","last_change":"2024-09-21T02:39:46.855445+0000","last_active":"2024-09-21T02:41:44.348433+0000","last_peered":"2024-09-21T02:41:44.348433+0000","last_clean":"2024-09-21T02:41:44.348433+0000","last_became_active":"2024-09-21T02:39:46.855053+0000","last_became_peered":"2024-09-21T02:39:46.855053+0000","last_unstale":"2024-09-21T02:41:44.348433+0000","last_undegraded":"2024-09-21T02:41:44.348433+0000","last_fullsized":"2024-09-21T02:41:44.348433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:19.122862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696560+0000","last_change":"2024-09-21T02:39:43.822744+0000","last_active":"2024-09-21T02:41:44.696560+0000","last_peered":"2024-09-21T02:41:44.696560+0000","last_clean":"2024-09-21T02:41:44.696560+0000","last_became_active":"2024-09-21T02:39:43.822339+0000","last_became_peered":"2024-09-21T02:39:43.822339+0000","last_unstale":"2024-09-21T02:41:44.696560+0000","last_undegraded":"2024-09-21T02:41:44.696560+0000","last_fullsized":"2024-09-21T02:41:44.696560+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:21.370224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346926+0000","last_change":"2024-09-21T02:39:56.929280+0000","last_active":"2024-09-21T02:41:44.346926+0000","last_peered":"2024-09-21T02:41:44.346926+0000","last_clean":"2024-09-21T02:41:44.346926+0000","last_became_active":"2024-09-21T02:39:56.928826+0000","last_became_peered":"2024-09-21T02:39:56.928826+0000","last_unstale":"2024-09-21T02:41:44.346926+0000","last_undegraded":"2024-09-21T02:41:44.346926+0000","last_fullsized":"2024-09-21T02:41:44.346926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:01.597772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.401350+0000","last_change":"2024-09-21T02:39:46.852466+0000","last_active":"2024-09-21T02:40:43.401350+0000","last_peered":"2024-09-21T02:40:43.401350+0000","last_clean":"2024-09-21T02:40:43.401350+0000","last_became_active":"2024-09-21T02:39:46.852113+0000","last_became_peered":"2024-09-21T02:39:46.852113+0000","last_unstale":"2024-09-21T02:40:43.401350+0000","last_undegraded":"2024-09-21T02:40:43.401350+0000","last_fullsized":"2024-09-21T02:40:43.401350+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:26.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'4","reported_seq":115,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.511038+0000","last_change":"2024-09-21T02:39:43.822241+0000","last_active":"2024-09-21T02:41:44.511038+0000","last_peered":"2024-09-21T02:41:44.511038+0000","last_clean":"2024-09-21T02:41:44.511038+0000","last_became_active":"2024-09-21T02:39:43.820813+0000","last_became_peered":"2024-09-21T02:39:43.820813+0000","last_unstale":"2024-09-21T02:41:44.511038+0000","last_undegraded":"2024-09-21T02:41:44.511038+0000","last_fullsized":"2024-09-21T02:41:44.511038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:09.749207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697239+0000","last_change":"2024-09-21T02:40:43.405942+0000","last_active":"2024-09-21T02:41:44.697239+0000","last_peered":"2024-09-21T02:41:44.697239+0000","last_clean":"2024-09-21T02:41:44.697239+0000","last_became_active":"2024-09-21T02:40:43.405455+0000","last_became_peered":"2024-09-21T02:40:43.405455+0000","last_unstale":"2024-09-21T02:41:44.697239+0000","last_undegraded":"2024-09-21T02:41:44.697239+0000","last_fullsized":"2024-09-21T02:41:44.697239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:28.594724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.417584+0000","last_change":"2024-09-21T02:40:43.417498+0000","last_active":"2024-09-21T02:40:43.417584+0000","last_peered":"2024-09-21T02:40:43.417584+0000","last_clean":"2024-09-21T02:40:43.417584+0000","last_became_active":"2024-09-21T02:40:43.417203+0000","last_became_peered":"2024-09-21T02:40:43.417203+0000","last_unstale":"2024-09-21T02:40:43.417584+0000","last_undegraded":"2024-09-21T02:40:43.417584+0000","last_fullsized":"2024-09-21T02:40:43.417584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:43.618931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348561+0000","last_change":"2024-09-21T02:39:43.827493+0000","last_active":"2024-09-21T02:41:44.348561+0000","last_peered":"2024-09-21T02:41:44.348561+0000","last_clean":"2024-09-21T02:41:44.348561+0000","last_became_active":"2024-09-21T02:39:43.826824+0000","last_became_peered":"2024-09-21T02:39:43.826824+0000","last_unstale":"2024-09-21T02:41:44.348561+0000","last_undegraded":"2024-09-21T02:41:44.348561+0000","last_fullsized":"2024-09-21T02:41:44.348561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:21.320101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343116+0000","last_change":"2024-09-21T02:39:56.929122+0000","last_active":"2024-09-21T02:41:44.343116+0000","last_peered":"2024-09-21T02:41:44.343116+0000","last_clean":"2024-09-21T02:41:44.343116+0000","last_became_active":"2024-09-21T02:39:56.928633+0000","last_became_peered":"2024-09-21T02:39:56.928633+0000","last_unstale":"2024-09-21T02:41:44.343116+0000","last_undegraded":"2024-09-21T02:41:44.343116+0000","last_fullsized":"2024-09-21T02:41:44.343116+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:56.599982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346501+0000","last_change":"2024-09-21T02:39:46.866922+0000","last_active":"2024-09-21T02:41:44.346501+0000","last_peered":"2024-09-21T02:41:44.346501+0000","last_clean":"2024-09-21T02:41:44.346501+0000","last_became_active":"2024-09-21T02:39:46.866061+0000","last_became_peered":"2024-09-21T02:39:46.866061+0000","last_unstale":"2024-09-21T02:41:44.346501+0000","last_undegraded":"2024-09-21T02:41:44.346501+0000","last_fullsized":"2024-09-21T02:41:44.346501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:02.707212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344809+0000","last_change":"2024-09-21T02:39:43.824188+0000","last_active":"2024-09-21T02:41:44.344809+0000","last_peered":"2024-09-21T02:41:44.344809+0000","last_clean":"2024-09-21T02:41:44.344809+0000","last_became_active":"2024-09-21T02:39:43.823760+0000","last_became_peered":"2024-09-21T02:39:43.823760+0000","last_unstale":"2024-09-21T02:41:44.344809+0000","last_undegraded":"2024-09-21T02:41:44.344809+0000","last_fullsized":"2024-09-21T02:41:44.344809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:56.770947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348849+0000","last_change":"2024-09-21T02:39:56.920213+0000","last_active":"2024-09-21T02:41:44.348849+0000","last_peered":"2024-09-21T02:41:44.348849+0000","last_clean":"2024-09-21T02:41:44.348849+0000","last_became_active":"2024-09-21T02:39:56.919796+0000","last_became_peered":"2024-09-21T02:39:56.919796+0000","last_unstale":"2024-09-21T02:41:44.348849+0000","last_undegraded":"2024-09-21T02:41:44.348849+0000","last_fullsized":"2024-09-21T02:41:44.348849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:32.162844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697265+0000","last_change":"2024-09-21T02:39:46.846759+0000","last_active":"2024-09-21T02:41:44.697265+0000","last_peered":"2024-09-21T02:41:44.697265+0000","last_clean":"2024-09-21T02:41:44.697265+0000","last_became_active":"2024-09-21T02:39:46.846315+0000","last_became_peered":"2024-09-21T02:39:46.846315+0000","last_unstale":"2024-09-21T02:41:44.697265+0000","last_undegraded":"2024-09-21T02:41:44.697265+0000","last_fullsized":"2024-09-21T02:41:44.697265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:41.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'32","reported_seq":211,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:45.516643+0000","last_change":"2024-09-21T02:39:43.824564+0000","last_active":"2024-09-21T02:41:45.516643+0000","last_peered":"2024-09-21T02:41:45.516643+0000","last_clean":"2024-09-21T02:41:45.516643+0000","last_became_active":"2024-09-21T02:39:43.824190+0000","last_became_peered":"2024-09-21T02:39:43.824190+0000","last_unstale":"2024-09-21T02:41:45.516643+0000","last_undegraded":"2024-09-21T02:41:45.516643+0000","last_fullsized":"2024-09-21T02:41:45.516643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:45.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67138,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":132,"num_write":33,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348289+0000","last_change":"2024-09-21T02:39:56.928936+0000","last_active":"2024-09-21T02:41:44.348289+0000","last_peered":"2024-09-21T02:41:44.348289+0000","last_clean":"2024-09-21T02:41:44.348289+0000","last_became_active":"2024-09-21T02:39:56.927999+0000","last_became_peered":"2024-09-21T02:39:56.927999+0000","last_unstale":"2024-09-21T02:41:44.348289+0000","last_undegraded":"2024-09-21T02:41:44.348289+0000","last_fullsized":"2024-09-21T02:41:44.348289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:33.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487831+0000","last_change":"2024-09-21T02:39:46.860572+0000","last_active":"2024-09-21T02:41:44.487831+0000","last_peered":"2024-09-21T02:41:44.487831+0000","last_clean":"2024-09-21T02:41:44.487831+0000","last_became_active":"2024-09-21T02:39:46.860073+0000","last_became_peered":"2024-09-21T02:39:46.860073+0000","last_unstale":"2024-09-21T02:41:44.487831+0000","last_undegraded":"2024-09-21T02:41:44.487831+0000","last_fullsized":"2024-09-21T02:41:44.487831+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:48.355107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.349073+0000","last_change":"2024-09-21T02:39:43.828437+0000","last_active":"2024-09-21T02:41:44.349073+0000","last_peered":"2024-09-21T02:41:44.349073+0000","last_clean":"2024-09-21T02:41:44.349073+0000","last_became_active":"2024-09-21T02:39:43.828033+0000","last_became_peered":"2024-09-21T02:39:43.828033+0000","last_unstale":"2024-09-21T02:41:44.349073+0000","last_undegraded":"2024-09-21T02:41:44.349073+0000","last_fullsized":"2024-09-21T02:41:44.349073+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:24.065773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487293+0000","last_change":"2024-09-21T02:39:56.937714+0000","last_active":"2024-09-21T02:41:44.487293+0000","last_peered":"2024-09-21T02:41:44.487293+0000","last_clean":"2024-09-21T02:41:44.487293+0000","last_became_active":"2024-09-21T02:39:56.937145+0000","last_became_peered":"2024-09-21T02:39:56.937145+0000","last_unstale":"2024-09-21T02:41:44.487293+0000","last_undegraded":"2024-09-21T02:41:44.487293+0000","last_fullsized":"2024-09-21T02:41:44.487293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:59.265795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487337+0000","last_change":"2024-09-21T02:39:46.864600+0000","last_active":"2024-09-21T02:41:44.487337+0000","last_peered":"2024-09-21T02:41:44.487337+0000","last_clean":"2024-09-21T02:41:44.487337+0000","last_became_active":"2024-09-21T02:39:46.862043+0000","last_became_peered":"2024-09-21T02:39:46.862043+0000","last_unstale":"2024-09-21T02:41:44.487337+0000","last_undegraded":"2024-09-21T02:41:44.487337+0000","last_fullsized":"2024-09-21T02:41:44.487337+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.119974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402322+0000","last_change":"2024-09-21T02:39:43.825910+0000","last_active":"2024-09-21T02:40:43.402322+0000","last_peered":"2024-09-21T02:40:43.402322+0000","last_clean":"2024-09-21T02:40:43.402322+0000","last_became_active":"2024-09-21T02:39:43.825370+0000","last_became_peered":"2024-09-21T02:39:43.825370+0000","last_unstale":"2024-09-21T02:40:43.402322+0000","last_undegraded":"2024-09-21T02:40:43.402322+0000","last_fullsized":"2024-09-21T02:40:43.402322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:05.410114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.347960+0000","last_change":"2024-09-21T02:39:56.935321+0000","last_active":"2024-09-21T02:41:44.347960+0000","last_peered":"2024-09-21T02:41:44.347960+0000","last_clean":"2024-09-21T02:41:44.347960+0000","last_became_active":"2024-09-21T02:39:56.931669+0000","last_became_peered":"2024-09-21T02:39:56.931669+0000","last_unstale":"2024-09-21T02:41:44.347960+0000","last_undegraded":"2024-09-21T02:41:44.347960+0000","last_fullsized":"2024-09-21T02:41:44.347960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:20.323574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487990+0000","last_change":"2024-09-21T02:39:46.853469+0000","last_active":"2024-09-21T02:41:44.487990+0000","last_peered":"2024-09-21T02:41:44.487990+0000","last_clean":"2024-09-21T02:41:44.487990+0000","last_became_active":"2024-09-21T02:39:46.853133+0000","last_became_peered":"2024-09-21T02:39:46.853133+0000","last_unstale":"2024-09-21T02:41:44.487990+0000","last_undegraded":"2024-09-21T02:41:44.487990+0000","last_fullsized":"2024-09-21T02:41:44.487990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.055341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":112,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.511003+0000","last_change":"2024-09-21T02:39:43.828678+0000","last_active":"2024-09-21T02:41:44.511003+0000","last_peered":"2024-09-21T02:41:44.511003+0000","last_clean":"2024-09-21T02:41:44.511003+0000","last_became_active":"2024-09-21T02:39:43.828281+0000","last_became_peered":"2024-09-21T02:39:43.828281+0000","last_unstale":"2024-09-21T02:41:44.511003+0000","last_undegraded":"2024-09-21T02:41:44.511003+0000","last_fullsized":"2024-09-21T02:41:44.511003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:42.678028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397054+0000","last_change":"2024-09-21T02:39:56.920489+0000","last_active":"2024-09-21T02:40:43.397054+0000","last_peered":"2024-09-21T02:40:43.397054+0000","last_clean":"2024-09-21T02:40:43.397054+0000","last_became_active":"2024-09-21T02:39:56.920031+0000","last_became_peered":"2024-09-21T02:39:56.920031+0000","last_unstale":"2024-09-21T02:40:43.397054+0000","last_undegraded":"2024-09-21T02:40:43.397054+0000","last_fullsized":"2024-09-21T02:40:43.397054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:56.576113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486870+0000","last_change":"2024-09-21T02:39:56.922470+0000","last_active":"2024-09-21T02:41:44.486870+0000","last_peered":"2024-09-21T02:41:44.486870+0000","last_clean":"2024-09-21T02:41:44.486870+0000","last_became_active":"2024-09-21T02:39:56.922014+0000","last_became_peered":"2024-09-21T02:39:56.922014+0000","last_unstale":"2024-09-21T02:41:44.486870+0000","last_undegraded":"2024-09-21T02:41:44.486870+0000","last_fullsized":"2024-09-21T02:41:44.486870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:25.307835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348121+0000","last_change":"2024-09-21T02:39:46.852869+0000","last_active":"2024-09-21T02:41:44.348121+0000","last_peered":"2024-09-21T02:41:44.348121+0000","last_clean":"2024-09-21T02:41:44.348121+0000","last_became_active":"2024-09-21T02:39:46.852237+0000","last_became_peered":"2024-09-21T02:39:46.852237+0000","last_unstale":"2024-09-21T02:41:44.348121+0000","last_undegraded":"2024-09-21T02:41:44.348121+0000","last_fullsized":"2024-09-21T02:41:44.348121+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:10.729381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348311+0000","last_change":"2024-09-21T02:39:43.827358+0000","last_active":"2024-09-21T02:41:44.348311+0000","last_peered":"2024-09-21T02:41:44.348311+0000","last_clean":"2024-09-21T02:41:44.348311+0000","last_became_active":"2024-09-21T02:39:43.826910+0000","last_became_peered":"2024-09-21T02:39:43.826910+0000","last_unstale":"2024-09-21T02:41:44.348311+0000","last_undegraded":"2024-09-21T02:41:44.348311+0000","last_fullsized":"2024-09-21T02:41:44.348311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:48.528314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343548+0000","last_change":"2024-09-21T02:39:56.930809+0000","last_active":"2024-09-21T02:41:44.343548+0000","last_peered":"2024-09-21T02:41:44.343548+0000","last_clean":"2024-09-21T02:41:44.343548+0000","last_became_active":"2024-09-21T02:39:56.930355+0000","last_became_peered":"2024-09-21T02:39:56.930355+0000","last_unstale":"2024-09-21T02:41:44.343548+0000","last_undegraded":"2024-09-21T02:41:44.343548+0000","last_fullsized":"2024-09-21T02:41:44.343548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:41.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397031+0000","last_change":"2024-09-21T02:39:46.856046+0000","last_active":"2024-09-21T02:40:43.397031+0000","last_peered":"2024-09-21T02:40:43.397031+0000","last_clean":"2024-09-21T02:40:43.397031+0000","last_became_active":"2024-09-21T02:39:46.855675+0000","last_became_peered":"2024-09-21T02:39:46.855675+0000","last_unstale":"2024-09-21T02:40:43.397031+0000","last_undegraded":"2024-09-21T02:40:43.397031+0000","last_fullsized":"2024-09-21T02:40:43.397031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.547082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346350+0000","last_change":"2024-09-21T02:39:43.828888+0000","last_active":"2024-09-21T02:41:44.346350+0000","last_peered":"2024-09-21T02:41:44.346350+0000","last_clean":"2024-09-21T02:41:44.346350+0000","last_became_active":"2024-09-21T02:39:43.828340+0000","last_became_peered":"2024-09-21T02:39:43.828340+0000","last_unstale":"2024-09-21T02:41:44.346350+0000","last_undegraded":"2024-09-21T02:41:44.346350+0000","last_fullsized":"2024-09-21T02:41:44.346350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:09.017191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487166+0000","last_change":"2024-09-21T02:39:43.828957+0000","last_active":"2024-09-21T02:41:44.487166+0000","last_peered":"2024-09-21T02:41:44.487166+0000","last_clean":"2024-09-21T02:41:44.487166+0000","last_became_active":"2024-09-21T02:39:43.827899+0000","last_became_peered":"2024-09-21T02:39:43.827899+0000","last_unstale":"2024-09-21T02:41:44.487166+0000","last_undegraded":"2024-09-21T02:41:44.487166+0000","last_fullsized":"2024-09-21T02:41:44.487166+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:36.727082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348600+0000","last_change":"2024-09-21T02:39:46.855278+0000","last_active":"2024-09-21T02:41:44.348600+0000","last_peered":"2024-09-21T02:41:44.348600+0000","last_clean":"2024-09-21T02:41:44.348600+0000","last_became_active":"2024-09-21T02:39:46.854905+0000","last_became_peered":"2024-09-21T02:39:46.854905+0000","last_unstale":"2024-09-21T02:41:44.348600+0000","last_undegraded":"2024-09-21T02:41:44.348600+0000","last_fullsized":"2024-09-21T02:41:44.348600+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.244912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344659+0000","last_change":"2024-09-21T02:39:56.931183+0000","last_active":"2024-09-21T02:41:44.344659+0000","last_peered":"2024-09-21T02:41:44.344659+0000","last_clean":"2024-09-21T02:41:44.344659+0000","last_became_active":"2024-09-21T02:39:56.930776+0000","last_became_peered":"2024-09-21T02:39:56.930776+0000","last_unstale":"2024-09-21T02:41:44.344659+0000","last_undegraded":"2024-09-21T02:41:44.344659+0000","last_fullsized":"2024-09-21T02:41:44.344659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:56.272272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.511651+0000","last_change":"2024-09-21T02:39:43.823668+0000","last_active":"2024-09-21T02:41:44.511651+0000","last_peered":"2024-09-21T02:41:44.511651+0000","last_clean":"2024-09-21T02:41:44.511651+0000","last_became_active":"2024-09-21T02:39:43.823132+0000","last_became_peered":"2024-09-21T02:39:43.823132+0000","last_unstale":"2024-09-21T02:41:44.511651+0000","last_undegraded":"2024-09-21T02:41:44.511651+0000","last_fullsized":"2024-09-21T02:41:44.511651+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:33.187554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696735+0000","last_change":"2024-09-21T02:39:46.845740+0000","last_active":"2024-09-21T02:41:44.696735+0000","last_peered":"2024-09-21T02:41:44.696735+0000","last_clean":"2024-09-21T02:41:44.696735+0000","last_became_active":"2024-09-21T02:39:46.845361+0000","last_became_peered":"2024-09-21T02:39:46.845361+0000","last_unstale":"2024-09-21T02:41:44.696735+0000","last_undegraded":"2024-09-21T02:41:44.696735+0000","last_fullsized":"2024-09-21T02:41:44.696735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.546769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344879+0000","last_change":"2024-09-21T02:39:56.919760+0000","last_active":"2024-09-21T02:41:44.344879+0000","last_peered":"2024-09-21T02:41:44.344879+0000","last_clean":"2024-09-21T02:41:44.344879+0000","last_became_active":"2024-09-21T02:39:56.919315+0000","last_became_peered":"2024-09-21T02:39:56.919315+0000","last_unstale":"2024-09-21T02:41:44.344879+0000","last_undegraded":"2024-09-21T02:41:44.344879+0000","last_fullsized":"2024-09-21T02:41:44.344879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:52.889707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342790+0000","last_change":"2024-09-21T02:39:46.848040+0000","last_active":"2024-09-21T02:41:44.342790+0000","last_peered":"2024-09-21T02:41:44.342790+0000","last_clean":"2024-09-21T02:41:44.342790+0000","last_became_active":"2024-09-21T02:39:46.847627+0000","last_became_peered":"2024-09-21T02:39:46.847627+0000","last_unstale":"2024-09-21T02:41:44.342790+0000","last_undegraded":"2024-09-21T02:41:44.342790+0000","last_fullsized":"2024-09-21T02:41:44.342790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:14.139156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345559+0000","last_change":"2024-09-21T02:39:46.853208+0000","last_active":"2024-09-21T02:41:44.345559+0000","last_peered":"2024-09-21T02:41:44.345559+0000","last_clean":"2024-09-21T02:41:44.345559+0000","last_became_active":"2024-09-21T02:39:46.852821+0000","last_became_peered":"2024-09-21T02:39:46.852821+0000","last_unstale":"2024-09-21T02:41:44.345559+0000","last_undegraded":"2024-09-21T02:41:44.345559+0000","last_fullsized":"2024-09-21T02:41:44.345559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:24.597702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344589+0000","last_change":"2024-09-21T02:39:46.866239+0000","last_active":"2024-09-21T02:41:44.344589+0000","last_peered":"2024-09-21T02:41:44.344589+0000","last_clean":"2024-09-21T02:41:44.344589+0000","last_became_active":"2024-09-21T02:39:46.865935+0000","last_became_peered":"2024-09-21T02:39:46.865935+0000","last_unstale":"2024-09-21T02:41:44.344589+0000","last_undegraded":"2024-09-21T02:41:44.344589+0000","last_fullsized":"2024-09-21T02:41:44.344589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.420521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486613+0000","last_change":"2024-09-21T02:39:46.861857+0000","last_active":"2024-09-21T02:41:44.486613+0000","last_peered":"2024-09-21T02:41:44.486613+0000","last_clean":"2024-09-21T02:41:44.486613+0000","last_became_active":"2024-09-21T02:39:46.861512+0000","last_became_peered":"2024-09-21T02:39:46.861512+0000","last_unstale":"2024-09-21T02:41:44.486613+0000","last_undegraded":"2024-09-21T02:41:44.486613+0000","last_fullsized":"2024-09-21T02:41:44.486613+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.044159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346757+0000","last_change":"2024-09-21T02:39:46.858655+0000","last_active":"2024-09-21T02:41:44.346757+0000","last_peered":"2024-09-21T02:41:44.346757+0000","last_clean":"2024-09-21T02:41:44.346757+0000","last_became_active":"2024-09-21T02:39:46.858376+0000","last_became_peered":"2024-09-21T02:39:46.858376+0000","last_unstale":"2024-09-21T02:41:44.346757+0000","last_undegraded":"2024-09-21T02:41:44.346757+0000","last_fullsized":"2024-09-21T02:41:44.346757+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:16.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343468+0000","last_change":"2024-09-21T02:39:46.847973+0000","last_active":"2024-09-21T02:41:44.343468+0000","last_peered":"2024-09-21T02:41:44.343468+0000","last_clean":"2024-09-21T02:41:44.343468+0000","last_became_active":"2024-09-21T02:39:46.846957+0000","last_became_peered":"2024-09-21T02:39:46.846957+0000","last_unstale":"2024-09-21T02:41:44.343468+0000","last_undegraded":"2024-09-21T02:41:44.343468+0000","last_fullsized":"2024-09-21T02:41:44.343468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:44.077854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345212+0000","last_change":"2024-09-21T02:39:46.851310+0000","last_active":"2024-09-21T02:41:44.345212+0000","last_peered":"2024-09-21T02:41:44.345212+0000","last_clean":"2024-09-21T02:41:44.345212+0000","last_became_active":"2024-09-21T02:39:46.850666+0000","last_became_peered":"2024-09-21T02:39:46.850666+0000","last_unstale":"2024-09-21T02:41:44.345212+0000","last_undegraded":"2024-09-21T02:41:44.345212+0000","last_fullsized":"2024-09-21T02:41:44.345212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:48.354795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.398248+0000","last_change":"2024-09-21T02:39:46.857409+0000","last_active":"2024-09-21T02:40:43.398248+0000","last_peered":"2024-09-21T02:40:43.398248+0000","last_clean":"2024-09-21T02:40:43.398248+0000","last_became_active":"2024-09-21T02:39:46.856974+0000","last_became_peered":"2024-09-21T02:39:46.856974+0000","last_unstale":"2024-09-21T02:40:43.398248+0000","last_undegraded":"2024-09-21T02:40:43.398248+0000","last_fullsized":"2024-09-21T02:40:43.398248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.140154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348091+0000","last_change":"2024-09-21T02:39:46.844168+0000","last_active":"2024-09-21T02:41:44.348091+0000","last_peered":"2024-09-21T02:41:44.348091+0000","last_clean":"2024-09-21T02:41:44.348091+0000","last_became_active":"2024-09-21T02:39:46.843509+0000","last_became_peered":"2024-09-21T02:39:46.843509+0000","last_unstale":"2024-09-21T02:41:44.348091+0000","last_undegraded":"2024-09-21T02:41:44.348091+0000","last_fullsized":"2024-09-21T02:41:44.348091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.899890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.397174+0000","last_change":"2024-09-21T02:39:46.854805+0000","last_active":"2024-09-21T02:40:43.397174+0000","last_peered":"2024-09-21T02:40:43.397174+0000","last_clean":"2024-09-21T02:40:43.397174+0000","last_became_active":"2024-09-21T02:39:46.850248+0000","last_became_peered":"2024-09-21T02:39:46.850248+0000","last_unstale":"2024-09-21T02:40:43.397174+0000","last_undegraded":"2024-09-21T02:40:43.397174+0000","last_fullsized":"2024-09-21T02:40:43.397174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:45.628337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487301+0000","last_change":"2024-09-21T02:39:46.866278+0000","last_active":"2024-09-21T02:41:44.487301+0000","last_peered":"2024-09-21T02:41:44.487301+0000","last_clean":"2024-09-21T02:41:44.487301+0000","last_became_active":"2024-09-21T02:39:46.865810+0000","last_became_peered":"2024-09-21T02:39:46.865810+0000","last_unstale":"2024-09-21T02:41:44.487301+0000","last_undegraded":"2024-09-21T02:41:44.487301+0000","last_fullsized":"2024-09-21T02:41:44.487301+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.754340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346658+0000","last_change":"2024-09-21T02:39:46.857721+0000","last_active":"2024-09-21T02:41:44.346658+0000","last_peered":"2024-09-21T02:41:44.346658+0000","last_clean":"2024-09-21T02:41:44.346658+0000","last_became_active":"2024-09-21T02:39:46.853640+0000","last_became_peered":"2024-09-21T02:39:46.853640+0000","last_unstale":"2024-09-21T02:41:44.346658+0000","last_undegraded":"2024-09-21T02:41:44.346658+0000","last_fullsized":"2024-09-21T02:41:44.346658+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:54.019607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343180+0000","last_change":"2024-09-21T02:40:43.413457+0000","last_active":"2024-09-21T02:41:44.343180+0000","last_peered":"2024-09-21T02:41:44.343180+0000","last_clean":"2024-09-21T02:41:44.343180+0000","last_became_active":"2024-09-21T02:40:43.413000+0000","last_became_peered":"2024-09-21T02:40:43.413000+0000","last_unstale":"2024-09-21T02:41:44.343180+0000","last_undegraded":"2024-09-21T02:41:44.343180+0000","last_fullsized":"2024-09-21T02:41:44.343180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:27.775410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345025+0000","last_change":"2024-09-21T02:39:46.857169+0000","last_active":"2024-09-21T02:41:44.345025+0000","last_peered":"2024-09-21T02:41:44.345025+0000","last_clean":"2024-09-21T02:41:44.345025+0000","last_became_active":"2024-09-21T02:39:46.856757+0000","last_became_peered":"2024-09-21T02:39:46.856757+0000","last_unstale":"2024-09-21T02:41:44.345025+0000","last_undegraded":"2024-09-21T02:41:44.345025+0000","last_fullsized":"2024-09-21T02:41:44.345025+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:36.729746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348647+0000","last_change":"2024-09-21T02:39:46.854162+0000","last_active":"2024-09-21T02:41:44.348647+0000","last_peered":"2024-09-21T02:41:44.348647+0000","last_clean":"2024-09-21T02:41:44.348647+0000","last_became_active":"2024-09-21T02:39:46.853697+0000","last_became_peered":"2024-09-21T02:39:46.853697+0000","last_unstale":"2024-09-21T02:41:44.348647+0000","last_undegraded":"2024-09-21T02:41:44.348647+0000","last_fullsized":"2024-09-21T02:41:44.348647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.605606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343800+0000","last_change":"2024-09-21T02:39:46.853570+0000","last_active":"2024-09-21T02:41:44.343800+0000","last_peered":"2024-09-21T02:41:44.343800+0000","last_clean":"2024-09-21T02:41:44.343800+0000","last_became_active":"2024-09-21T02:39:46.853074+0000","last_became_peered":"2024-09-21T02:39:46.853074+0000","last_unstale":"2024-09-21T02:41:44.343800+0000","last_undegraded":"2024-09-21T02:41:44.343800+0000","last_fullsized":"2024-09-21T02:41:44.343800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:02.642887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486215+0000","last_change":"2024-09-21T02:39:46.850070+0000","last_active":"2024-09-21T02:41:44.486215+0000","last_peered":"2024-09-21T02:41:44.486215+0000","last_clean":"2024-09-21T02:41:44.486215+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:41:44.486215+0000","last_undegraded":"2024-09-21T02:41:44.486215+0000","last_fullsized":"2024-09-21T02:41:44.486215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:59.185574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486368+0000","last_change":"2024-09-21T02:40:43.403735+0000","last_active":"2024-09-21T02:41:44.486368+0000","last_peered":"2024-09-21T02:41:44.486368+0000","last_clean":"2024-09-21T02:41:44.486368+0000","last_became_active":"2024-09-21T02:40:43.403330+0000","last_became_peered":"2024-09-21T02:40:43.403330+0000","last_unstale":"2024-09-21T02:41:44.486368+0000","last_undegraded":"2024-09-21T02:41:44.486368+0000","last_fullsized":"2024-09-21T02:41:44.486368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:35.043475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486318+0000","last_change":"2024-09-21T02:39:46.850811+0000","last_active":"2024-09-21T02:41:44.486318+0000","last_peered":"2024-09-21T02:41:44.486318+0000","last_clean":"2024-09-21T02:41:44.486318+0000","last_became_active":"2024-09-21T02:39:46.850423+0000","last_became_peered":"2024-09-21T02:39:46.850423+0000","last_unstale":"2024-09-21T02:41:44.486318+0000","last_undegraded":"2024-09-21T02:41:44.486318+0000","last_fullsized":"2024-09-21T02:41:44.486318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:47.343607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346623+0000","last_change":"2024-09-21T02:39:46.851169+0000","last_active":"2024-09-21T02:41:44.346623+0000","last_peered":"2024-09-21T02:41:44.346623+0000","last_clean":"2024-09-21T02:41:44.346623+0000","last_became_active":"2024-09-21T02:39:46.850258+0000","last_became_peered":"2024-09-21T02:39:46.850258+0000","last_unstale":"2024-09-21T02:41:44.346623+0000","last_undegraded":"2024-09-21T02:41:44.346623+0000","last_fullsized":"2024-09-21T02:41:44.346623+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:02.588325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487706+0000","last_change":"2024-09-21T02:39:46.854082+0000","last_active":"2024-09-21T02:41:44.487706+0000","last_peered":"2024-09-21T02:41:44.487706+0000","last_clean":"2024-09-21T02:41:44.487706+0000","last_became_active":"2024-09-21T02:39:46.852226+0000","last_became_peered":"2024-09-21T02:39:46.852226+0000","last_unstale":"2024-09-21T02:41:44.487706+0000","last_undegraded":"2024-09-21T02:41:44.487706+0000","last_fullsized":"2024-09-21T02:41:44.487706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:41.960472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402990+0000","last_change":"2024-09-21T02:39:46.856222+0000","last_active":"2024-09-21T02:40:43.402990+0000","last_peered":"2024-09-21T02:40:43.402990+0000","last_clean":"2024-09-21T02:40:43.402990+0000","last_became_active":"2024-09-21T02:39:46.855868+0000","last_became_peered":"2024-09-21T02:39:46.855868+0000","last_unstale":"2024-09-21T02:40:43.402990+0000","last_undegraded":"2024-09-21T02:40:43.402990+0000","last_fullsized":"2024-09-21T02:40:43.402990+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:31.396030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486838+0000","last_change":"2024-09-21T02:39:46.862312+0000","last_active":"2024-09-21T02:41:44.486838+0000","last_peered":"2024-09-21T02:41:44.486838+0000","last_clean":"2024-09-21T02:41:44.486838+0000","last_became_active":"2024-09-21T02:39:46.861921+0000","last_became_peered":"2024-09-21T02:39:46.861921+0000","last_unstale":"2024-09-21T02:41:44.486838+0000","last_undegraded":"2024-09-21T02:41:44.486838+0000","last_fullsized":"2024-09-21T02:41:44.486838+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:33.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.488244+0000","last_change":"2024-09-21T02:39:46.851155+0000","last_active":"2024-09-21T02:41:44.488244+0000","last_peered":"2024-09-21T02:41:44.488244+0000","last_clean":"2024-09-21T02:41:44.488244+0000","last_became_active":"2024-09-21T02:39:46.850809+0000","last_became_peered":"2024-09-21T02:39:46.850809+0000","last_unstale":"2024-09-21T02:41:44.488244+0000","last_undegraded":"2024-09-21T02:41:44.488244+0000","last_fullsized":"2024-09-21T02:41:44.488244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.396921+0000","last_change":"2024-09-21T02:39:46.850585+0000","last_active":"2024-09-21T02:40:43.396921+0000","last_peered":"2024-09-21T02:40:43.396921+0000","last_clean":"2024-09-21T02:40:43.396921+0000","last_became_active":"2024-09-21T02:39:46.850114+0000","last_became_peered":"2024-09-21T02:39:46.850114+0000","last_unstale":"2024-09-21T02:40:43.396921+0000","last_undegraded":"2024-09-21T02:40:43.396921+0000","last_fullsized":"2024-09-21T02:40:43.396921+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:04.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-21T02:40:43.402958+0000","last_change":"2024-09-21T02:39:46.850416+0000","last_active":"2024-09-21T02:40:43.402958+0000","last_peered":"2024-09-21T02:40:43.402958+0000","last_clean":"2024-09-21T02:40:43.402958+0000","last_became_active":"2024-09-21T02:39:46.850035+0000","last_became_peered":"2024-09-21T02:39:46.850035+0000","last_unstale":"2024-09-21T02:40:43.402958+0000","last_undegraded":"2024-09-21T02:40:43.402958+0000","last_fullsized":"2024-09-21T02:40:43.402958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:09.139331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487040+0000","last_change":"2024-09-21T02:39:46.861376+0000","last_active":"2024-09-21T02:41:44.487040+0000","last_peered":"2024-09-21T02:41:44.487040+0000","last_clean":"2024-09-21T02:41:44.487040+0000","last_became_active":"2024-09-21T02:39:46.861011+0000","last_became_peered":"2024-09-21T02:39:46.861011+0000","last_unstale":"2024-09-21T02:41:44.487040+0000","last_undegraded":"2024-09-21T02:41:44.487040+0000","last_fullsized":"2024-09-21T02:41:44.487040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:45.123705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696726+0000","last_change":"2024-09-21T02:39:46.846135+0000","last_active":"2024-09-21T02:41:44.696726+0000","last_peered":"2024-09-21T02:41:44.696726+0000","last_clean":"2024-09-21T02:41:44.696726+0000","last_became_active":"2024-09-21T02:39:46.845693+0000","last_became_peered":"2024-09-21T02:39:46.845693+0000","last_unstale":"2024-09-21T02:41:44.696726+0000","last_undegraded":"2024-09-21T02:41:44.696726+0000","last_fullsized":"2024-09-21T02:41:44.696726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:55.830932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487799+0000","last_change":"2024-09-21T02:39:46.853300+0000","last_active":"2024-09-21T02:41:44.487799+0000","last_peered":"2024-09-21T02:41:44.487799+0000","last_clean":"2024-09-21T02:41:44.487799+0000","last_became_active":"2024-09-21T02:39:46.852953+0000","last_became_peered":"2024-09-21T02:39:46.852953+0000","last_unstale":"2024-09-21T02:41:44.487799+0000","last_undegraded":"2024-09-21T02:41:44.487799+0000","last_fullsized":"2024-09-21T02:41:44.487799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:04.475743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486783+0000","last_change":"2024-09-21T02:39:46.854976+0000","last_active":"2024-09-21T02:41:44.486783+0000","last_peered":"2024-09-21T02:41:44.486783+0000","last_clean":"2024-09-21T02:41:44.486783+0000","last_became_active":"2024-09-21T02:39:46.852970+0000","last_became_peered":"2024-09-21T02:39:46.852970+0000","last_unstale":"2024-09-21T02:41:44.486783+0000","last_undegraded":"2024-09-21T02:41:44.486783+0000","last_fullsized":"2024-09-21T02:41:44.486783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:54.654967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486998+0000","last_change":"2024-09-21T02:39:46.848698+0000","last_active":"2024-09-21T02:41:44.486998+0000","last_peered":"2024-09-21T02:41:44.486998+0000","last_clean":"2024-09-21T02:41:44.486998+0000","last_became_active":"2024-09-21T02:39:46.848374+0000","last_became_peered":"2024-09-21T02:39:46.848374+0000","last_unstale":"2024-09-21T02:41:44.486998+0000","last_undegraded":"2024-09-21T02:41:44.486998+0000","last_fullsized":"2024-09-21T02:41:44.486998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:59.589062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343728+0000","last_change":"2024-09-21T02:39:46.851850+0000","last_active":"2024-09-21T02:41:44.343728+0000","last_peered":"2024-09-21T02:41:44.343728+0000","last_clean":"2024-09-21T02:41:44.343728+0000","last_became_active":"2024-09-21T02:39:46.851408+0000","last_became_peered":"2024-09-21T02:39:46.851408+0000","last_unstale":"2024-09-21T02:41:44.343728+0000","last_undegraded":"2024-09-21T02:41:44.343728+0000","last_fullsized":"2024-09-21T02:41:44.343728+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:27.831504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71530,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":410,"num_read_kb":280,"num_write":167,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":214590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1015808,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939691,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1716224,"data_stored":1169598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103216,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":510941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1015808,"data_stored":501495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495675,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1593344,"data_stored":1088387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659202,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1011712,"data_stored":506117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855432,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1098262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":511158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":487537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1110016,"data_stored":574906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1085440,"data_stored":573165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":507505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:41:49.900 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T02:41:49.900 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T02:41:49.900 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T02:41:49.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T02:41:50.308 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:50.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:50 smithi084 ceph-mon[30747]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:50.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:50 smithi084 ceph-mon[30747]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T02:41:50.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:41:50.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:41:50.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:50 smithi172 ceph-mon[35067]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:50 smithi172 ceph-mon[35067]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T02:41:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:41:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:41:50.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:50 smithi090 ceph-mon[34571]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:41:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:50 smithi090 ceph-mon[34571]: pgmap v382: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T02:41:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:41:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:41:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:41:50.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 -- 172.21.15.84:0/3245602408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4077380 msgr2=0x7f7fd40757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:50.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 --2- 172.21.15.84:0/3245602408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4077380 0x7f7fd40757b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009860 tx=0x7f7fc802a340 comp rx=0 tx=0).stop 2024-09-21T02:41:50.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 -- 172.21.15.84:0/3245602408 shutdown_connections 2024-09-21T02:41:50.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 --2- 172.21.15.84:0/3245602408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4114280 0x7f7fd4116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:50.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 --2- 172.21.15.84:0/3245602408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd4075dd0 0x7f7fd40761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:50.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 --2- 172.21.15.84:0/3245602408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4077380 0x7f7fd40757b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:50.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 -- 172.21.15.84:0/3245602408 >> 172.21.15.84:0/3245602408 conn(0x7f7fd40ff440 msgr2=0x7f7fd4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:50.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 -- 172.21.15.84:0/3245602408 shutdown_connections 2024-09-21T02:41:50.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.919+0000 7f7fda200640 1 -- 172.21.15.84:0/3245602408 wait complete. 2024-09-21T02:41:50.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.920+0000 7f7fda200640 1 Processor -- start 2024-09-21T02:41:50.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fda200640 1 -- start start 2024-09-21T02:41:50.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fda200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4075dd0 0x7f7fd41a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:50.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fda200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4077380 0x7f7fd41a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:50.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fda200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd4114280 0x7f7fd41a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fda200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4119fe0 con 0x7f7fd4075dd0 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fda200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4119e60 con 0x7f7fd4114280 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fda200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd411a160 con 0x7f7fd4077380 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fd8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4075dd0 0x7f7fd41a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fd8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4075dd0 0x7f7fd41a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33524/0 (socket says 172.21.15.84:33524) 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fd8e00640 1 -- 172.21.15.84:0/4121178865 learned_addr learned my addr 172.21.15.84:0/4121178865 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fd3e00640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4077380 0x7f7fd41a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.921+0000 7f7fd9800640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd4114280 0x7f7fd41a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd8e00640 1 -- 172.21.15.84:0/4121178865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4077380 msgr2=0x7f7fd41a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd8e00640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4077380 0x7f7fd41a0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd8e00640 1 -- 172.21.15.84:0/4121178865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd4114280 msgr2=0x7f7fd41a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd8e00640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd4114280 0x7f7fd41a6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:50.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd8e00640 1 -- 172.21.15.84:0/4121178865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd41a6940 con 0x7f7fd4075dd0 2024-09-21T02:41:50.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd8e00640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4075dd0 0x7f7fd41a09d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8035040 tx=0x7f7fc802af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:50.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd1600640 1 -- 172.21.15.84:0/4121178865 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc803f020 con 0x7f7fd4075dd0 2024-09-21T02:41:50.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd1600640 1 -- 172.21.15.84:0/4121178865 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7fc8033e50 con 0x7f7fd4075dd0 2024-09-21T02:41:50.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.922+0000 7f7fd1600640 1 -- 172.21.15.84:0/4121178865 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8037040 con 0x7f7fd4075dd0 2024-09-21T02:41:50.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.923+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd41a6bd0 con 0x7f7fd4075dd0 2024-09-21T02:41:50.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.923+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd41ad390 con 0x7f7fd4075dd0 2024-09-21T02:41:50.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.924+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd4076cc0 con 0x7f7fd4075dd0 2024-09-21T02:41:50.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.926+0000 7f7fd1600640 1 -- 172.21.15.84:0/4121178865 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7fc8042020 con 0x7f7fd4075dd0 2024-09-21T02:41:50.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.927+0000 7f7fd1600640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fbc0b6620 0x7f7fbc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:50.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.928+0000 7f7fd1600640 1 -- 172.21.15.84:0/4121178865 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f7fc81074d0 con 0x7f7fd4075dd0 2024-09-21T02:41:50.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.928+0000 7f7fd3e00640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fbc0b6620 0x7f7fbc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:50.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.928+0000 7f7fd3e00640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fbc0b6620 0x7f7fbc0b8b30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00095f0 tx=0x7f7fc0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:50.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:50.932+0000 7f7fd1600640 1 -- 172.21.15.84:0/4121178865 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fc8049020 con 0x7f7fd4075dd0 2024-09-21T02:41:51.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.158+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7fd40761e0 con 0x7f7fd4075dd0 2024-09-21T02:41:51.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.158+0000 7f7fd1600640 1 -- 172.21.15.84:0/4121178865 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7fc80cd810 con 0x7f7fd4075dd0 2024-09-21T02:41:51.160 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:51.160 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T02:41:51.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fbc0b6620 msgr2=0x7f7fbc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fbc0b6620 0x7f7fbc0b8b30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00095f0 tx=0x7f7fc0005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4075dd0 msgr2=0x7f7fd41a09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4075dd0 0x7f7fd41a09d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8035040 tx=0x7f7fc802af30 comp rx=0 tx=0).stop 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 shutdown_connections 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fbc0b6620 0x7f7fbc0b8b30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd4077380 0x7f7fd41a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd4114280 0x7f7fd41a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 --2- 172.21.15.84:0/4121178865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4075dd0 0x7f7fd41a09d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 >> 172.21.15.84:0/4121178865 conn(0x7f7fd40ff440 msgr2=0x7f7fd4110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 shutdown_connections 2024-09-21T02:41:51.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:51.161+0000 7f7fda200640 1 -- 172.21.15.84:0/4121178865 wait complete. 2024-09-21T02:41:51.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:51 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4121178865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:41:51.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:51 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4121178865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:41:51.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:51 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4121178865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T02:41:51.899 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T02:41:51.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:41:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:52.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:52 smithi172 ceph-mon[35067]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T02:41:52.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:52 smithi084 ceph-mon[30747]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T02:41:52.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:52 smithi090 ceph-mon[34571]: pgmap v383: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 -- 172.21.15.84:0/986795586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 msgr2=0x7fda38110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 --2- 172.21.15.84:0/986795586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 0x7fda38110320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fda30009ca0 tx=0x7fda3002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 -- 172.21.15.84:0/986795586 shutdown_connections 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 --2- 172.21.15.84:0/986795586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda38105320 0x7fda3810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 --2- 172.21.15.84:0/986795586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 0x7fda38110320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 --2- 172.21.15.84:0/986795586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda381049d0 0x7fda38104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 -- 172.21.15.84:0/986795586 >> 172.21.15.84:0/986795586 conn(0x7fda38079740 msgr2=0x7fda38079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 -- 172.21.15.84:0/986795586 shutdown_connections 2024-09-21T02:41:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.902+0000 7fda3dc00640 1 -- 172.21.15.84:0/986795586 wait complete. 2024-09-21T02:41:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.903+0000 7fda3dc00640 1 Processor -- start 2024-09-21T02:41:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda3dc00640 1 -- start start 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda3dc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda381049d0 0x7fda38102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda3dc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda38105320 0x7fda38102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda3dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 0x7fda38103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda3dc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fda38113bf0 con 0x7fda3810de30 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda3dc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda38113a70 con 0x7fda38105320 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda3dc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda38113d70 con 0x7fda381049d0 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda37400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 0x7fda38103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda36a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda381049d0 0x7fda38102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda36a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda381049d0 0x7fda38102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49062/0 (socket says 172.21.15.84:49062) 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda2e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda38105320 0x7fda38102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.904+0000 7fda36a00640 1 -- 172.21.15.84:0/2456964819 learned_addr learned my addr 172.21.15.84:0/2456964819 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:52.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.905+0000 7fda36a00640 1 -- 172.21.15.84:0/2456964819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda38105320 msgr2=0x7fda38102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:52.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.905+0000 7fda36a00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda38105320 0x7fda38102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.905+0000 7fda36a00640 1 -- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 msgr2=0x7fda38103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.905+0000 7fda36a00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 0x7fda38103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.905+0000 7fda36a00640 1 -- 172.21.15.84:0/2456964819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda381a8840 con 0x7fda381049d0 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.905+0000 7fda2e000640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda38105320 0x7fda38102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.905+0000 7fda37400640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 0x7fda38103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.905+0000 7fda36a00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda381049d0 0x7fda38102710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fda2800e9c0 tx=0x7fda2800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.906+0000 7fda2fe00640 1 -- 172.21.15.84:0/2456964819 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2800cd80 con 0x7fda381049d0 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.906+0000 7fda2fe00640 1 -- 172.21.15.84:0/2456964819 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fda280035f0 con 0x7fda381049d0 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.906+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda381a8b30 con 0x7fda381049d0 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.906+0000 7fda2fe00640 1 -- 172.21.15.84:0/2456964819 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28010690 con 0x7fda381049d0 2024-09-21T02:41:52.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.906+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda381a9070 con 0x7fda381049d0 2024-09-21T02:41:52.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.907+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3806c240 con 0x7fda381049d0 2024-09-21T02:41:52.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.909+0000 7fda2fe00640 1 -- 172.21.15.84:0/2456964819 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fda280037a0 con 0x7fda381049d0 2024-09-21T02:41:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.911+0000 7fda2fe00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fda1c0b65a0 0x7fda1c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.911+0000 7fda2fe00640 1 -- 172.21.15.84:0/2456964819 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fda280e7d00 con 0x7fda381049d0 2024-09-21T02:41:52.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.911+0000 7fda2e000640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fda1c0b65a0 0x7fda1c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:52.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.912+0000 7fda2e000640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fda1c0b65a0 0x7fda1c0b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fda3810faf0 tx=0x7fda20005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:52.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:52.913+0000 7fda2fe00640 1 -- 172.21.15.84:0/2456964819 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda280ae0d0 con 0x7fda381049d0 2024-09-21T02:41:53.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.134+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda38104de0 con 0x7fda381049d0 2024-09-21T02:41:53.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.135+0000 7fda2fe00640 1 -- 172.21.15.84:0/2456964819 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11909 (secure 0 0 0) 0x7fda38104de0 con 0x7fda381049d0 2024-09-21T02:41:53.136 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:53.136 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-09-21T02:41:53.137 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"btime":"2024-09-21T02:40:45:465332+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:40:44.516130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fda1c0b65a0 msgr2=0x7fda1c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fda1c0b65a0 0x7fda1c0b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fda3810faf0 tx=0x7fda20005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda381049d0 msgr2=0x7fda38102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda381049d0 0x7fda38102710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fda2800e9c0 tx=0x7fda2800ee80 comp rx=0 tx=0).stop 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 shutdown_connections 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda3810de30 0x7fda38103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda38105320 0x7fda38102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fda1c0b65a0 0x7fda1c0b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 --2- 172.21.15.84:0/2456964819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda381049d0 0x7fda38102710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:53.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.137+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 >> 172.21.15.84:0/2456964819 conn(0x7fda38079740 msgr2=0x7fda380ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:53.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.138+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 shutdown_connections 2024-09-21T02:41:53.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:53.138+0000 7fda3dc00640 1 -- 172.21.15.84:0/2456964819 wait complete. 2024-09-21T02:41:53.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:53 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2456964819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:53.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:53 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2456964819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:53.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:53 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2456964819' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:53.840 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:41:54.210 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:54.486 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:54 smithi084 ceph-mon[30747]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T02:41:54.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:54 smithi172 ceph-mon[35067]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T02:41:54.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:54 smithi090 ceph-mon[34571]: pgmap v384: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T02:41:54.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 -- 172.21.15.84:0/899324907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813810de30 msgr2=0x7f8138110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:54.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 --2- 172.21.15.84:0/899324907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813810de30 0x7f8138110320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8130009ca0 tx=0x7f813002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:41:54.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 -- 172.21.15.84:0/899324907 shutdown_connections 2024-09-21T02:41:54.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 --2- 172.21.15.84:0/899324907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f813810de30 0x7f8138110320 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:54.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 --2- 172.21.15.84:0/899324907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8138105320 0x7f813810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:54.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 --2- 172.21.15.84:0/899324907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81381049d0 0x7f8138104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:54.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 -- 172.21.15.84:0/899324907 >> 172.21.15.84:0/899324907 conn(0x7f8138079740 msgr2=0x7f8138079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:54.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 -- 172.21.15.84:0/899324907 shutdown_connections 2024-09-21T02:41:54.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.798+0000 7f813d600640 1 -- 172.21.15.84:0/899324907 wait complete. 2024-09-21T02:41:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.799+0000 7f813d600640 1 Processor -- start 2024-09-21T02:41:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.799+0000 7f813d600640 1 -- start start 2024-09-21T02:41:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f813d600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81381049d0 0x7f813819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f813d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8138105320 0x7f813819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f813d600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813810de30 0x7f813819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f813d600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8138113bf0 con 0x7f8138105320 2024-09-21T02:41:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f813d600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8138113a70 con 0x7f81381049d0 2024-09-21T02:41:54.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f813d600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8138113d70 con 0x7f813810de30 2024-09-21T02:41:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f812e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8138105320 0x7f813819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:54.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f812e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8138105320 0x7f813819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33558/0 (socket says 172.21.15.84:33558) 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f812e000640 1 -- 172.21.15.84:0/3340840466 learned_addr learned my addr 172.21.15.84:0/3340840466 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f8136a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81381049d0 0x7f813819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f8137400640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813810de30 0x7f813819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f812e000640 1 -- 172.21.15.84:0/3340840466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813810de30 msgr2=0x7f813819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f812e000640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813810de30 0x7f813819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f812e000640 1 -- 172.21.15.84:0/3340840466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81381049d0 msgr2=0x7f813819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f812e000640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81381049d0 0x7f813819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.800+0000 7f812e000640 1 -- 172.21.15.84:0/3340840466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81381a04d0 con 0x7f8138105320 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.801+0000 7f812e000640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8138105320 0x7f813819ab00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f812000e9f0 tx=0x7f812000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.801+0000 7f812fe00640 1 -- 172.21.15.84:0/3340840466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812000ccc0 con 0x7f8138105320 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.801+0000 7f812fe00640 1 -- 172.21.15.84:0/3340840466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8120010900 con 0x7f8138105320 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.801+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81381a07c0 con 0x7f8138105320 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.801+0000 7f812fe00640 1 -- 172.21.15.84:0/3340840466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120018900 con 0x7f8138105320 2024-09-21T02:41:54.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.801+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381025f0 con 0x7f8138105320 2024-09-21T02:41:54.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.802+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813806c240 con 0x7f8138105320 2024-09-21T02:41:54.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.806+0000 7f812fe00640 1 -- 172.21.15.84:0/3340840466 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8120010ab0 con 0x7f8138105320 2024-09-21T02:41:54.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.808+0000 7f812fe00640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f811c0b65a0 0x7f811c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:54.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.808+0000 7f812fe00640 1 -- 172.21.15.84:0/3340840466 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f81200e7fe0 con 0x7f8138105320 2024-09-21T02:41:54.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.808+0000 7f8136a00640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f811c0b65a0 0x7f811c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:54.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.809+0000 7f8136a00640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f811c0b65a0 0x7f811c0b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f813806c940 tx=0x7f8128005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:54.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:54.810+0000 7f812fe00640 1 -- 172.21.15.84:0/3340840466 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81200b2760 con 0x7f8138105320 2024-09-21T02:41:55.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.037+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8138104de0 con 0x7f8138105320 2024-09-21T02:41:55.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.038+0000 7f812fe00640 1 -- 172.21.15.84:0/3340840466 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11909 (secure 0 0 0) 0x7f81200b76a0 con 0x7f8138105320 2024-09-21T02:41:55.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:55.040 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"btime":"2024-09-21T02:40:45:465332+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:40:44.516130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:41:55.040 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.040+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f811c0b65a0 msgr2=0x7f811c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.040+0000 7f813d600640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f811c0b65a0 0x7f811c0b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f813806c940 tx=0x7f8128005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.040+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8138105320 msgr2=0x7f813819ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.040+0000 7f813d600640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8138105320 0x7f813819ab00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f812000e9f0 tx=0x7f812000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.041+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 shutdown_connections 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.041+0000 7f813d600640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f811c0b65a0 0x7f811c0b8ab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.041+0000 7f813d600640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813810de30 0x7f813819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.041+0000 7f813d600640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8138105320 0x7f813819ab00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.041+0000 7f813d600640 1 --2- 172.21.15.84:0/3340840466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81381049d0 0x7f813819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:55.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.041+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 >> 172.21.15.84:0/3340840466 conn(0x7f8138079740 msgr2=0x7f81380ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:55.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.041+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 shutdown_connections 2024-09-21T02:41:55.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:55.041+0000 7f813d600640 1 -- 172.21.15.84:0/3340840466 wait complete. 2024-09-21T02:41:55.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:55 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3340840466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:55.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:55 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3340840466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:55.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:55 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3340840466' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:55.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:41:56.237 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:56.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:56 smithi172 ceph-mon[35067]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 objects/s recovering 2024-09-21T02:41:56.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:56 smithi084 ceph-mon[30747]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 objects/s recovering 2024-09-21T02:41:56.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:56 smithi090 ceph-mon[34571]: pgmap v385: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s; 10 B/s, 0 objects/s recovering 2024-09-21T02:41:56.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 -- 172.21.15.84:0/849774872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e81039b0 msgr2=0x7f97e8103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:56.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 --2- 172.21.15.84:0/849774872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e81039b0 0x7f97e8103dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009900 tx=0x7f97d802a410 comp rx=0 tx=0).stop 2024-09-21T02:41:56.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 -- 172.21.15.84:0/849774872 shutdown_connections 2024-09-21T02:41:56.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 --2- 172.21.15.84:0/849774872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e81092f0 0x7f97e8109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:56.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 --2- 172.21.15.84:0/849774872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97e8109c40 0x7f97e8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:56.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 --2- 172.21.15.84:0/849774872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e81039b0 0x7f97e8103dc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:56.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 -- 172.21.15.84:0/849774872 >> 172.21.15.84:0/849774872 conn(0x7f97e80ff400 msgr2=0x7f97e8101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:56.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 -- 172.21.15.84:0/849774872 shutdown_connections 2024-09-21T02:41:56.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.883+0000 7f97e7200640 1 -- 172.21.15.84:0/849774872 wait complete. 2024-09-21T02:41:56.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.884+0000 7f97e7200640 1 Processor -- start 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e7200640 1 -- start start 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97e81039b0 0x7f97e819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e81092f0 0x7f97e819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e7200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e8109c40 0x7f97e819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f97e8113a90 con 0x7f97e81092f0 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e7200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97e8113910 con 0x7f97e81039b0 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e7200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f97e8113c10 con 0x7f97e8109c40 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e81092f0 0x7f97e819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e5e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97e81039b0 0x7f97e819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e5e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97e81039b0 0x7f97e819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:34828/0 (socket says 172.21.15.84:34828) 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e5e00640 1 -- 172.21.15.84:0/2947053249 learned_addr learned my addr 172.21.15.84:0/2947053249 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:56.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.885+0000 7f97e6800640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e8109c40 0x7f97e819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:56.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.886+0000 7f97e5e00640 1 -- 172.21.15.84:0/2947053249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e8109c40 msgr2=0x7f97e819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:56.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.886+0000 7f97e5e00640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e8109c40 0x7f97e819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:56.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.886+0000 7f97e5e00640 1 -- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e81092f0 msgr2=0x7f97e819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:56.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.886+0000 7f97e5e00640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e81092f0 0x7f97e819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:56.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.886+0000 7f97e5e00640 1 -- 172.21.15.84:0/2947053249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e81a03d0 con 0x7f97e81039b0 2024-09-21T02:41:56.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.886+0000 7f97e5e00640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97e81039b0 0x7f97e819a460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97d80314b0 tx=0x7f97d8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:56.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.886+0000 7f97dea00640 1 -- 172.21.15.84:0/2947053249 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d803f070 con 0x7f97e81039b0 2024-09-21T02:41:56.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.886+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e81a0660 con 0x7f97e81039b0 2024-09-21T02:41:56.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.887+0000 7f97dea00640 1 -- 172.21.15.84:0/2947053249 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f97d8031bf0 con 0x7f97e81039b0 2024-09-21T02:41:56.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.887+0000 7f97dea00640 1 -- 172.21.15.84:0/2947053249 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8035030 con 0x7f97e81039b0 2024-09-21T02:41:56.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.887+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e81a6e20 con 0x7f97e81039b0 2024-09-21T02:41:56.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.888+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e8103dc0 con 0x7f97e81039b0 2024-09-21T02:41:56.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.890+0000 7f97dea00640 1 -- 172.21.15.84:0/2947053249 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f97d803bd10 con 0x7f97e81039b0 2024-09-21T02:41:56.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.892+0000 7f97dea00640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97cc0b65a0 0x7f97cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:56.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.892+0000 7f97dea00640 1 -- 172.21.15.84:0/2947053249 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f97d81085d0 con 0x7f97e81039b0 2024-09-21T02:41:56.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.892+0000 7f97e5400640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97cc0b65a0 0x7f97cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:56.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.893+0000 7f97e5400640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97cc0b65a0 0x7f97cc0b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f97e8102b00 tx=0x7f97d4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:56.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:56.894+0000 7f97dea00640 1 -- 172.21.15.84:0/2947053249 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97d8031da0 con 0x7f97e81039b0 2024-09-21T02:41:57.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.090+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97e819b590 con 0x7f97e81039b0 2024-09-21T02:41:57.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.092+0000 7f97dea00640 1 -- 172.21.15.84:0/2947053249 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24819 (secure 0 0 0) 0x7f97d80d2cf0 con 0x7f97e81039b0 2024-09-21T02:41:57.094 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:57.094 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:41:44.334281+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:41:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97cc0b65a0 msgr2=0x7f97cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97cc0b65a0 0x7f97cc0b8ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f97e8102b00 tx=0x7f97d4005f90 comp rx=0 tx=0).stop 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97e81039b0 msgr2=0x7f97e819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97e81039b0 0x7f97e819a460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97d80314b0 tx=0x7f97d8003c10 comp rx=0 tx=0).stop 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 shutdown_connections 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97cc0b65a0 0x7f97cc0b8ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e8109c40 0x7f97e819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97e81092f0 0x7f97e819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 --2- 172.21.15.84:0/2947053249 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97e81039b0 0x7f97e819a460 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 >> 172.21.15.84:0/2947053249 conn(0x7f97e80ff400 msgr2=0x7f97e8108940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 shutdown_connections 2024-09-21T02:41:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:57.096+0000 7f97e7200640 1 -- 172.21.15.84:0/2947053249 wait complete. 2024-09-21T02:41:57.452 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:57 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2947053249' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:57.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:57 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2947053249' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:57.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:57 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2947053249' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:41:57.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:41:58.330 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:41:58.475 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:58 smithi084 ceph-mon[30747]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T02:41:58.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:58 smithi172 ceph-mon[35067]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T02:41:58.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:58 smithi090 ceph-mon[34571]: pgmap v386: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T02:41:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.124+0000 7f44a8800640 1 -- 172.21.15.84:0/51979777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 msgr2=0x7f44a0106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:59.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.124+0000 7f44a8800640 1 --2- 172.21.15.84:0/51979777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 0x7f44a0106190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4494009900 tx=0x7f449402a410 comp rx=0 tx=0).stop 2024-09-21T02:41:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.125+0000 7f44a8800640 1 -- 172.21.15.84:0/51979777 shutdown_connections 2024-09-21T02:41:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.125+0000 7f44a8800640 1 --2- 172.21.15.84:0/51979777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a010c010 0x7f44a0112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.125+0000 7f44a8800640 1 --2- 172.21.15.84:0/51979777 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a010b6c0 0x7f44a010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.125+0000 7f44a8800640 1 --2- 172.21.15.84:0/51979777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 0x7f44a0106190 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.125+0000 7f44a8800640 1 -- 172.21.15.84:0/51979777 >> 172.21.15.84:0/51979777 conn(0x7f44a0101810 msgr2=0x7f44a0103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.125+0000 7f44a8800640 1 -- 172.21.15.84:0/51979777 shutdown_connections 2024-09-21T02:41:59.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.125+0000 7f44a8800640 1 -- 172.21.15.84:0/51979777 wait complete. 2024-09-21T02:41:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.126+0000 7f44a8800640 1 Processor -- start 2024-09-21T02:41:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.126+0000 7f44a8800640 1 -- start start 2024-09-21T02:41:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.126+0000 7f44a8800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 0x7f44a019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:59.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.126+0000 7f44a8800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a010b6c0 0x7f44a019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.126+0000 7f44a8800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a010c010 0x7f44a01a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.126+0000 7f44a8800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0115e10 con 0x7f44a0105d80 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.126+0000 7f44a8800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0115c90 con 0x7f44a010c010 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.126+0000 7f44a8800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0115f90 con 0x7f44a010b6c0 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 0x7f44a019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 0x7f44a019c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33600/0 (socket says 172.21.15.84:33600) 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5e00640 1 -- 172.21.15.84:0/1419107400 learned_addr learned my addr 172.21.15.84:0/1419107400 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5400640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a010b6c0 0x7f44a019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a6800640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a010c010 0x7f44a01a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5400640 1 -- 172.21.15.84:0/1419107400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a010c010 msgr2=0x7f44a01a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5400640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a010c010 0x7f44a01a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5400640 1 -- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 msgr2=0x7f44a019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5400640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 0x7f44a019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.127+0000 7f44a5400640 1 -- 172.21.15.84:0/1419107400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a01a2710 con 0x7f44a010b6c0 2024-09-21T02:41:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.128+0000 7f44a5400640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a010b6c0 0x7f44a019cd40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f44a006caa0 tx=0x7f449000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.128+0000 7f449aa00640 1 -- 172.21.15.84:0/1419107400 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449000cd00 con 0x7f44a010b6c0 2024-09-21T02:41:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.128+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a01a2a00 con 0x7f44a010b6c0 2024-09-21T02:41:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.128+0000 7f449aa00640 1 -- 172.21.15.84:0/1419107400 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44900035f0 con 0x7f44a010b6c0 2024-09-21T02:41:59.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.128+0000 7f449aa00640 1 -- 172.21.15.84:0/1419107400 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490010670 con 0x7f44a010b6c0 2024-09-21T02:41:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.128+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a01a9160 con 0x7f44a010b6c0 2024-09-21T02:41:59.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.129+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a0106190 con 0x7f44a010b6c0 2024-09-21T02:41:59.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.132+0000 7f449aa00640 1 -- 172.21.15.84:0/1419107400 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f44900037a0 con 0x7f44a010b6c0 2024-09-21T02:41:59.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.133+0000 7f449aa00640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44880b65a0 0x7f44880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:41:59.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.133+0000 7f449aa00640 1 -- 172.21.15.84:0/1419107400 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f44900e7bb0 con 0x7f44a010b6c0 2024-09-21T02:41:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.133+0000 7f44a5e00640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44880b65a0 0x7f44880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:41:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.134+0000 7f44a5e00640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44880b65a0 0x7f44880b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4494005f70 tx=0x7f4494005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:41:59.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.135+0000 7f449aa00640 1 -- 172.21.15.84:0/1419107400 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44900adf80 con 0x7f44a010b6c0 2024-09-21T02:41:59.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.357+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44a019d8d0 con 0x7f44a010b6c0 2024-09-21T02:41:59.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.358+0000 7f449aa00640 1 -- 172.21.15.84:0/1419107400 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11909 (secure 0 0 0) 0x7f44900b2360 con 0x7f44a010b6c0 2024-09-21T02:41:59.360 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:41:59.360 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"btime":"2024-09-21T02:40:45:465332+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:40:44.516130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:41:59.360 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-09-21T02:41:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44880b65a0 msgr2=0x7f44880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44880b65a0 0x7f44880b8ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4494005f70 tx=0x7f4494005a20 comp rx=0 tx=0).stop 2024-09-21T02:41:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a010b6c0 msgr2=0x7f44a019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:41:59.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a010b6c0 0x7f44a019cd40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f44a006caa0 tx=0x7f449000ee50 comp rx=0 tx=0).stop 2024-09-21T02:41:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 shutdown_connections 2024-09-21T02:41:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f44880b65a0 0x7f44880b8ab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44a010b6c0 0x7f44a019cd40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a010c010 0x7f44a01a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 --2- 172.21.15.84:0/1419107400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44a0105d80 0x7f44a019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:41:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 >> 172.21.15.84:0/1419107400 conn(0x7f44a0101810 msgr2=0x7f44a010ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:41:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 shutdown_connections 2024-09-21T02:41:59.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:41:59.361+0000 7f44a8800640 1 -- 172.21.15.84:0/1419107400 wait complete. 2024-09-21T02:41:59.691 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:41:59 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1419107400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:59.725 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:41:59 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1419107400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:41:59.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:41:59 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1419107400' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:00.162 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:39:47.859217+0000', 'modified': '2024-09-21T02:40:44.516130+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24704, 'mds_1': 24703, 'mds_2': 24679}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24647': {'gid': 24647, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6835/1905318969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1905318969}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1905318969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24668': {'gid': 24668, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6837/939715852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 939715852}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 939715852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/2876777250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2876777250}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 2876777250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24679': {'gid': 24679, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.172:6837/3475533235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3475533235}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3475533235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24703': {'gid': 24703, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.172:6839/3937933536', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3937933536}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3937933536}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6839/3427873852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6838', 'nonce': 3427873852}, {'type': 'v1', 'addr': '172.21.15.90:6839', 'nonce': 3427873852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24704, 'qdb_cluster': [24704, 24703, 24679]} 2024-09-21T02:42:00.162 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T02:42:00.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T02:42:00.536 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:00.675 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:00 smithi084 ceph-mon[30747]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T02:42:00.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:00 smithi172 ceph-mon[35067]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T02:42:00.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:00 smithi090 ceph-mon[34571]: pgmap v387: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 9 B/s, 0 objects/s recovering 2024-09-21T02:42:01.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 -- 172.21.15.84:0/4138093168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 msgr2=0x7fb31c106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 --2- 172.21.15.84:0/4138093168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 0x7fb31c106190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb310009900 tx=0x7fb31002a410 comp rx=0 tx=0).stop 2024-09-21T02:42:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 -- 172.21.15.84:0/4138093168 shutdown_connections 2024-09-21T02:42:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 --2- 172.21.15.84:0/4138093168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb31c10b6c0 0x7fb31c10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 --2- 172.21.15.84:0/4138093168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31c10c010 0x7fb31c112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 --2- 172.21.15.84:0/4138093168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 0x7fb31c106190 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 -- 172.21.15.84:0/4138093168 >> 172.21.15.84:0/4138093168 conn(0x7fb31c101810 msgr2=0x7fb31c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 -- 172.21.15.84:0/4138093168 shutdown_connections 2024-09-21T02:42:01.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.211+0000 7fb324600640 1 -- 172.21.15.84:0/4138093168 wait complete. 2024-09-21T02:42:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.212+0000 7fb324600640 1 Processor -- start 2024-09-21T02:42:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.212+0000 7fb324600640 1 -- start start 2024-09-21T02:42:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb324600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 0x7fb31c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb324600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb31c10b6c0 0x7fb31c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb324600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31c10c010 0x7fb31c1a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb324600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c115e10 con 0x7fb31c105d80 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb324600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c115c90 con 0x7fb31c10c010 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb324600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c115f90 con 0x7fb31c10b6c0 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb321c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 0x7fb31c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb321c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 0x7fb31c19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33494/0 (socket says 172.21.15.84:33494) 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb321c00640 1 -- 172.21.15.84:0/409028006 learned_addr learned my addr 172.21.15.84:0/409028006 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb322600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31c10c010 0x7fb31c1a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.213+0000 7fb321200640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb31c10b6c0 0x7fb31c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb322600640 1 -- 172.21.15.84:0/409028006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb31c10b6c0 msgr2=0x7fb31c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb322600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb31c10b6c0 0x7fb31c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb322600640 1 -- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 msgr2=0x7fb31c19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb322600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 0x7fb31c19c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb322600640 1 -- 172.21.15.84:0/409028006 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31c1a27d0 con 0x7fb31c10c010 2024-09-21T02:42:01.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb321c00640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 0x7fb31c19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:01.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb322600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31c10c010 0x7fb31c1a20a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb314009fd0 tx=0x7fb31400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:01.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb31a000640 1 -- 172.21.15.84:0/409028006 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31400ce20 con 0x7fb31c10c010 2024-09-21T02:42:01.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb31a000640 1 -- 172.21.15.84:0/409028006 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb314005020 con 0x7fb31c10c010 2024-09-21T02:42:01.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb324600640 1 -- 172.21.15.84:0/409028006 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31c1a2ac0 con 0x7fb31c10c010 2024-09-21T02:42:01.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb31a000640 1 -- 172.21.15.84:0/409028006 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314010720 con 0x7fb31c10c010 2024-09-21T02:42:01.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.214+0000 7fb324600640 1 -- 172.21.15.84:0/409028006 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb31c1a9220 con 0x7fb31c10c010 2024-09-21T02:42:01.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.217+0000 7fb32b286740 1 Processor -- start 2024-09-21T02:42:01.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.218+0000 7fb31a000640 1 -- 172.21.15.84:0/409028006 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb314005560 con 0x7fb31c10c010 2024-09-21T02:42:01.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.218+0000 7fb32b286740 1 -- start start 2024-09-21T02:42:01.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.218+0000 7fb32b286740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97008490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.218+0000 7fb32b286740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c970089d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.218+0000 7fb32b286740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97008f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.218+0000 7fb32b286740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558c96f7fd50 con 0x558c96c41280 2024-09-21T02:42:01.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.218+0000 7fb32b286740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558c96f6f180 con 0x558c96c61f60 2024-09-21T02:42:01.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.218+0000 7fb32b286740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c96f72f90 con 0x558c96c390a0 2024-09-21T02:42:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97008490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c970089d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c970089d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:60228/0 (socket says 172.21.15.84:60228) 2024-09-21T02:42:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321c00640 1 -- 172.21.15.84:0/141197039 learned_addr learned my addr 172.21.15.84:0/141197039 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:01.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97008490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56766/0 (socket says 172.21.15.84:56766) 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321200640 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97008f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321c00640 1 -- 172.21.15.84:0/141197039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 msgr2=0x558c97008490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321c00640 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97008490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321c00640 1 -- 172.21.15.84:0/141197039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 msgr2=0x558c97008f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321c00640 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97008f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321c00640 1 -- 172.21.15.84:0/141197039 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c96f39a70 con 0x558c96c390a0 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.219+0000 7fb321200640 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97008f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.220+0000 7fb321c00640 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c970089d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb310009a20 tx=0x7fb310005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c22ba35975371a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.220+0000 7fb31a000640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3040b65a0 0x7fb3040b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.220+0000 7fb30ea00640 1 -- 172.21.15.84:0/141197039 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310035040 con 0x558c96c390a0 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.220+0000 7fb30ea00640 1 -- 172.21.15.84:0/141197039 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb3100318d0 con 0x558c96c390a0 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.220+0000 7fb30ea00640 1 -- 172.21.15.84:0/141197039 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310004a00 con 0x558c96c390a0 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.220+0000 7fb31a000640 1 -- 172.21.15.84:0/409028006 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fb3140e7ef0 con 0x7fb31c10c010 2024-09-21T02:42:01.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.220+0000 7fb321200640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3040b65a0 0x7fb3040b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 -- 172.21.15.84:0/141197039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 msgr2=0x558c970089d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c970089d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb310009a20 tx=0x7fb310005e50 comp rx=0 tx=0).stop 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb321200640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3040b65a0 0x7fb3040b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb31c104f10 tx=0x7fb308013040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 -- 172.21.15.84:0/141197039 shutdown_connections 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c970089d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97008f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 --2- 172.21.15.84:0/141197039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97008490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 -- 172.21.15.84:0/141197039 >> 172.21.15.84:0/141197039 conn(0x558c96c56350 msgr2=0x558c97006380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 -- 172.21.15.84:0/141197039 shutdown_connections 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.221+0000 7fb32b286740 1 -- 172.21.15.84:0/141197039 wait complete. 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.222+0000 7fb32b286740 1 -- start start 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.222+0000 7fb32b286740 1 Processor -- start 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.222+0000 7fb32b286740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c390a0 0x558c97014050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.222+0000 7fb32b286740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.222+0000 7fb32b286740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c61f60 0x558c9701ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.222+0000 7fb32b286740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558c96dd05f0 con 0x558c96c41280 2024-09-21T02:42:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.222+0000 7fb32b286740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558c96f0a460 con 0x558c96c390a0 2024-09-21T02:42:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.222+0000 7fb32b286740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c97016c10 con 0x558c96c61f60 2024-09-21T02:42:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb32b286740 10 client.0 _ll_register_callbacks cb 0x558c96f1a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb321200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb321c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c390a0 0x558c97014050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb322600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c61f60 0x558c9701ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb321c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c390a0 0x558c97014050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56776/0 (socket says 172.21.15.84:56776) 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb322600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c61f60 0x558c9701ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:60242/0 (socket says 172.21.15.84:60242) 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb321c00640 1 -- 172.21.15.84:0/2987094682 learned_addr learned my addr 172.21.15.84:0/2987094682 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb321200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97014590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33516/0 (socket says 172.21.15.84:33516) 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb322600640 1 -- 172.21.15.84:0/2987094682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c390a0 msgr2=0x558c97014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb322600640 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c390a0 0x558c97014050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb322600640 1 -- 172.21.15.84:0/2987094682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 msgr2=0x558c97014590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb322600640 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97014590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb322600640 1 -- 172.21.15.84:0/2987094682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c96ccd540 con 0x558c96c61f60 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.223+0000 7fb321c00640 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c390a0 0x558c97014050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb322600640 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c61f60 0x558c9701ff30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3140e54b0 tx=0x7fb3140ad500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c4ff8c9db6e098e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb303400640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb303400640 1 -- 172.21.15.84:0/2987094682 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3140aee60 con 0x558c96c61f60 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb303400640 1 -- 172.21.15.84:0/2987094682 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fb3140acd90 con 0x558c96c61f60 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb32b286740 1 -- 172.21.15.84:0/2987094682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c96f0ca70 con 0x558c96c61f60 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb303400640 1 -- 172.21.15.84:0/2987094682 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3140ae230 con 0x558c96c61f60 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb32b286740 10 client.25165 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb32b286740 1 -- 172.21.15.84:0/2987094682 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558c96f276f0 con 0x558c96c61f60 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.224+0000 7fb303400640 1 -- 172.21.15.84:0/2987094682 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x558c96f0ca70 con 0x558c96c61f60 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.225+0000 7fb303400640 1 -- 172.21.15.84:0/2987094682 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb3140c3ce0 con 0x558c96c61f60 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.225+0000 7fb32b286740 10 client.25165 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.225+0000 7fb32b286740 10 client.25165 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T02:42:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.225+0000 7fb32b286740 20 client.25165 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.225+0000 7fb32b286740 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x558c96c208e0 0x558c97026490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.225+0000 7fb32b286740 4 client.25165 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.225+0000 7fb32b286740 1 -- 172.21.15.84:0/2987094682 --> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c96f81ca0 con 0x558c96c208e0 2024-09-21T02:42:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.225+0000 7fb321c00640 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x558c96c208e0 0x558c97026490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.226+0000 7fb321c00640 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x558c96c208e0 0x558c97026490 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=352a3c3d7b099c1c server_cookie=c820abc4915a9212 in_seq=0 out_seq=0 2024-09-21T02:42:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.226+0000 7fb303400640 10 client.25165 ms_handle_connect on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb303400640 1 -- 172.21.15.84:0/2987094682 <== mds.2 v2:172.21.15.172:6836/3475533235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c96f81ca0 con 0x558c96c208e0 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb303400640 10 client.25165 handle_command_reply: tid=0 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 client.25165 shutdown 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 -- 172.21.15.84:0/2987094682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c61f60 msgr2=0x558c9701ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c61f60 0x558c9701ff30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3140e54b0 tx=0x7fb3140ad500 comp rx=0 tx=0).stop 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 -- 172.21.15.84:0/2987094682 shutdown_connections 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x558c96c208e0 0x558c97026490 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c61f60 0x558c9701ff30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97014590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 --2- 172.21.15.84:0/2987094682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c390a0 0x558c97014050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 -- 172.21.15.84:0/2987094682 >> 172.21.15.84:0/2987094682 conn(0x558c96c56350 msgr2=0x558c9700b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb303400640 0 client.25165 ms_handle_reset on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 -- 172.21.15.84:0/2987094682 shutdown_connections 2024-09-21T02:42:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 1 -- 172.21.15.84:0/2987094682 wait complete. 2024-09-21T02:42:01.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.227+0000 7fb32b286740 20 client.25165 trim_cache size 0 max 16384 2024-09-21T02:42:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.246+0000 7fb32b286740 1 Processor -- start 2024-09-21T02:42:01.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.246+0000 7fb32b286740 1 -- start start 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.246+0000 7fb32b286740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c97005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.246+0000 7fb32b286740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.246+0000 7fb32b286740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97014030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.246+0000 7fb32b286740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558c970247d0 con 0x558c96c41280 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.246+0000 7fb32b286740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558c97024ea0 con 0x558c96c61f60 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.246+0000 7fb32b286740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c97025570 con 0x558c96c390a0 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97006220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33518/0 (socket says 172.21.15.84:33518) 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 -- 172.21.15.84:0/3333788959 learned_addr learned my addr 172.21.15.84:0/3333788959 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321c00640 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c97005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb322600640 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 -- 172.21.15.84:0/3333788959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 msgr2=0x558c97005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c97005ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 -- 172.21.15.84:0/3333788959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 msgr2=0x558c97014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97014030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 -- 172.21.15.84:0/3333788959 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9700b2f0 con 0x558c96c41280 2024-09-21T02:42:01.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb322600640 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97014030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.247+0000 7fb321200640 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97006220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb3080041a0 tx=0x7fb30801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1dbc23b5e03692 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.248+0000 7fb30e000640 1 -- 172.21.15.84:0/3333788959 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308003c30 con 0x558c96c41280 2024-09-21T02:42:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.248+0000 7fb30e000640 1 -- 172.21.15.84:0/3333788959 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb308003dd0 con 0x558c96c41280 2024-09-21T02:42:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.248+0000 7fb30e000640 1 -- 172.21.15.84:0/3333788959 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308020840 con 0x558c96c41280 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.248+0000 7fb32b286740 1 -- 172.21.15.84:0/3333788959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 msgr2=0x558c97006220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97006220 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb3080041a0 tx=0x7fb30801a000 comp rx=0 tx=0).stop 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 -- 172.21.15.84:0/3333788959 shutdown_connections 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c97014030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97006220 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 --2- 172.21.15.84:0/3333788959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c97005ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 -- 172.21.15.84:0/3333788959 >> 172.21.15.84:0/3333788959 conn(0x558c96c56350 msgr2=0x558c97001010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 -- 172.21.15.84:0/3333788959 shutdown_connections 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 -- 172.21.15.84:0/3333788959 wait complete. 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 -- start start 2024-09-21T02:42:01.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.249+0000 7fb32b286740 1 Processor -- start 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb32b286740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c9702ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb32b286740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97028070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb32b286740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c970285b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb32b286740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558c97026310 con 0x558c96c41280 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb32b286740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x558c97025c40 con 0x558c96c61f60 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb32b286740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c970269e0 con 0x558c96c390a0 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb32b286740 10 client.0 _ll_register_callbacks cb 0x7fb3140a9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb321200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97028070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb321200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97028070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33526/0 (socket says 172.21.15.84:33526) 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb321200640 1 -- 172.21.15.84:0/3066983644 learned_addr learned my addr 172.21.15.84:0/3066983644 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb321c00640 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c9702ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.250+0000 7fb322600640 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c970285b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb321200640 1 -- 172.21.15.84:0/3066983644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 msgr2=0x558c9702ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb321200640 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c9702ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb321200640 1 -- 172.21.15.84:0/3066983644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 msgr2=0x558c970285b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb321200640 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c970285b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb321200640 1 -- 172.21.15.84:0/3066983644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c97028af0 con 0x558c96c41280 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb321200640 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97028070 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb308005df0 tx=0x7fb308005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dae30b9f74b0ced server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb303400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb303400640 1 -- 172.21.15.84:0/3066983644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308003c30 con 0x558c96c41280 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb32b286740 1 -- 172.21.15.84:0/3066983644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb308003dd0 con 0x558c96c41280 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.251+0000 7fb303400640 1 -- 172.21.15.84:0/3066983644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fb308019070 con 0x558c96c41280 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb303400640 1 -- 172.21.15.84:0/3066983644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb30803d050 con 0x558c96c41280 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb32b286740 10 client.15153 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:01.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb32b286740 1 -- 172.21.15.84:0/3066983644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558c9702e3e0 con 0x558c96c41280 2024-09-21T02:42:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb303400640 1 -- 172.21.15.84:0/3066983644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb308003dd0 con 0x558c96c41280 2024-09-21T02:42:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb303400640 1 -- 172.21.15.84:0/3066983644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb308020bc0 con 0x558c96c41280 2024-09-21T02:42:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb32b286740 10 client.15153 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb32b286740 10 client.15153 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T02:42:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb32b286740 20 client.15153 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb32b286740 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x558c96bf5c90 0x558c97094a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb32b286740 4 client.15153 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.252+0000 7fb32b286740 1 -- 172.21.15.84:0/3066983644 --> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] -- command(tid 0: {"prefix": "status"}) -- 0x558c96f7d750 con 0x558c96bf5c90 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.253+0000 7fb321c00640 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x558c96bf5c90 0x558c97094a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.253+0000 7fb321c00640 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x558c96bf5c90 0x558c97094a30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d8e2024058878d8 server_cookie=8b5f2d95fdd949dd in_seq=0 out_seq=0 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.253+0000 7fb303400640 10 client.15153 ms_handle_connect on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.253+0000 7fb303400640 1 -- 172.21.15.84:0/3066983644 <== mds.2 v2:172.21.15.172:6836/3475533235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558c96f7d750 con 0x558c96bf5c90 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.253+0000 7fb303400640 10 client.15153 handle_command_reply: tid=0 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.253+0000 7fb32b286740 1 client.15153 shutdown 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 -- 172.21.15.84:0/3066983644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 msgr2=0x558c97028070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97028070 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb308005df0 tx=0x7fb308005e20 comp rx=0 tx=0).stop 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 -- 172.21.15.84:0/3066983644 shutdown_connections 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x558c96bf5c90 0x558c97094a30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558c96c61f60 0x558c970285b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c96c41280 0x558c97028070 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 --2- 172.21.15.84:0/3066983644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c96c390a0 0x558c9702ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb303400640 0 client.15153 ms_handle_reset on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 -- 172.21.15.84:0/3066983644 >> 172.21.15.84:0/3066983644 conn(0x558c96c56350 msgr2=0x558c97014030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 -- 172.21.15.84:0/3066983644 shutdown_connections 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 1 -- 172.21.15.84:0/3066983644 wait complete. 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.254+0000 7fb32b286740 20 client.15153 trim_cache size 0 max 16384 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24679, 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:42:01.258 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:42:01.259 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:42:01.259 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 80.870165166999996, 2024-09-21T02:42:01.259 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 26, 2024-09-21T02:42:01.259 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:42:01.259 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:42:01.259 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 162.232745499 2024-09-21T02:42:01.259 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:42:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 -- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3040b65a0 msgr2=0x7fb3040b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3040b65a0 0x7fb3040b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb31c104f10 tx=0x7fb308013040 comp rx=0 tx=0).stop 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 -- 172.21.15.84:0/409028006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31c10c010 msgr2=0x7fb31c1a20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31c10c010 0x7fb31c1a20a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb314009fd0 tx=0x7fb31400ef10 comp rx=0 tx=0).stop 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 -- 172.21.15.84:0/409028006 shutdown_connections 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3040b65a0 0x7fb3040b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb31c10b6c0 0x7fb31c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31c10c010 0x7fb31c1a20a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 --2- 172.21.15.84:0/409028006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb31c105d80 0x7fb31c19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 -- 172.21.15.84:0/409028006 >> 172.21.15.84:0/409028006 conn(0x7fb31c101810 msgr2=0x7fb31c10ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 -- 172.21.15.84:0/409028006 shutdown_connections 2024-09-21T02:42:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:01.255+0000 7fb324600640 1 -- 172.21.15.84:0/409028006 wait complete. 2024-09-21T02:42:02.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:01 smithi172 ceph-mon[35067]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:02.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:01 smithi084 ceph-mon[30747]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:01 smithi090 ceph-mon[34571]: pgmap v388: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:02.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T02:42:02.579 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 -- 172.21.15.84:0/4217295121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 msgr2=0x7f0838105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 --2- 172.21.15.84:0/4217295121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 0x7f0838105fc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0828009900 tx=0x7f082802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 -- 172.21.15.84:0/4217295121 shutdown_connections 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 --2- 172.21.15.84:0/4217295121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f083810be40 0x7f0838112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 --2- 172.21.15.84:0/4217295121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f083810b4f0 0x7f083810b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 --2- 172.21.15.84:0/4217295121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 0x7f0838105fc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 -- 172.21.15.84:0/4217295121 >> 172.21.15.84:0/4217295121 conn(0x7f0838101680 msgr2=0x7f0838103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 -- 172.21.15.84:0/4217295121 shutdown_connections 2024-09-21T02:42:03.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.228+0000 7f0837e00640 1 -- 172.21.15.84:0/4217295121 wait complete. 2024-09-21T02:42:03.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.229+0000 7f0837e00640 1 Processor -- start 2024-09-21T02:42:03.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.229+0000 7f0837e00640 1 -- start start 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0837e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 0x7f083819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0837e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f083810b4f0 0x7f083819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0837e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f083810be40 0x7f08381a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0837e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0838115c90 con 0x7f083810b4f0 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0837e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0838115b10 con 0x7f0838105bb0 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0837e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0838115e10 con 0x7f083810be40 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f082e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f083810b4f0 0x7f083819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0836a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 0x7f083819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0836a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 0x7f083819c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56808/0 (socket says 172.21.15.84:56808) 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0836a00640 1 -- 172.21.15.84:0/1395658347 learned_addr learned my addr 172.21.15.84:0/1395658347 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:03.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.230+0000 7f0837400640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f083810be40 0x7f08381a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f082e000640 1 -- 172.21.15.84:0/1395658347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f083810be40 msgr2=0x7f08381a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f082e000640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f083810be40 0x7f08381a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f082e000640 1 -- 172.21.15.84:0/1395658347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 msgr2=0x7f083819c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f082e000640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 0x7f083819c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f082e000640 1 -- 172.21.15.84:0/1395658347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08381a2530 con 0x7f083810b4f0 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f082e000640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f083810b4f0 0x7f083819cb60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f083806c8c0 tx=0x7f082000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f083ca00640 1 -- 172.21.15.84:0/1395658347 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082000cd00 con 0x7f083810b4f0 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f0837e00640 1 -- 172.21.15.84:0/1395658347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08381a2820 con 0x7f083810b4f0 2024-09-21T02:42:03.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f083ca00640 1 -- 172.21.15.84:0/1395658347 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f08200035f0 con 0x7f083810b4f0 2024-09-21T02:42:03.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.231+0000 7f083ca00640 1 -- 172.21.15.84:0/1395658347 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820010690 con 0x7f083810b4f0 2024-09-21T02:42:03.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.232+0000 7f0837e00640 1 -- 172.21.15.84:0/1395658347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381a8f80 con 0x7f083810b4f0 2024-09-21T02:42:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.234+0000 7f0844a51740 1 Processor -- start 2024-09-21T02:42:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0844a51740 1 -- start start 2024-09-21T02:42:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0844a51740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e45670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0844a51740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a760a0 0x562d05e45bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0844a51740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a7e280 0x562d05e460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0844a51740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d05dbcd50 con 0x562d05a9ef60 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0844a51740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562d05dac180 con 0x562d05a7e280 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0844a51740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d05daff90 con 0x562d05a760a0 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f083ca00640 1 -- 172.21.15.84:0/1395658347 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f08200037a0 con 0x7f083810b4f0 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0837400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e45670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.235+0000 7f0837400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e45670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33540/0 (socket says 172.21.15.84:33540) 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f0837400640 1 -- 172.21.15.84:0/3256574278 learned_addr learned my addr 172.21.15.84:0/3256574278 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f082e000640 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a7e280 0x562d05e460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f0836a00640 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a760a0 0x562d05e45bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f0836a00640 1 -- 172.21.15.84:0/3256574278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a7e280 msgr2=0x562d05e460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f0836a00640 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a7e280 0x562d05e460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f0836a00640 1 -- 172.21.15.84:0/3256574278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 msgr2=0x562d05e45670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f0836a00640 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e45670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f0836a00640 1 -- 172.21.15.84:0/3256574278 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d05d76a70 con 0x562d05a760a0 2024-09-21T02:42:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.236+0000 7f0837400640 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e45670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.237+0000 7f0836a00640 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a760a0 0x562d05e45bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0828004770 tx=0x7f0828005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3dfa63ef0bb10e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:03.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.237+0000 7f083ca00640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f081c0b65a0 0x7f081c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.237+0000 7f0827e00640 1 -- 172.21.15.84:0/3256574278 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828040070 con 0x562d05a760a0 2024-09-21T02:42:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.237+0000 7f0827e00640 1 -- 172.21.15.84:0/3256574278 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0828004480 con 0x562d05a760a0 2024-09-21T02:42:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.237+0000 7f0827e00640 1 -- 172.21.15.84:0/3256574278 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828035040 con 0x562d05a760a0 2024-09-21T02:42:03.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.237+0000 7f083ca00640 1 -- 172.21.15.84:0/1395658347 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f08200e7b50 con 0x7f083810b4f0 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.237+0000 7f0837400640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f081c0b65a0 0x7f081c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 -- 172.21.15.84:0/3256574278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a760a0 msgr2=0x562d05e45bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0837400640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f081c0b65a0 0x7f081c0b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0830011890 tx=0x7f0830009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a760a0 0x562d05e45bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0828004770 tx=0x7f0828005f00 comp rx=0 tx=0).stop 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 -- 172.21.15.84:0/3256574278 shutdown_connections 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a760a0 0x562d05e45bb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a7e280 0x562d05e460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 --2- 172.21.15.84:0/3256574278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e45670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 -- 172.21.15.84:0/3256574278 >> 172.21.15.84:0/3256574278 conn(0x562d05a93350 msgr2=0x562d05e43560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 -- 172.21.15.84:0/3256574278 shutdown_connections 2024-09-21T02:42:03.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.238+0000 7f0844a51740 1 -- 172.21.15.84:0/3256574278 wait complete. 2024-09-21T02:42:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.239+0000 7f0844a51740 1 -- start start 2024-09-21T02:42:03.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.239+0000 7f0844a51740 1 Processor -- start 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0844a51740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e51260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0844a51740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0844a51740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e5d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0844a51740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d05c0d5f0 con 0x562d05a7e280 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0844a51740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562d05d47460 con 0x562d05a760a0 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0844a51740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d05e53df0 con 0x562d05a9ef60 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0844a51740 10 client.0 _ll_register_callbacks cb 0x562d05d57210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f082e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0837400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e5d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0836a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e51260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f082e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33544/0 (socket says 172.21.15.84:33544) 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f082e000640 1 -- 172.21.15.84:0/3663865496 learned_addr learned my addr 172.21.15.84:0/3663865496 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:03.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0837400640 1 -- 172.21.15.84:0/3663865496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 msgr2=0x562d05e51260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0837400640 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e51260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0837400640 1 -- 172.21.15.84:0/3663865496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 msgr2=0x562d05e517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0837400640 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0837400640 1 -- 172.21.15.84:0/3663865496 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d05b0a540 con 0x562d05a9ef60 2024-09-21T02:42:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f082e000640 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:03.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.240+0000 7f0836a00640 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e51260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.241+0000 7f0837400640 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e5d0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0830009fd0 tx=0x7f0830004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32c0ff2e6e5f464d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:03.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.241+0000 7f0824c00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.241+0000 7f0824c00640 1 -- 172.21.15.84:0/3663865496 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830004b20 con 0x562d05a9ef60 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.241+0000 7f0844a51740 1 -- 172.21.15.84:0/3663865496 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d05d49a70 con 0x562d05a9ef60 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.241+0000 7f0824c00640 1 -- 172.21.15.84:0/3663865496 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f0830017030 con 0x562d05a9ef60 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.241+0000 7f0824c00640 1 -- 172.21.15.84:0/3663865496 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0830004cc0 con 0x562d05a9ef60 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.241+0000 7f0844a51740 10 client.25183 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.241+0000 7f0844a51740 1 -- 172.21.15.84:0/3663865496 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562d05d646f0 con 0x562d05a9ef60 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0824c00640 1 -- 172.21.15.84:0/3663865496 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x562d05d49a70 con 0x562d05a9ef60 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0824c00640 1 -- 172.21.15.84:0/3663865496 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0830004640 con 0x562d05a9ef60 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0844a51740 10 client.25183 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0844a51740 10 client.25183 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0844a51740 20 client.25183 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0844a51740 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x562d05a5d8e0 0x562d05e63800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0844a51740 4 client.25183 mds_command: new command op to 24703 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:03.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0844a51740 1 -- 172.21.15.84:0/3663865496 --> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d05dbeca0 con 0x562d05a5d8e0 2024-09-21T02:42:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.242+0000 7f0836a00640 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x562d05a5d8e0 0x562d05e63800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.243+0000 7f0836a00640 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x562d05a5d8e0 0x562d05e63800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=caca7153b685dd23 server_cookie=110fe65d917ac2ae in_seq=0 out_seq=0 2024-09-21T02:42:03.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.243+0000 7f0824c00640 10 client.25183 ms_handle_connect on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0824c00640 1 -- 172.21.15.84:0/3663865496 <== mds.1 v2:172.21.15.172:6838/3937933536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d05dbeca0 con 0x562d05a5d8e0 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0824c00640 10 client.25183 handle_command_reply: tid=0 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 client.25183 shutdown 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 -- 172.21.15.84:0/3663865496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 msgr2=0x562d05e5d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e5d0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0830009fd0 tx=0x7f0830004ab0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 -- 172.21.15.84:0/3663865496 shutdown_connections 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e5d0e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x562d05a5d8e0 0x562d05e63800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 --2- 172.21.15.84:0/3663865496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e51260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0824c00640 0 client.25183 ms_handle_reset on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:03.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.244+0000 7f0844a51740 1 -- 172.21.15.84:0/3663865496 >> 172.21.15.84:0/3663865496 conn(0x562d05a93350 msgr2=0x562d05e48850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.245+0000 7f0844a51740 1 -- 172.21.15.84:0/3663865496 shutdown_connections 2024-09-21T02:42:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.245+0000 7f0844a51740 1 -- 172.21.15.84:0/3663865496 wait complete. 2024-09-21T02:42:03.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.245+0000 7f0844a51740 20 client.25183 trim_cache size 0 max 16384 2024-09-21T02:42:03.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.263+0000 7f0844a51740 1 Processor -- start 2024-09-21T02:42:03.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.263+0000 7f0844a51740 1 -- start start 2024-09-21T02:42:03.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0844a51740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e63800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0844a51740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a7e280 0x562d05e611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0844a51740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e4c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0844a51740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d05e61b40 con 0x562d05a9ef60 2024-09-21T02:42:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0844a51740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562d05e62210 con 0x562d05a760a0 2024-09-21T02:42:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0844a51740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d05e628e0 con 0x562d05a7e280 2024-09-21T02:42:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0837400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e4c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0837400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e4c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33556/0 (socket says 172.21.15.84:33556) 2024-09-21T02:42:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0837400640 1 -- 172.21.15.84:0/2733073843 learned_addr learned my addr 172.21.15.84:0/2733073843 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f082e000640 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a7e280 0x562d05e611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.264+0000 7f0836a00640 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e63800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0836a00640 1 -- 172.21.15.84:0/2733073843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a7e280 msgr2=0x562d05e611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:03.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0836a00640 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a7e280 0x562d05e611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0836a00640 1 -- 172.21.15.84:0/2733073843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 msgr2=0x562d05e4c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:03.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0836a00640 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e4c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0836a00640 1 -- 172.21.15.84:0/2733073843 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d05e4f560 con 0x562d05a760a0 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0837400640 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e4c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0836a00640 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e63800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0828000c00 tx=0x7f0828005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55280f081d46ce42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0827400640 1 -- 172.21.15.84:0/2733073843 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828040050 con 0x562d05a760a0 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0827400640 1 -- 172.21.15.84:0/2733073843 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0828004fe0 con 0x562d05a760a0 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.265+0000 7f0827400640 1 -- 172.21.15.84:0/2733073843 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828035040 con 0x562d05a760a0 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 -- 172.21.15.84:0/2733073843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 msgr2=0x562d05e63800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e63800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0828000c00 tx=0x7f0828005e80 comp rx=0 tx=0).stop 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 -- 172.21.15.84:0/2733073843 shutdown_connections 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a7e280 0x562d05e611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a9ef60 0x562d05e4c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 --2- 172.21.15.84:0/2733073843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e63800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 -- 172.21.15.84:0/2733073843 >> 172.21.15.84:0/2733073843 conn(0x562d05a93350 msgr2=0x562d05e51260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 -- 172.21.15.84:0/2733073843 shutdown_connections 2024-09-21T02:42:03.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.266+0000 7f0844a51740 1 -- 172.21.15.84:0/2733073843 wait complete. 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 1 -- start start 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 1 Processor -- start 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e65160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e65720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e6a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d05e63680 con 0x562d05a7e280 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562d05e62fb0 con 0x562d05a760a0 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d05e63d50 con 0x562d05a9ef60 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.267+0000 7f0844a51740 10 client.0 _ll_register_callbacks cb 0x7f083000fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e65160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e65160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56844/0 (socket says 172.21.15.84:56844) 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 -- 172.21.15.84:0/253684609 learned_addr learned my addr 172.21.15.84:0/253684609 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f082e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e65720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0837400640 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e6a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 -- 172.21.15.84:0/253684609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 msgr2=0x562d05e6a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e6a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 -- 172.21.15.84:0/253684609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 msgr2=0x562d05e65720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e65720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 -- 172.21.15.84:0/253684609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d05e6add0 con 0x562d05a760a0 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0836a00640 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e65160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0828004df0 tx=0x7f0828004e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0079052410cb11a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.268+0000 7f0824c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0824c00640 1 -- 172.21.15.84:0/253684609 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082805c060 con 0x562d05a760a0 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0844a51740 1 -- 172.21.15.84:0/253684609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0828004fe0 con 0x562d05a760a0 2024-09-21T02:42:03.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0824c00640 1 -- 172.21.15.84:0/253684609 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f0828004970 con 0x562d05a760a0 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0824c00640 1 -- 172.21.15.84:0/253684609 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0828063050 con 0x562d05a760a0 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0844a51740 10 client.25178 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0844a51740 1 -- 172.21.15.84:0/253684609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562d05e6c190 con 0x562d05a760a0 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0824c00640 1 -- 172.21.15.84:0/253684609 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0828004fe0 con 0x562d05a760a0 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0824c00640 1 -- 172.21.15.84:0/253684609 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0828003b10 con 0x562d05a760a0 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.269+0000 7f0844a51740 10 client.25178 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.270+0000 7f0844a51740 10 client.25178 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.270+0000 7f0844a51740 20 client.25178 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.270+0000 7f0844a51740 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x562d05a32c90 0x562d05ed1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.270+0000 7f0844a51740 4 client.25178 mds_command: new command op to 24703 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.270+0000 7f0844a51740 1 -- 172.21.15.84:0/253684609 --> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] -- command(tid 0: {"prefix": "status"}) -- 0x562d05dba750 con 0x562d05a32c90 2024-09-21T02:42:03.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.270+0000 7f082e000640 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x562d05a32c90 0x562d05ed1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.270+0000 7f082e000640 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x562d05a32c90 0x562d05ed1640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8983d67e36e4288 server_cookie=9f57d6358203baf4 in_seq=0 out_seq=0 2024-09-21T02:42:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.270+0000 7f0824c00640 10 client.25178 ms_handle_connect on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0824c00640 1 -- 172.21.15.84:0/253684609 <== mds.1 v2:172.21.15.172:6838/3937933536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562d05dba750 con 0x562d05a32c90 2024-09-21T02:42:03.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0824c00640 10 client.25178 handle_command_reply: tid=0 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 client.25178 shutdown 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 -- 172.21.15.84:0/253684609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 msgr2=0x562d05e65160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e65160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0828004df0 tx=0x7f0828004e20 comp rx=0 tx=0).stop 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 -- 172.21.15.84:0/253684609 shutdown_connections 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d05a9ef60 0x562d05e6a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x562d05a32c90 0x562d05ed1640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d05a7e280 0x562d05e65720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 --2- 172.21.15.84:0/253684609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562d05a760a0 0x562d05e65160 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 -- 172.21.15.84:0/253684609 >> 172.21.15.84:0/253684609 conn(0x562d05a93350 msgr2=0x562d05e4f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0824c00640 0 client.25178 ms_handle_reset on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 -- 172.21.15.84:0/253684609 shutdown_connections 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 1 -- 172.21.15.84:0/253684609 wait complete. 2024-09-21T02:42:03.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.271+0000 7f0844a51740 20 client.25178 trim_cache size 0 max 16384 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24703, 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 83.909111050000007, 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 26, 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 158.90948699399999 2024-09-21T02:42:03.276 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:42:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 -- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f081c0b65a0 msgr2=0x7f081c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f081c0b65a0 0x7f081c0b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0830011890 tx=0x7f0830009500 comp rx=0 tx=0).stop 2024-09-21T02:42:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 -- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f083810b4f0 msgr2=0x7f083819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:03.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f083810b4f0 0x7f083819cb60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f083806c8c0 tx=0x7f082000ee50 comp rx=0 tx=0).stop 2024-09-21T02:42:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 -- 172.21.15.84:0/1395658347 shutdown_connections 2024-09-21T02:42:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f081c0b65a0 0x7f081c0b8ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f083810be40 0x7f08381a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f083810b4f0 0x7f083819cb60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 --2- 172.21.15.84:0/1395658347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0838105bb0 0x7f083819c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 -- 172.21.15.84:0/1395658347 >> 172.21.15.84:0/1395658347 conn(0x7f0838101680 msgr2=0x7f083810aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 -- 172.21.15.84:0/1395658347 shutdown_connections 2024-09-21T02:42:03.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:03.272+0000 7f0837e00640 1 -- 172.21.15.84:0/1395658347 wait complete. 2024-09-21T02:42:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:03 smithi172 ceph-mon[35067]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:03 smithi084 ceph-mon[30747]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:04.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:03 smithi090 ceph-mon[34571]: pgmap v389: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:04.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:42:04.506 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:05.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.177+0000 7efc03400640 1 -- 172.21.15.84:0/2642460594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 msgr2=0x7efbfc1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.177+0000 7efc03400640 1 --2- 172.21.15.84:0/2642460594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 0x7efbfc1098e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efbe4009900 tx=0x7efbe402a410 comp rx=0 tx=0).stop 2024-09-21T02:42:05.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.177+0000 7efc03400640 1 -- 172.21.15.84:0/2642460594 shutdown_connections 2024-09-21T02:42:05.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.177+0000 7efc03400640 1 --2- 172.21.15.84:0/2642460594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc109e20 0x7efbfc110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.177+0000 7efc03400640 1 --2- 172.21.15.84:0/2642460594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 0x7efbfc1098e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.177+0000 7efc03400640 1 --2- 172.21.15.84:0/2642460594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc103b90 0x7efbfc103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.177+0000 7efc03400640 1 -- 172.21.15.84:0/2642460594 >> 172.21.15.84:0/2642460594 conn(0x7efbfc0ff600 msgr2=0x7efbfc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.178+0000 7efc03400640 1 -- 172.21.15.84:0/2642460594 shutdown_connections 2024-09-21T02:42:05.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.178+0000 7efc03400640 1 -- 172.21.15.84:0/2642460594 wait complete. 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc03400640 1 Processor -- start 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc03400640 1 -- start start 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc03400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc103b90 0x7efbfc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc03400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 0x7efbfc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc03400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc109e20 0x7efbfc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc03400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc113c00 con 0x7efbfc1094d0 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc03400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc113a80 con 0x7efbfc109e20 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc03400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc113d80 con 0x7efbfc103b90 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc00a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc103b90 0x7efbfc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efbf3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 0x7efbfc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.179+0000 7efc00a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc103b90 0x7efbfc19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:60342/0 (socket says 172.21.15.84:60342) 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efc00a00640 1 -- 172.21.15.84:0/943381581 learned_addr learned my addr 172.21.15.84:0/943381581 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:05.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efc01400640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc109e20 0x7efbfc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efbf3e00640 1 -- 172.21.15.84:0/943381581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc103b90 msgr2=0x7efbfc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efbf3e00640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc103b90 0x7efbfc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efbf3e00640 1 -- 172.21.15.84:0/943381581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc109e20 msgr2=0x7efbfc19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efbf3e00640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc109e20 0x7efbfc19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efbf3e00640 1 -- 172.21.15.84:0/943381581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc1a0500 con 0x7efbfc1094d0 2024-09-21T02:42:05.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efc00a00640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc103b90 0x7efbfc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:05.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.180+0000 7efbf3e00640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 0x7efbfc19ab30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efbe402a930 tx=0x7efbe4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.181+0000 7efbfa000640 1 -- 172.21.15.84:0/943381581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe403f030 con 0x7efbfc1094d0 2024-09-21T02:42:05.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.181+0000 7efbfa000640 1 -- 172.21.15.84:0/943381581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efbe4004440 con 0x7efbfc1094d0 2024-09-21T02:42:05.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.181+0000 7efc03400640 1 -- 172.21.15.84:0/943381581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc1a0790 con 0x7efbfc1094d0 2024-09-21T02:42:05.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.181+0000 7efbfa000640 1 -- 172.21.15.84:0/943381581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe4035070 con 0x7efbfc1094d0 2024-09-21T02:42:05.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.181+0000 7efc03400640 1 -- 172.21.15.84:0/943381581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc1a6f50 con 0x7efbfc1094d0 2024-09-21T02:42:05.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.184+0000 7efc0a00b740 1 Processor -- start 2024-09-21T02:42:05.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.184+0000 7efbfa000640 1 -- 172.21.15.84:0/943381581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7efbe4042030 con 0x7efbfc1094d0 2024-09-21T02:42:05.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.184+0000 7efc0a00b740 1 -- start start 2024-09-21T02:42:05.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b748a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a10a0 0x55baf3b74de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a9280 0x55baf3b75320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc0a00b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55baf3ae7d50 con 0x55baf37a10a0 2024-09-21T02:42:05.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc0a00b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55baf3ad7180 con 0x55baf37c9f60 2024-09-21T02:42:05.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc0a00b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55baf3adaf90 con 0x55baf37a9280 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc01400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc00a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a10a0 0x55baf3b74de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc01400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b748a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:56888/0 (socket says 172.21.15.84:56888) 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc01400640 1 -- 172.21.15.84:0/3907612948 learned_addr learned my addr 172.21.15.84:0/3907612948 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efbf3e00640 1 --2- 172.21.15.84:0/3907612948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a9280 0x55baf3b75320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc01400640 1 -- 172.21.15.84:0/3907612948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a9280 msgr2=0x55baf3b75320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc01400640 1 --2- 172.21.15.84:0/3907612948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a9280 0x55baf3b75320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc01400640 1 -- 172.21.15.84:0/3907612948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a10a0 msgr2=0x55baf3b74de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc01400640 1 --2- 172.21.15.84:0/3907612948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a10a0 0x55baf3b74de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.185+0000 7efc01400640 1 -- 172.21.15.84:0/3907612948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baf3aa1a70 con 0x55baf37c9f60 2024-09-21T02:42:05.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.186+0000 7efc01400640 1 --2- 172.21.15.84:0/3907612948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b748a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009fd0 tx=0x7efbf40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8500e4ac674871b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.186+0000 7efbf1c00640 1 -- 172.21.15.84:0/3907612948 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4004d20 con 0x55baf37c9f60 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.186+0000 7efbf1c00640 1 -- 172.21.15.84:0/3907612948 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efbf4004050 con 0x55baf37c9f60 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.186+0000 7efbf1c00640 1 -- 172.21.15.84:0/3907612948 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4005260 con 0x55baf37c9f60 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.186+0000 7efbfa000640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efbe00b6620 0x7efbe00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efbfa000640 1 -- 172.21.15.84:0/943381581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7efbe4107a60 con 0x7efbfc1094d0 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efc00a00640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efbe00b6620 0x7efbe00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efc0a00b740 1 -- 172.21.15.84:0/3907612948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 msgr2=0x55baf3b748a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efc0a00b740 1 --2- 172.21.15.84:0/3907612948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b748a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009fd0 tx=0x7efbf40118d0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efc0a00b740 1 -- 172.21.15.84:0/3907612948 shutdown_connections 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efc0a00b740 1 --2- 172.21.15.84:0/3907612948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a9280 0x55baf3b75320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efc0a00b740 1 --2- 172.21.15.84:0/3907612948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a10a0 0x55baf3b74de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efc0a00b740 1 --2- 172.21.15.84:0/3907612948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b748a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.187+0000 7efc0a00b740 1 -- 172.21.15.84:0/3907612948 >> 172.21.15.84:0/3907612948 conn(0x55baf37be350 msgr2=0x55baf3b72790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.188+0000 7efc0a00b740 1 -- 172.21.15.84:0/3907612948 shutdown_connections 2024-09-21T02:42:05.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.188+0000 7efc00a00640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efbe00b6620 0x7efbe00b8b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55baf3b73520 tx=0x7efbec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.188+0000 7efc0a00b740 1 -- 172.21.15.84:0/3907612948 wait complete. 2024-09-21T02:42:05.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.188+0000 7efc0a00b740 1 -- start start 2024-09-21T02:42:05.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.188+0000 7efc0a00b740 1 Processor -- start 2024-09-21T02:42:05.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b80540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b80a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b8c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc0a00b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55baf39385f0 con 0x55baf37a9280 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc0a00b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55baf3a72460 con 0x55baf37c9f60 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc0a00b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55baf3b83080 con 0x55baf37a10a0 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc0a00b740 10 client.0 _ll_register_callbacks cb 0x55baf3a82210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efbf3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b80a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efbf3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b80a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33588/0 (socket says 172.21.15.84:33588) 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efbf3e00640 1 -- 172.21.15.84:0/2786975010 learned_addr learned my addr 172.21.15.84:0/2786975010 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc00a00640 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b80540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.189+0000 7efc01400640 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b8c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbf3e00640 1 -- 172.21.15.84:0/2786975010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 msgr2=0x55baf3b80540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbf3e00640 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b80540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbf3e00640 1 -- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 msgr2=0x55baf3b8c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbf3e00640 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b8c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbf3e00640 1 -- 172.21.15.84:0/2786975010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baf3835540 con 0x55baf37a9280 2024-09-21T02:42:05.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efc01400640 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b8c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbf3e00640 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b80a80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efbe40c9d20 tx=0x7efbe4009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8402871df3e1bba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbea000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbea000640 1 -- 172.21.15.84:0/2786975010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe4049070 con 0x55baf37a9280 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbea000640 1 -- 172.21.15.84:0/2786975010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7efbe40d6e30 con 0x55baf37a9280 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efc0a00b740 1 -- 172.21.15.84:0/2786975010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55baf3a74a70 con 0x55baf37a9280 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efbea000640 1 -- 172.21.15.84:0/2786975010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efbe40ccec0 con 0x55baf37a9280 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efc0a00b740 10 client.15183 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.190+0000 7efc0a00b740 1 -- 172.21.15.84:0/2786975010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55baf3a8f6f0 con 0x55baf37a9280 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.191+0000 7efbea000640 1 -- 172.21.15.84:0/2786975010 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55baf3a74a70 con 0x55baf37a9280 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.191+0000 7efbea000640 1 -- 172.21.15.84:0/2786975010 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7efbe403bb40 con 0x55baf37a9280 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.191+0000 7efc0a00b740 10 client.15183 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.191+0000 7efc0a00b740 10 client.15183 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.191+0000 7efc0a00b740 20 client.15183 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:05.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.191+0000 7efc0a00b740 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55baf37888e0 0x55baf3b92900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.191+0000 7efc0a00b740 4 client.15183 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:05.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.191+0000 7efc0a00b740 1 -- 172.21.15.84:0/2786975010 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baf3ae9ca0 con 0x55baf37888e0 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.192+0000 7efc00a00640 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55baf37888e0 0x55baf3b92900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.192+0000 7efc00a00640 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55baf37888e0 0x55baf3b92900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ec6c10e5a44a1b server_cookie=fa7477f97f132da9 in_seq=0 out_seq=0 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.192+0000 7efbea000640 10 client.15183 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.193+0000 7efbea000640 1 -- 172.21.15.84:0/2786975010 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55baf3ae9ca0 con 0x55baf37888e0 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.193+0000 7efbea000640 10 client.15183 handle_command_reply: tid=0 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.193+0000 7efc0a00b740 1 client.15183 shutdown 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.193+0000 7efc0a00b740 1 -- 172.21.15.84:0/2786975010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 msgr2=0x55baf3b80a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.193+0000 7efc0a00b740 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b80a80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efbe40c9d20 tx=0x7efbe4009680 comp rx=0 tx=0).stop 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 1 -- 172.21.15.84:0/2786975010 shutdown_connections 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55baf37888e0 0x55baf3b92900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37c9f60 0x55baf3b8c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b80a80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 1 --2- 172.21.15.84:0/2786975010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b80540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 1 -- 172.21.15.84:0/2786975010 >> 172.21.15.84:0/2786975010 conn(0x55baf37be350 msgr2=0x55baf3b77a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efbea000640 0 client.15183 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 1 -- 172.21.15.84:0/2786975010 shutdown_connections 2024-09-21T02:42:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 1 -- 172.21.15.84:0/2786975010 wait complete. 2024-09-21T02:42:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.194+0000 7efc0a00b740 20 client.15183 trim_cache size 0 max 16384 2024-09-21T02:42:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc0a00b740 1 Processor -- start 2024-09-21T02:42:05.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc0a00b740 1 -- start start 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b7b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a9280 0x55baf3b7b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37c9f60 0x55baf3b7ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc0a00b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55baf3b90c40 con 0x55baf37c9f60 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc0a00b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55baf3b91310 con 0x55baf37a9280 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc0a00b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55baf3b919e0 con 0x55baf37a10a0 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc01400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37c9f60 0x55baf3b7ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc01400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37c9f60 0x55baf3b7ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33592/0 (socket says 172.21.15.84:33592) 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.213+0000 7efc01400640 1 -- 172.21.15.84:0/99806716 learned_addr learned my addr 172.21.15.84:0/99806716 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efc00a00640 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b7b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efbf3e00640 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a9280 0x55baf3b7b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efc00a00640 1 -- 172.21.15.84:0/99806716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a9280 msgr2=0x55baf3b7b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efc00a00640 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a9280 0x55baf3b7b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efc00a00640 1 -- 172.21.15.84:0/99806716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37c9f60 msgr2=0x55baf3b7ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efc00a00640 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37c9f60 0x55baf3b7ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efc00a00640 1 -- 172.21.15.84:0/99806716 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baf3b76b90 con 0x55baf37a10a0 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efbf3e00640 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a9280 0x55baf3b7b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efc01400640 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37c9f60 0x55baf3b7ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.214+0000 7efc00a00640 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b7b480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55baf3b81530 tx=0x7efbec01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6154474243b467 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efbf1200640 1 -- 172.21.15.84:0/99806716 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec005020 con 0x55baf37a10a0 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efbf1200640 1 -- 172.21.15.84:0/99806716 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efbec0047a0 con 0x55baf37a10a0 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efbf1200640 1 -- 172.21.15.84:0/99806716 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec02b7f0 con 0x55baf37a10a0 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efc0a00b740 1 -- 172.21.15.84:0/99806716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 msgr2=0x55baf3b7b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efc0a00b740 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b7b480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55baf3b81530 tx=0x7efbec01a000 comp rx=0 tx=0).stop 2024-09-21T02:42:05.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efc0a00b740 1 -- 172.21.15.84:0/99806716 shutdown_connections 2024-09-21T02:42:05.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efc0a00b740 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37c9f60 0x55baf3b7ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efc0a00b740 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a9280 0x55baf3b7b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efc0a00b740 1 --2- 172.21.15.84:0/99806716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37a10a0 0x55baf3b7b480 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.215+0000 7efc0a00b740 1 -- 172.21.15.84:0/99806716 >> 172.21.15.84:0/99806716 conn(0x55baf37be350 msgr2=0x55baf3b90220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.216+0000 7efc0a00b740 1 -- 172.21.15.84:0/99806716 shutdown_connections 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.216+0000 7efc0a00b740 1 -- 172.21.15.84:0/99806716 wait complete. 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.216+0000 7efc0a00b740 1 -- start start 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.216+0000 7efc0a00b740 1 Processor -- start 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a10a0 0x55baf3b9b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b950e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc0a00b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37c9f60 0x55baf3b956a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc0a00b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55baf3b92780 con 0x55baf37a9280 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc0a00b740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55baf3b920b0 con 0x55baf37a10a0 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc0a00b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55baf3b92e50 con 0x55baf37c9f60 2024-09-21T02:42:05.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc0a00b740 10 client.0 _ll_register_callbacks cb 0x55baf3a82210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efbf3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efbf3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b950e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33600/0 (socket says 172.21.15.84:33600) 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efbf3e00640 1 -- 172.21.15.84:0/1932219087 learned_addr learned my addr 172.21.15.84:0/1932219087 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc00a00640 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a10a0 0x55baf3b9b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efc01400640 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37c9f60 0x55baf3b956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efbf3e00640 1 -- 172.21.15.84:0/1932219087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37c9f60 msgr2=0x55baf3b956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efbf3e00640 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37c9f60 0x55baf3b956a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efbf3e00640 1 -- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a10a0 msgr2=0x55baf3b9b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.217+0000 7efbf3e00640 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a10a0 0x55baf3b9b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efbf3e00640 1 -- 172.21.15.84:0/1932219087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baf3b95e30 con 0x55baf37a9280 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efc00a00640 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a10a0 0x55baf3b9b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efbf3e00640 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b950e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efbe40ca9c0 tx=0x7efbe40d6e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfd630f60f41a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efbea000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efbea000640 1 -- 172.21.15.84:0/1932219087 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe4049070 con 0x55baf37a9280 2024-09-21T02:42:05.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efbea000640 1 -- 172.21.15.84:0/1932219087 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7efbe4031af0 con 0x55baf37a9280 2024-09-21T02:42:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efc0a00b740 1 -- 172.21.15.84:0/1932219087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efbec0047a0 con 0x55baf37a9280 2024-09-21T02:42:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efbea000640 1 -- 172.21.15.84:0/1932219087 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efbe40c95f0 con 0x55baf37a9280 2024-09-21T02:42:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efc0a00b740 10 client.15189 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:05.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.218+0000 7efc0a00b740 1 -- 172.21.15.84:0/1932219087 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55baf3bfddd0 con 0x55baf37a9280 2024-09-21T02:42:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efbea000640 1 -- 172.21.15.84:0/1932219087 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efbec0047a0 con 0x55baf37a9280 2024-09-21T02:42:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efbea000640 1 -- 172.21.15.84:0/1932219087 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7efbe40cc420 con 0x55baf37a9280 2024-09-21T02:42:05.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efc0a00b740 10 client.15189 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efc0a00b740 10 client.15189 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:42:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efc0a00b740 20 client.15189 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efc0a00b740 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55baf375dc90 0x55baf3c014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:05.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efc0a00b740 4 client.15189 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:42:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efc0a00b740 1 -- 172.21.15.84:0/1932219087 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "status"}) -- 0x55baf3ae5750 con 0x55baf375dc90 2024-09-21T02:42:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.219+0000 7efc00a00640 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55baf375dc90 0x55baf3c014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:05.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.220+0000 7efbea000640 10 client.15189 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.220+0000 7efc00a00640 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55baf375dc90 0x55baf3c014a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bb1bd78955973f server_cookie=31e0c9def2482dec in_seq=0 out_seq=0 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.220+0000 7efbea000640 1 -- 172.21.15.84:0/1932219087 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55baf3ae5750 con 0x55baf375dc90 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.220+0000 7efbea000640 10 client.15189 handle_command_reply: tid=0 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.220+0000 7efc0a00b740 1 client.15189 shutdown 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.220+0000 7efc0a00b740 1 -- 172.21.15.84:0/1932219087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 msgr2=0x55baf3b950e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.220+0000 7efc0a00b740 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b950e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efbe40ca9c0 tx=0x7efbe40d6e40 comp rx=0 tx=0).stop 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 1 -- 172.21.15.84:0/1932219087 shutdown_connections 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baf37c9f60 0x55baf3b956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55baf375dc90 0x55baf3c014a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baf37a9280 0x55baf3b950e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 1 --2- 172.21.15.84:0/1932219087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55baf37a10a0 0x55baf3b9b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 1 -- 172.21.15.84:0/1932219087 >> 172.21.15.84:0/1932219087 conn(0x55baf37be350 msgr2=0x55baf3b7b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efbea000640 0 client.15189 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 1 -- 172.21.15.84:0/1932219087 shutdown_connections 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 1 -- 172.21.15.84:0/1932219087 wait complete. 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc0a00b740 20 client.15189 trim_cache size 0 max 16384 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24704, 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:42:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:42:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:42:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 136.37564955799999, 2024-09-21T02:42:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 26, 2024-09-21T02:42:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:42:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:42:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 150.92790810599999 2024-09-21T02:42:05.228 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc03400640 1 -- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efbe00b6620 msgr2=0x7efbe00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc03400640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efbe00b6620 0x7efbe00b8b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55baf3b73520 tx=0x7efbec005f90 comp rx=0 tx=0).stop 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc03400640 1 -- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 msgr2=0x7efbfc19ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.221+0000 7efc03400640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 0x7efbfc19ab30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efbe402a930 tx=0x7efbe4004040 comp rx=0 tx=0).stop 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.222+0000 7efc03400640 1 -- 172.21.15.84:0/943381581 shutdown_connections 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.222+0000 7efc03400640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbfc109e20 0x7efbfc19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.222+0000 7efc03400640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efbfc1094d0 0x7efbfc19ab30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.222+0000 7efc03400640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7efbe00b6620 0x7efbe00b8b30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.222+0000 7efc03400640 1 --2- 172.21.15.84:0/943381581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc103b90 0x7efbfc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.222+0000 7efc03400640 1 -- 172.21.15.84:0/943381581 >> 172.21.15.84:0/943381581 conn(0x7efbfc0ff600 msgr2=0x7efbfc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.222+0000 7efc03400640 1 -- 172.21.15.84:0/943381581 shutdown_connections 2024-09-21T02:42:05.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:05.222+0000 7efc03400640 1 -- 172.21.15.84:0/943381581 wait complete. 2024-09-21T02:42:05.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:05 smithi084 ceph-mon[30747]: pgmap v390: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:42:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:05 smithi172 ceph-mon[35067]: pgmap v390: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:42:06.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:05 smithi090 ceph-mon[34571]: pgmap v390: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:42:06.030 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T02:42:06.030 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T02:42:06.041 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:42:06.041 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T02:42:06.411 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.036+0000 7fed02200640 1 -- 172.21.15.84:0/2626974837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc106a10 msgr2=0x7fecfc106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.036+0000 7fed02200640 1 --2- 172.21.15.84:0/2626974837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc106a10 0x7fecfc106e20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fece8009900 tx=0x7fece802a480 comp rx=0 tx=0).stop 2024-09-21T02:42:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.036+0000 7fed02200640 1 -- 172.21.15.84:0/2626974837 shutdown_connections 2024-09-21T02:42:07.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.036+0000 7fed02200640 1 --2- 172.21.15.84:0/2626974837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecfc1073b0 0x7fecfc10dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.036+0000 7fed02200640 1 --2- 172.21.15.84:0/2626974837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc106a10 0x7fecfc106e20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.036+0000 7fed02200640 1 --2- 172.21.15.84:0/2626974837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecfc105980 0x7fecfc105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.036+0000 7fed02200640 1 -- 172.21.15.84:0/2626974837 >> 172.21.15.84:0/2626974837 conn(0x7fecfc1012f0 msgr2=0x7fecfc1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.036+0000 7fed02200640 1 -- 172.21.15.84:0/2626974837 shutdown_connections 2024-09-21T02:42:07.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.037+0000 7fed02200640 1 -- 172.21.15.84:0/2626974837 wait complete. 2024-09-21T02:42:07.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.037+0000 7fed02200640 1 Processor -- start 2024-09-21T02:42:07.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fed02200640 1 -- start start 2024-09-21T02:42:07.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fed02200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc105980 0x7fecfc19c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:07.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fed02200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecfc106a10 0x7fecfc19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fed02200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecfc1073b0 0x7fecfc19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fed02200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc111700 con 0x7fecfc105980 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fed02200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc111580 con 0x7fecfc1073b0 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fed02200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc111880 con 0x7fecfc106a10 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fecfb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc105980 0x7fecfc19c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fecfb400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc105980 0x7fecfc19c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33608/0 (socket says 172.21.15.84:33608) 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fecfb400640 1 -- 172.21.15.84:0/3423602326 learned_addr learned my addr 172.21.15.84:0/3423602326 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.038+0000 7fecfaa00640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecfc106a10 0x7fecfc19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.039+0000 7fecfbe00640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecfc1073b0 0x7fecfc19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:07.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.039+0000 7fecfb400640 1 -- 172.21.15.84:0/3423602326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecfc106a10 msgr2=0x7fecfc19c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.039+0000 7fecfb400640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecfc106a10 0x7fecfc19c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.039+0000 7fecfb400640 1 -- 172.21.15.84:0/3423602326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecfc1073b0 msgr2=0x7fecfc19d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.039+0000 7fecfb400640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecfc1073b0 0x7fecfc19d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.039+0000 7fecfb400640 1 -- 172.21.15.84:0/3423602326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc19dd00 con 0x7fecfc105980 2024-09-21T02:42:07.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.039+0000 7fecfb400640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc105980 0x7fecfc19c2d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fecec00e9f0 tx=0x7fecec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.039+0000 7fecf3e00640 1 -- 172.21.15.84:0/3423602326 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec00cd80 con 0x7fecfc105980 2024-09-21T02:42:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.040+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc19dff0 con 0x7fecfc105980 2024-09-21T02:42:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.040+0000 7fecf3e00640 1 -- 172.21.15.84:0/3423602326 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fecec010900 con 0x7fecfc105980 2024-09-21T02:42:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.040+0000 7fecf3e00640 1 -- 172.21.15.84:0/3423602326 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec0188d0 con 0x7fecfc105980 2024-09-21T02:42:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.040+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc1a46f0 con 0x7fecfc105980 2024-09-21T02:42:07.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.041+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecfc10cb60 con 0x7fecfc105980 2024-09-21T02:42:07.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.045+0000 7fecf3e00640 1 -- 172.21.15.84:0/3423602326 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fecec010ab0 con 0x7fecfc105980 2024-09-21T02:42:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.046+0000 7fecf3e00640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fece00b65a0 0x7fece00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:07.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.046+0000 7fecf3e00640 1 -- 172.21.15.84:0/3423602326 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fecec0e8120 con 0x7fecfc105980 2024-09-21T02:42:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.046+0000 7fecfaa00640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fece00b65a0 0x7fece00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.047+0000 7fecfaa00640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fece00b65a0 0x7fece00b8ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fece8000c00 tx=0x7fece8031470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.048+0000 7fecf3e00640 1 -- 172.21.15.84:0/3423602326 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fecec0b2840 con 0x7fecfc105980 2024-09-21T02:42:07.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.249+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fecfc063800 con 0x7fece00b65a0 2024-09-21T02:42:07.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.251+0000 7fecf3e00640 1 -- 172.21.15.84:0/3423602326 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fecfc063800 con 0x7fece00b65a0 2024-09-21T02:42:07.252 INFO:teuthology.orchestra.run.smithi084.stdout:Backend: cephadm 2024-09-21T02:42:07.252 INFO:teuthology.orchestra.run.smithi084.stdout:Available: Yes 2024-09-21T02:42:07.253 INFO:teuthology.orchestra.run.smithi084.stdout:Paused: No 2024-09-21T02:42:07.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fece00b65a0 msgr2=0x7fece00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:07.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fece00b65a0 0x7fece00b8ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fece8000c00 tx=0x7fece8031470 comp rx=0 tx=0).stop 2024-09-21T02:42:07.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc105980 msgr2=0x7fecfc19c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:07.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc105980 0x7fecfc19c2d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fecec00e9f0 tx=0x7fecec00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 shutdown_connections 2024-09-21T02:42:07.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fece00b65a0 0x7fece00b8ab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecfc106a10 0x7fecfc19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fecfc1073b0 0x7fecfc19d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 --2- 172.21.15.84:0/3423602326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fecfc105980 0x7fecfc19c2d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:07.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 >> 172.21.15.84:0/3423602326 conn(0x7fecfc1012f0 msgr2=0x7fecfc109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:07.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 shutdown_connections 2024-09-21T02:42:07.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:07.254+0000 7fed02200640 1 -- 172.21.15.84:0/3423602326 wait complete. 2024-09-21T02:42:08.001 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:07 smithi084 ceph-mon[30747]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:08.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:07 smithi084 ceph-mon[30747]: pgmap v391: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:08.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:07 smithi172 ceph-mon[35067]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:08.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:07 smithi172 ceph-mon[35067]: pgmap v391: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:08.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:07 smithi090 ceph-mon[34571]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:08.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:07 smithi090 ceph-mon[34571]: pgmap v391: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:08.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T02:42:08.408 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 -- 172.21.15.84:0/1960474213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70105980 msgr2=0x7fcb70105df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 --2- 172.21.15.84:0/1960474213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70105980 0x7fcb70105df0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009900 tx=0x7fcb6402a480 comp rx=0 tx=0).stop 2024-09-21T02:42:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 -- 172.21.15.84:0/1960474213 shutdown_connections 2024-09-21T02:42:09.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 --2- 172.21.15.84:0/1960474213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb70106a10 0x7fcb70106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 --2- 172.21.15.84:0/1960474213 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb701073b0 0x7fcb7010dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 --2- 172.21.15.84:0/1960474213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70105980 0x7fcb70105df0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 -- 172.21.15.84:0/1960474213 >> 172.21.15.84:0/1960474213 conn(0x7fcb701012f0 msgr2=0x7fcb701037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 -- 172.21.15.84:0/1960474213 shutdown_connections 2024-09-21T02:42:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.027+0000 7fcb77e00640 1 -- 172.21.15.84:0/1960474213 wait complete. 2024-09-21T02:42:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.028+0000 7fcb77e00640 1 Processor -- start 2024-09-21T02:42:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.028+0000 7fcb77e00640 1 -- start start 2024-09-21T02:42:09.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.028+0000 7fcb77e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb70105980 0x7fcb7019c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.028+0000 7fcb77e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70106a10 0x7fcb7019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.028+0000 7fcb77e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb701073b0 0x7fcb7019d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.028+0000 7fcb77e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70111700 con 0x7fcb70106a10 2024-09-21T02:42:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.028+0000 7fcb77e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70111580 con 0x7fcb701073b0 2024-09-21T02:42:09.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.028+0000 7fcb77e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb70111880 con 0x7fcb70105980 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70106a10 0x7fcb7019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb75400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb70105980 0x7fcb7019c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70106a10 0x7fcb7019c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33616/0 (socket says 172.21.15.84:33616) 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 -- 172.21.15.84:0/3368266472 learned_addr learned my addr 172.21.15.84:0/3368266472 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb75e00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb701073b0 0x7fcb7019d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 -- 172.21.15.84:0/3368266472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb70105980 msgr2=0x7fcb7019c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb70105980 0x7fcb7019c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 -- 172.21.15.84:0/3368266472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb701073b0 msgr2=0x7fcb7019d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb701073b0 0x7fcb7019d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 -- 172.21.15.84:0/3368266472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7019dca0 con 0x7fcb70106a10 2024-09-21T02:42:09.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.029+0000 7fcb74a00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70106a10 0x7fcb7019c8e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00e9f0 tx=0x7fcb5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.030+0000 7fcb6e000640 1 -- 172.21.15.84:0/3368266472 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00cd80 con 0x7fcb70106a10 2024-09-21T02:42:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.030+0000 7fcb6e000640 1 -- 172.21.15.84:0/3368266472 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb5c010900 con 0x7fcb70106a10 2024-09-21T02:42:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.030+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7019df90 con 0x7fcb70106a10 2024-09-21T02:42:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.030+0000 7fcb6e000640 1 -- 172.21.15.84:0/3368266472 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c018920 con 0x7fcb70106a10 2024-09-21T02:42:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.030+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb701a4690 con 0x7fcb70106a10 2024-09-21T02:42:09.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.031+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7010cb60 con 0x7fcb70106a10 2024-09-21T02:42:09.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.033+0000 7fcb6e000640 1 -- 172.21.15.84:0/3368266472 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcb5c010ab0 con 0x7fcb70106a10 2024-09-21T02:42:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.035+0000 7fcb6e000640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcb580b65a0 0x7fcb580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.035+0000 7fcb6e000640 1 -- 172.21.15.84:0/3368266472 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fcb5c0e7c30 con 0x7fcb70106a10 2024-09-21T02:42:09.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.035+0000 7fcb75400640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcb580b65a0 0x7fcb580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:09.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.036+0000 7fcb75400640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcb580b65a0 0x7fcb580b8ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb64000c00 tx=0x7fcb64031470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:09.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.039+0000 7fcb6e000640 1 -- 172.21.15.84:0/3368266472 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb5c0b2350 con 0x7fcb70106a10 2024-09-21T02:42:09.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.234+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcb70063800 con 0x7fcb580b65a0 2024-09-21T02:42:09.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.247+0000 7fcb6e000640 1 -- 172.21.15.84:0/3368266472 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fcb70063800 con 0x7fcb580b65a0 2024-09-21T02:42:09.248 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T02:42:09.248 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (2m) 20s ago 2m 80.7M - 19.3.0-5120-g18432218 ddce307e1f32 04c1d9440035 2024-09-21T02:42:09.248 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi090 running (2m) 23s ago 2m 93.7M - 19.3.0-5120-g18432218 ddce307e1f32 4c2765dca7a2 2024-09-21T02:42:09.248 INFO:teuthology.orchestra.run.smithi084.stdout:mds.c smithi172 running (2m) 23s ago 2m 86.5M - 19.3.0-5120-g18432218 ddce307e1f32 54c03c993353 2024-09-21T02:42:09.248 INFO:teuthology.orchestra.run.smithi084.stdout:mds.d smithi084 running (2m) 20s ago 2m 80.9M - 19.3.0-5120-g18432218 ddce307e1f32 a441ab471a13 2024-09-21T02:42:09.248 INFO:teuthology.orchestra.run.smithi084.stdout:mds.e smithi090 running (2m) 23s ago 2m 85.2M - 19.3.0-5120-g18432218 ddce307e1f32 ce4ceace76bc 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mds.f smithi172 running (2m) 23s ago 2m 89.4M - 19.3.0-5120-g18432218 ddce307e1f32 44166c6d902a 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mds.g smithi084 running (2m) 20s ago 2m 80.6M - 19.3.0-5120-g18432218 ddce307e1f32 aa068203c841 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mds.h smithi090 running (2m) 23s ago 2m 88.0M - 19.3.0-5120-g18432218 ddce307e1f32 bce9a61af2cd 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mds.i smithi172 running (2m) 23s ago 2m 86.7M - 19.3.0-5120-g18432218 ddce307e1f32 919b18d18202 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mds.j smithi084 running (3m) 20s ago 3m 80.8M - 19.3.0-5120-g18432218 ddce307e1f32 4404949de542 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mds.k smithi090 running (3m) 23s ago 3m 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 31e7134a9ca9 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mds.l smithi172 running (3m) 23s ago 3m 83.3M - 19.3.0-5120-g18432218 ddce307e1f32 ae375eb4cf9c 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi084 *:9283,8765 running (11m) 20s ago 11m 592M - 19.3.0-5120-g18432218 ddce307e1f32 7df86c183f49 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi090 *:8443,8765 running (9m) 23s ago 9m 525M - 19.3.0-5120-g18432218 ddce307e1f32 f1184dc398db 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.z smithi172 *:8443,8765 running (9m) 23s ago 9m 525M - 19.3.0-5120-g18432218 ddce307e1f32 d5bee140c48c 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (11m) 20s ago 11m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 2869e05ceb39 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi090 running (9m) 23s ago 9m 112M 2048M 19.3.0-5120-g18432218 ddce307e1f32 0efa60bf2ee9 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi172 running (9m) 23s ago 9m 111M 2048M 19.3.0-5120-g18432218 ddce307e1f32 210a6b4d7312 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (8m) 20s ago 8m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0f8bae43b283 2024-09-21T02:42:09.249 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi090 running (8m) 23s ago 8m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6566d094bd45 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi172 running (7m) 23s ago 7m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1299ffacedc0 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (7m) 20s ago 7m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 552c81709c04 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi090 running (6m) 23s ago 6m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 dc806323920f 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi172 running (6m) 23s ago 6m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1cccded0deed 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi084 running (5m) 20s ago 5m 116M 4272M 19.3.0-5120-g18432218 ddce307e1f32 852277f5a631 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi090 running (5m) 23s ago 5m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 2ecc0edd0b13 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.8 smithi172 running (4m) 23s ago 4m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a33a0eb11755 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.9 smithi084 running (4m) 20s ago 4m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 dc72b82fb1d0 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.10 smithi090 running (3m) 23s ago 3m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4d07eb8f28fa 2024-09-21T02:42:09.250 INFO:teuthology.orchestra.run.smithi084.stdout:osd.11 smithi172 running (3m) 23s ago 3m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 0b58901da4c5 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcb580b65a0 msgr2=0x7fcb580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcb580b65a0 0x7fcb580b8ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb64000c00 tx=0x7fcb64031470 comp rx=0 tx=0).stop 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70106a10 msgr2=0x7fcb7019c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70106a10 0x7fcb7019c8e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00e9f0 tx=0x7fcb5c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 shutdown_connections 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb701073b0 0x7fcb7019d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb70106a10 0x7fcb7019c8e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcb580b65a0 0x7fcb580b8ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 --2- 172.21.15.84:0/3368266472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb70105980 0x7fcb7019c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:09.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.249+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 >> 172.21.15.84:0/3368266472 conn(0x7fcb701012f0 msgr2=0x7fcb70109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:09.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.250+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 shutdown_connections 2024-09-21T02:42:09.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:09.250+0000 7fcb77e00640 1 -- 172.21.15.84:0/3368266472 wait complete. 2024-09-21T02:42:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:09 smithi172 ceph-mon[35067]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:09 smithi172 ceph-mon[35067]: pgmap v392: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:10.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:09 smithi084 ceph-mon[30747]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:10.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:09 smithi084 ceph-mon[30747]: pgmap v392: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:09 smithi090 ceph-mon[34571]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:09 smithi090 ceph-mon[34571]: pgmap v392: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:10.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T02:42:10.459 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:11.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 -- 172.21.15.84:0/3053124477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc01047f0 msgr2=0x7f9cc0104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/3053124477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc01047f0 0x7f9cc0104c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009860 tx=0x7f9cac02a3d0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 -- 172.21.15.84:0/3053124477 shutdown_connections 2024-09-21T02:42:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/3053124477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc01047f0 0x7f9cc0104c00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/3053124477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0105190 0x7f9cc010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/3053124477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc0103760 0x7f9cc0103bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 -- 172.21.15.84:0/3053124477 >> 172.21.15.84:0/3053124477 conn(0x7f9cc00ff0b0 msgr2=0x7f9cc0101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 -- 172.21.15.84:0/3053124477 shutdown_connections 2024-09-21T02:42:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.075+0000 7f9cc6a00640 1 -- 172.21.15.84:0/3053124477 wait complete. 2024-09-21T02:42:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.076+0000 7f9cc6a00640 1 Processor -- start 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.076+0000 7f9cc6a00640 1 -- start start 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.076+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc0103760 0x7f9cc0076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc01047f0 0x7f9cc0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cc6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0105190 0x7f9cc0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cc6a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc010f4e0 con 0x7f9cc01047f0 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cc6a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc010f360 con 0x7f9cc0105190 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cc6a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc010f660 con 0x7f9cc0103760 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cbf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc01047f0 0x7f9cc0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cbfe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc0103760 0x7f9cc0076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cbf400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc01047f0 0x7f9cc0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36416/0 (socket says 172.21.15.84:36416) 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cbf400640 1 -- 172.21.15.84:0/215359846 learned_addr learned my addr 172.21.15.84:0/215359846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cc4a00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0105190 0x7f9cc0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cbfe00640 1 -- 172.21.15.84:0/215359846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0105190 msgr2=0x7f9cc0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cbfe00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0105190 0x7f9cc0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cbfe00640 1 -- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc01047f0 msgr2=0x7f9cc0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.077+0000 7f9cbfe00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc01047f0 0x7f9cc0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.078+0000 7f9cbfe00640 1 -- 172.21.15.84:0/215359846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc0076350 con 0x7f9cc0103760 2024-09-21T02:42:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.078+0000 7f9cbfe00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc0103760 0x7f9cc0076e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0005fd0 tx=0x7f9cb000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.078+0000 7f9cbcc00640 1 -- 172.21.15.84:0/215359846 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb000cd00 con 0x7f9cc0103760 2024-09-21T02:42:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.078+0000 7f9cbcc00640 1 -- 172.21.15.84:0/215359846 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9cb00035f0 con 0x7f9cc0103760 2024-09-21T02:42:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.078+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc01a4100 con 0x7f9cc0103760 2024-09-21T02:42:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.078+0000 7f9cbcc00640 1 -- 172.21.15.84:0/215359846 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0010690 con 0x7f9cc0103760 2024-09-21T02:42:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.078+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc01a45b0 con 0x7f9cc0103760 2024-09-21T02:42:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.080+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc010a940 con 0x7f9cc0103760 2024-09-21T02:42:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.082+0000 7f9cbcc00640 1 -- 172.21.15.84:0/215359846 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9cb00037a0 con 0x7f9cc0103760 2024-09-21T02:42:11.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.083+0000 7f9cbcc00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ca40b6620 0x7f9ca40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.084+0000 7f9cbcc00640 1 -- 172.21.15.84:0/215359846 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f9cb00e7ad0 con 0x7f9cc0103760 2024-09-21T02:42:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.084+0000 7f9cbf400640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ca40b6620 0x7f9ca40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.085+0000 7f9cbf400640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ca40b6620 0x7f9ca40b8b30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9cac030a80 tx=0x7f9cac0094b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:11.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.085+0000 7f9cbcc00640 1 -- 172.21.15.84:0/215359846 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cb0009510 con 0x7f9cc0103760 2024-09-21T02:42:11.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.283+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9cc0063800 con 0x7f9ca40b6620 2024-09-21T02:42:11.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.289+0000 7f9cbcc00640 1 -- 172.21.15.84:0/215359846 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f9cc0063800 con 0x7f9ca40b6620 2024-09-21T02:42:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T02:42:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:mds.all 12/12 25s ago 3m smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi090=b;smithi090=e;smithi090=h;smithi090=k;smithi172=c;smithi172=f;smithi172=i;smithi172=l;count:12 2024-09-21T02:42:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:mgr 3/3 25s ago 9m smithi084=x;smithi090=y;smithi172=z;count:3 2024-09-21T02:42:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:mon 3/3 25s ago 9m smithi084:172.21.15.84=a;smithi090:172.21.15.90=b;smithi172:172.21.15.172=c;count:3 2024-09-21T02:42:11.290 INFO:teuthology.orchestra.run.smithi084.stdout:osd 12 25s ago - 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ca40b6620 msgr2=0x7f9ca40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ca40b6620 0x7f9ca40b8b30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9cac030a80 tx=0x7f9cac0094b0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc0103760 msgr2=0x7f9cc0076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc0103760 0x7f9cc0076e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0005fd0 tx=0x7f9cb000ee50 comp rx=0 tx=0).stop 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 shutdown_connections 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0105190 0x7f9cc0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cc01047f0 0x7f9cc0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9ca40b6620 0x7f9ca40b8b30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 --2- 172.21.15.84:0/215359846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cc0103760 0x7f9cc0076e40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.291+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 >> 172.21.15.84:0/215359846 conn(0x7f9cc00ff0b0 msgr2=0x7f9cc0107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.292+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 shutdown_connections 2024-09-21T02:42:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:11.292+0000 7f9cc6a00640 1 -- 172.21.15.84:0/215359846 wait complete. 2024-09-21T02:42:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:11 smithi172 ceph-mon[35067]: from='client.25225 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:11 smithi172 ceph-mon[35067]: pgmap v393: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:12.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:11 smithi084 ceph-mon[30747]: from='client.25225 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:11 smithi084 ceph-mon[30747]: pgmap v393: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:12.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:11 smithi090 ceph-mon[34571]: from='client.25225 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:12.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:11 smithi090 ceph-mon[34571]: pgmap v393: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:12.138 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T02:42:12.507 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:13.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 -- 172.21.15.84:0/2999051328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20079640 msgr2=0x7f1a20079fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:13.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 --2- 172.21.15.84:0/2999051328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20079640 0x7f1a20079fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009be0 tx=0x7f1a1802a750 comp rx=0 tx=0).stop 2024-09-21T02:42:13.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 -- 172.21.15.84:0/2999051328 shutdown_connections 2024-09-21T02:42:13.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 --2- 172.21.15.84:0/2999051328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a20078ca0 0x7f1a200790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 --2- 172.21.15.84:0/2999051328 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20079640 0x7f1a20079fb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 --2- 172.21.15.84:0/2999051328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a20077c10 0x7f1a20078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 -- 172.21.15.84:0/2999051328 >> 172.21.15.84:0/2999051328 conn(0x7f1a20101100 msgr2=0x7f1a201035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:13.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 -- 172.21.15.84:0/2999051328 shutdown_connections 2024-09-21T02:42:13.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.153+0000 7f1a26e00640 1 -- 172.21.15.84:0/2999051328 wait complete. 2024-09-21T02:42:13.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.154+0000 7f1a26e00640 1 Processor -- start 2024-09-21T02:42:13.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.154+0000 7f1a26e00640 1 -- start start 2024-09-21T02:42:13.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.154+0000 7f1a26e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a20077c10 0x7f1a201a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:13.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.154+0000 7f1a26e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20078ca0 0x7f1a201a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.154+0000 7f1a26e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a20079640 0x7f1a201a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.154+0000 7f1a26e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20115920 con 0x7f1a20079640 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.154+0000 7f1a26e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a201157a0 con 0x7f1a20078ca0 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.154+0000 7f1a26e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20115aa0 con 0x7f1a20077c10 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a26400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a20079640 0x7f1a201a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a25a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a20077c10 0x7f1a201a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a26400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a20079640 0x7f1a201a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36446/0 (socket says 172.21.15.84:36446) 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a26400640 1 -- 172.21.15.84:0/3567450798 learned_addr learned my addr 172.21.15.84:0/3567450798 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a25000640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20078ca0 0x7f1a201a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a26400640 1 -- 172.21.15.84:0/3567450798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a20077c10 msgr2=0x7f1a201a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a26400640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a20077c10 0x7f1a201a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a26400640 1 -- 172.21.15.84:0/3567450798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20078ca0 msgr2=0x7f1a201a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a26400640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20078ca0 0x7f1a201a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a26400640 1 -- 172.21.15.84:0/3567450798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a201a1e90 con 0x7f1a20079640 2024-09-21T02:42:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a25a00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a20077c10 0x7f1a201a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.155+0000 7f1a25000640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20078ca0 0x7f1a201a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.156+0000 7f1a26400640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a20079640 0x7f1a201a1670 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1a18034040 tx=0x7f1a18030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.156+0000 7f1a1e000640 1 -- 172.21.15.84:0/3567450798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18041020 con 0x7f1a20079640 2024-09-21T02:42:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.156+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a201a2120 con 0x7f1a20079640 2024-09-21T02:42:13.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.156+0000 7f1a1e000640 1 -- 172.21.15.84:0/3567450798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a18031910 con 0x7f1a20079640 2024-09-21T02:42:13.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.156+0000 7f1a1e000640 1 -- 172.21.15.84:0/3567450798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18036040 con 0x7f1a20079640 2024-09-21T02:42:13.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.156+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a201a8880 con 0x7f1a20079640 2024-09-21T02:42:13.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.157+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a201129d0 con 0x7f1a20079640 2024-09-21T02:42:13.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.159+0000 7f1a1e000640 1 -- 172.21.15.84:0/3567450798 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1a18044020 con 0x7f1a20079640 2024-09-21T02:42:13.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.161+0000 7f1a1e000640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a080b65a0 0x7f1a080b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:13.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.161+0000 7f1a1e000640 1 -- 172.21.15.84:0/3567450798 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f1a18108980 con 0x7f1a20079640 2024-09-21T02:42:13.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.161+0000 7f1a25a00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a080b65a0 0x7f1a080b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:13.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.162+0000 7f1a25a00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a080b65a0 0x7f1a080b8ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1a140096c0 tx=0x7f1a14009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:13.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.164+0000 7f1a1e000640 1 -- 172.21.15.84:0/3567450798 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a1804b020 con 0x7f1a20079640 2024-09-21T02:42:13.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.356+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f1a20063800 con 0x7f1a080b65a0 2024-09-21T02:42:13.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.357+0000 7f1a1e000640 1 -- 172.21.15.84:0/3567450798 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f1a20063800 con 0x7f1a080b65a0 2024-09-21T02:42:13.359 INFO:teuthology.orchestra.run.smithi084.stdout:HOST ADDR LABELS STATUS 2024-09-21T02:42:13.359 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 172.21.15.84 2024-09-21T02:42:13.359 INFO:teuthology.orchestra.run.smithi084.stdout:smithi090 172.21.15.90 2024-09-21T02:42:13.359 INFO:teuthology.orchestra.run.smithi084.stdout:smithi172 172.21.15.172 2024-09-21T02:42:13.359 INFO:teuthology.orchestra.run.smithi084.stdout:3 hosts in cluster 2024-09-21T02:42:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a080b65a0 msgr2=0x7f1a080b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a080b65a0 0x7f1a080b8ab0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1a140096c0 tx=0x7f1a14009260 comp rx=0 tx=0).stop 2024-09-21T02:42:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a20079640 msgr2=0x7f1a201a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a20079640 0x7f1a201a1670 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1a18034040 tx=0x7f1a18030d70 comp rx=0 tx=0).stop 2024-09-21T02:42:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 shutdown_connections 2024-09-21T02:42:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a20079640 0x7f1a201a1670 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a20078ca0 0x7f1a201a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1a080b65a0 0x7f1a080b8ab0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 --2- 172.21.15.84:0/3567450798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a20077c10 0x7f1a201a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 >> 172.21.15.84:0/3567450798 conn(0x7f1a20101100 msgr2=0x7f1a2010fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 shutdown_connections 2024-09-21T02:42:13.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:13.360+0000 7f1a26e00640 1 -- 172.21.15.84:0/3567450798 wait complete. 2024-09-21T02:42:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:13 smithi172 ceph-mon[35067]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:13 smithi172 ceph-mon[35067]: pgmap v394: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:14.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:13 smithi084 ceph-mon[30747]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:13 smithi084 ceph-mon[30747]: pgmap v394: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:14.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:13 smithi090 ceph-mon[34571]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:14.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:13 smithi090 ceph-mon[34571]: pgmap v394: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:14.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T02:42:14.539 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:15.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.176+0000 7fbf59e00640 1 -- 172.21.15.84:0/3267627682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf54106820 msgr2=0x7fbf54106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:15.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.176+0000 7fbf59e00640 1 --2- 172.21.15.84:0/3267627682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf54106820 0x7fbf54106c30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf40009900 tx=0x7fbf4002a480 comp rx=0 tx=0).stop 2024-09-21T02:42:15.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.177+0000 7fbf59e00640 1 -- 172.21.15.84:0/3267627682 shutdown_connections 2024-09-21T02:42:15.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.177+0000 7fbf59e00640 1 --2- 172.21.15.84:0/3267627682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf541071c0 0x7fbf5410db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.177+0000 7fbf59e00640 1 --2- 172.21.15.84:0/3267627682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf54106820 0x7fbf54106c30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.177+0000 7fbf59e00640 1 --2- 172.21.15.84:0/3267627682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf54105790 0x7fbf54105c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.177+0000 7fbf59e00640 1 -- 172.21.15.84:0/3267627682 >> 172.21.15.84:0/3267627682 conn(0x7fbf54101100 msgr2=0x7fbf541035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:15.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.177+0000 7fbf59e00640 1 -- 172.21.15.84:0/3267627682 shutdown_connections 2024-09-21T02:42:15.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.177+0000 7fbf59e00640 1 -- 172.21.15.84:0/3267627682 wait complete. 2024-09-21T02:42:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59e00640 1 Processor -- start 2024-09-21T02:42:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59e00640 1 -- start start 2024-09-21T02:42:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf54105790 0x7fbf5419c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf54106820 0x7fbf5419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf541071c0 0x7fbf5419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbf54111560 con 0x7fbf541071c0 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541113e0 con 0x7fbf54106820 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf541116e0 con 0x7fbf54105790 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf54105790 0x7fbf5419c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.178+0000 7fbf59400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf541071c0 0x7fbf5419d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf54105790 0x7fbf5419c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:36822/0 (socket says 172.21.15.84:36822) 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 -- 172.21.15.84:0/438523921 learned_addr learned my addr 172.21.15.84:0/438523921 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf53e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf54106820 0x7fbf5419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 -- 172.21.15.84:0/438523921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf54106820 msgr2=0x7fbf5419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf54106820 0x7fbf5419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 -- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf541071c0 msgr2=0x7fbf5419d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:15.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf541071c0 0x7fbf5419d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 -- 172.21.15.84:0/438523921 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5419db00 con 0x7fbf54105790 2024-09-21T02:42:15.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf59400640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf541071c0 0x7fbf5419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:15.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.179+0000 7fbf58a00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf54105790 0x7fbf5419c0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800e9f0 tx=0x7fbf4800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:15.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.180+0000 7fbf51600640 1 -- 172.21.15.84:0/438523921 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800cd80 con 0x7fbf54105790 2024-09-21T02:42:15.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.180+0000 7fbf51600640 1 -- 172.21.15.84:0/438523921 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf48010900 con 0x7fbf54105790 2024-09-21T02:42:15.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.180+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5419ddf0 con 0x7fbf54105790 2024-09-21T02:42:15.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.180+0000 7fbf51600640 1 -- 172.21.15.84:0/438523921 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48018920 con 0x7fbf54105790 2024-09-21T02:42:15.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.180+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf541a44f0 con 0x7fbf54105790 2024-09-21T02:42:15.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.181+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5410c970 con 0x7fbf54105790 2024-09-21T02:42:15.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.183+0000 7fbf51600640 1 -- 172.21.15.84:0/438523921 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fbf48010ab0 con 0x7fbf54105790 2024-09-21T02:42:15.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.185+0000 7fbf51600640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf3c0b6590 0x7fbf3c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:15.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.185+0000 7fbf51600640 1 -- 172.21.15.84:0/438523921 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fbf480e7e90 con 0x7fbf54105790 2024-09-21T02:42:15.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.185+0000 7fbf53e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf3c0b6590 0x7fbf3c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.185+0000 7fbf53e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf3c0b6590 0x7fbf3c0b8aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf40004770 tx=0x7fbf40031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.186+0000 7fbf51600640 1 -- 172.21.15.84:0/438523921 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf480b2710 con 0x7fbf54105790 2024-09-21T02:42:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.381+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fbf54063800 con 0x7fbf3c0b6590 2024-09-21T02:42:15.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.383+0000 7fbf51600640 1 -- 172.21.15.84:0/438523921 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fbf54063800 con 0x7fbf3c0b6590 2024-09-21T02:42:15.384 INFO:teuthology.orchestra.run.smithi084.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T02:42:15.384 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WF400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-21T02:42:15.384 INFO:teuthology.orchestra.run.smithi084.stdout:smithi090 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UK400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T02:42:15.384 INFO:teuthology.orchestra.run.smithi084.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf3c0b6590 msgr2=0x7fbf3c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf3c0b6590 0x7fbf3c0b8aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbf40004770 tx=0x7fbf40031510 comp rx=0 tx=0).stop 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf54105790 msgr2=0x7fbf5419c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf54105790 0x7fbf5419c0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800e9f0 tx=0x7fbf4800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 shutdown_connections 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf541071c0 0x7fbf5419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf54106820 0x7fbf5419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbf3c0b6590 0x7fbf3c0b8aa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 --2- 172.21.15.84:0/438523921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf54105790 0x7fbf5419c0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.385+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 >> 172.21.15.84:0/438523921 conn(0x7fbf54101100 msgr2=0x7fbf54109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.386+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 shutdown_connections 2024-09-21T02:42:15.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:15.386+0000 7fbf59e00640 1 -- 172.21.15.84:0/438523921 wait complete. 2024-09-21T02:42:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:15 smithi172 ceph-mon[35067]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-21T02:42:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:15 smithi172 ceph-mon[35067]: from='client.25237 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:15 smithi172 ceph-mon[35067]: pgmap v395: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T02:42:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:15 smithi084 ceph-mon[30747]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-21T02:42:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:15 smithi084 ceph-mon[30747]: from='client.25237 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:15 smithi084 ceph-mon[30747]: pgmap v395: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T02:42:16.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:15 smithi090 ceph-mon[34571]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-21T02:42:16.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:15 smithi090 ceph-mon[34571]: from='client.25237 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:15 smithi090 ceph-mon[34571]: pgmap v395: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T02:42:16.146 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T02:42:16.155 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:42:16.155 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T02:42:16.524 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 -- 172.21.15.84:0/1257313681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 msgr2=0x7fb70810b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1257313681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 0x7fb70810b940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb700009900 tx=0x7fb70002a480 comp rx=0 tx=0).stop 2024-09-21T02:42:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 -- 172.21.15.84:0/1257313681 shutdown_connections 2024-09-21T02:42:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1257313681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 0x7fb70810b940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1257313681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb708104600 0x7fb708104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1257313681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb708103570 0x7fb7081039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 -- 172.21.15.84:0/1257313681 >> 172.21.15.84:0/1257313681 conn(0x7fb7080feec0 msgr2=0x7fb708101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:17.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 -- 172.21.15.84:0/1257313681 shutdown_connections 2024-09-21T02:42:17.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.144+0000 7fb70ca00640 1 -- 172.21.15.84:0/1257313681 wait complete. 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.145+0000 7fb70ca00640 1 Processor -- start 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.145+0000 7fb70ca00640 1 -- start start 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb70ca00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb708103570 0x7fb708076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb70ca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb708104600 0x7fb708075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb70ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 0x7fb708075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb70ca00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810f2f0 con 0x7fb708104fa0 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb70ca00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810f170 con 0x7fb708104600 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb70ca00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb70810f470 con 0x7fb708103570 2024-09-21T02:42:17.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb707e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 0x7fb708075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb707e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 0x7fb708075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36474/0 (socket says 172.21.15.84:36474) 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb707e00640 1 -- 172.21.15.84:0/1986944675 learned_addr learned my addr 172.21.15.84:0/1986944675 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb706a00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb708104600 0x7fb708075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb707400640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb708103570 0x7fb708076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.146+0000 7fb707e00640 1 -- 172.21.15.84:0/1986944675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb708103570 msgr2=0x7fb708076e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb707e00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb708103570 0x7fb708076e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb707e00640 1 -- 172.21.15.84:0/1986944675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb708104600 msgr2=0x7fb708075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb707e00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb708104600 0x7fb708075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb707e00640 1 -- 172.21.15.84:0/1986944675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb708076350 con 0x7fb708104fa0 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb706a00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb708104600 0x7fb708075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb707e00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 0x7fb708075c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb700009230 tx=0x7fb700004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb6ffe00640 1 -- 172.21.15.84:0/1986944675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70003f030 con 0x7fb708104fa0 2024-09-21T02:42:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb6ffe00640 1 -- 172.21.15.84:0/1986944675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb700003ac0 con 0x7fb708104fa0 2024-09-21T02:42:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7081a3ed0 con 0x7fb708104fa0 2024-09-21T02:42:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb6ffe00640 1 -- 172.21.15.84:0/1986944675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700035070 con 0x7fb708104fa0 2024-09-21T02:42:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.147+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7081a4270 con 0x7fb708104fa0 2024-09-21T02:42:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.148+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7081039e0 con 0x7fb708104fa0 2024-09-21T02:42:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.152+0000 7fb6ffe00640 1 -- 172.21.15.84:0/1986944675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb700042030 con 0x7fb708104fa0 2024-09-21T02:42:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.154+0000 7fb6ffe00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb6ec0b6510 0x7fb6ec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.154+0000 7fb6ffe00640 1 -- 172.21.15.84:0/1986944675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fb7001080e0 con 0x7fb708104fa0 2024-09-21T02:42:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.154+0000 7fb707400640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb6ec0b6510 0x7fb6ec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:17.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.155+0000 7fb707400640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb6ec0b6510 0x7fb6ec0b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8005fd0 tx=0x7fb6f8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:17.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.156+0000 7fb6ffe00640 1 -- 172.21.15.84:0/1986944675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7000d29c0 con 0x7fb708104fa0 2024-09-21T02:42:17.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.379+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb70810a750 con 0x7fb708104fa0 2024-09-21T02:42:17.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.380+0000 7fb6ffe00640 1 -- 172.21.15.84:0/1986944675 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3086 (secure 0 0 0) 0x7fb70810a750 con 0x7fb708104fa0 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout:e26 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout:btime 2024-09-21T02:40:45:465332+0000 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-09-21T02:42:17.382 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 26 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-09-21T02:39:47.859217+0000 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-09-21T02:40:44.516130+0000 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 300 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-09-21T02:42:17.383 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 3 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1,2 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24704,1=24703,2=24679} 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3,4] 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 0 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 24704 members: 24704,24703,24679 2024-09-21T02:42:17.384 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b{0:24704} state up:active seq 5 addr [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.f{0:24673} state up:standby-replay seq 1 addr [v2:172.21.15.172:6834/2876777250,v1:172.21.15.172:6835/2876777250] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.i{1:24703} state up:active seq 20 addr [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.h{1:24668} state up:standby-replay seq 1 addr [v2:172.21.15.90:6836/939715852,v1:172.21.15.90:6837/939715852] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c{2:24679} state up:active seq 22 addr [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.e{2:24647} state up:standby-replay seq 1 addr [v2:172.21.15.90:6834/1905318969,v1:172.21.15.90:6835/1905318969] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d{-1:14631} state up:standby seq 1 addr [v2:172.21.15.84:6836/688117760,v1:172.21.15.84:6837/688117760] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.g{-1:14679} state up:standby seq 1 addr [v2:172.21.15.84:6838/594957392,v1:172.21.15.84:6839/594957392] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.385 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a{-1:14691} state up:standby seq 1 addr [v2:172.21.15.84:6840/3752727807,v1:172.21.15.84:6841/3752727807] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.386 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.k{-1:24611} state up:standby seq 1 addr [v2:172.21.15.90:6832/1029758123,v1:172.21.15.90:6833/1029758123] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.386 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.l{-1:24625} state up:standby seq 1 addr [v2:172.21.15.172:6832/1475355449,v1:172.21.15.172:6833/1475355449] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.386 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.j{-1:24637} state up:standby seq 1 addr [v2:172.21.15.84:6834/3765261714,v1:172.21.15.84:6835/3765261714] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T02:42:17.386 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.382+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb6ec0b6510 msgr2=0x7fb6ec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.382+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb6ec0b6510 0x7fb6ec0b8a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8005fd0 tx=0x7fb6f8009500 comp rx=0 tx=0).stop 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.382+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 msgr2=0x7fb708075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.382+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 0x7fb708075c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb700009230 tx=0x7fb700004270 comp rx=0 tx=0).stop 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.383+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 shutdown_connections 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.383+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb708104fa0 0x7fb708075c50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.383+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb708104600 0x7fb708075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.383+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb6ec0b6510 0x7fb6ec0b8a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.383+0000 7fb70ca00640 1 --2- 172.21.15.84:0/1986944675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb708103570 0x7fb708076e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.383+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 >> 172.21.15.84:0/1986944675 conn(0x7fb7080feec0 msgr2=0x7fb708107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.383+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 shutdown_connections 2024-09-21T02:42:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:17.383+0000 7fb70ca00640 1 -- 172.21.15.84:0/1986944675 wait complete. 2024-09-21T02:42:17.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:17 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1986944675' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T02:42:17.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:17 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1986944675' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T02:42:17.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:17 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1986944675' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T02:42:18.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T02:42:18.540 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:18.717 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:18 smithi084 ceph-mon[30747]: pgmap v396: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T02:42:18.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:18 smithi172 ceph-mon[35067]: pgmap v396: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T02:42:18.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:18 smithi090 ceph-mon[34571]: pgmap v396: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T02:42:19.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.165+0000 7f463d200640 1 -- 172.21.15.84:0/2909278180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4638079640 msgr2=0x7f4638079fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:19.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.165+0000 7f463d200640 1 --2- 172.21.15.84:0/2909278180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4638079640 0x7f4638079fb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4630009ca0 tx=0x7f463002a950 comp rx=0 tx=0).stop 2024-09-21T02:42:19.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.166+0000 7f463d200640 1 -- 172.21.15.84:0/2909278180 shutdown_connections 2024-09-21T02:42:19.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.166+0000 7f463d200640 1 --2- 172.21.15.84:0/2909278180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4638078ca0 0x7f46380790b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.166+0000 7f463d200640 1 --2- 172.21.15.84:0/2909278180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4638079640 0x7f4638079fb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.166+0000 7f463d200640 1 --2- 172.21.15.84:0/2909278180 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4638077c10 0x7f4638078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.166+0000 7f463d200640 1 -- 172.21.15.84:0/2909278180 >> 172.21.15.84:0/2909278180 conn(0x7f46381012f0 msgr2=0x7f46381037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:19.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.166+0000 7f463d200640 1 -- 172.21.15.84:0/2909278180 shutdown_connections 2024-09-21T02:42:19.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.166+0000 7f463d200640 1 -- 172.21.15.84:0/2909278180 wait complete. 2024-09-21T02:42:19.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.167+0000 7f463d200640 1 Processor -- start 2024-09-21T02:42:19.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.167+0000 7f463d200640 1 -- start start 2024-09-21T02:42:19.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f463d200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4638077c10 0x7f46381a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f463d200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4638078ca0 0x7f46381a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f463d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4638079640 0x7f46381a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f463d200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4638115b10 con 0x7f4638079640 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f463d200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4638115990 con 0x7f4638077c10 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f463d200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4638115c90 con 0x7f4638078ca0 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f462fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4638078ca0 0x7f46381a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f462fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4638078ca0 0x7f46381a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:36856/0 (socket says 172.21.15.84:36856) 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f462fe00640 1 -- 172.21.15.84:0/520166343 learned_addr learned my addr 172.21.15.84:0/520166343 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f4635e00640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4638077c10 0x7f46381a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f4636800640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4638079640 0x7f46381a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f462fe00640 1 -- 172.21.15.84:0/520166343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4638077c10 msgr2=0x7f46381a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f462fe00640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4638077c10 0x7f46381a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f462fe00640 1 -- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4638079640 msgr2=0x7f46381a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:19.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f462fe00640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4638079640 0x7f46381a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.168+0000 7f462fe00640 1 -- 172.21.15.84:0/520166343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46381a20b0 con 0x7f4638078ca0 2024-09-21T02:42:19.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.169+0000 7f462fe00640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4638078ca0 0x7f46381a0cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f462000e9f0 tx=0x7f462000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:19.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.169+0000 7f462ea00640 1 -- 172.21.15.84:0/520166343 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462000cd80 con 0x7f4638078ca0 2024-09-21T02:42:19.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.169+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46381a23a0 con 0x7f4638078ca0 2024-09-21T02:42:19.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.169+0000 7f462ea00640 1 -- 172.21.15.84:0/520166343 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f46200054f0 con 0x7f4638078ca0 2024-09-21T02:42:19.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.169+0000 7f462ea00640 1 -- 172.21.15.84:0/520166343 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620010690 con 0x7f4638078ca0 2024-09-21T02:42:19.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.169+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46381a8aa0 con 0x7f4638078ca0 2024-09-21T02:42:19.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.170+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46381124b0 con 0x7f4638078ca0 2024-09-21T02:42:19.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.173+0000 7f462ea00640 1 -- 172.21.15.84:0/520166343 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f46200046c0 con 0x7f4638078ca0 2024-09-21T02:42:19.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.175+0000 7f462ea00640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f461c0b6510 0x7f461c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:19.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.175+0000 7f462ea00640 1 -- 172.21.15.84:0/520166343 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f46200e7d30 con 0x7f4638078ca0 2024-09-21T02:42:19.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.175+0000 7f4635e00640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f461c0b6510 0x7f461c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:19.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.176+0000 7f4635e00640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f461c0b6510 0x7f461c0b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4628009bd0 tx=0x7f4628005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:19.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.176+0000 7f462ea00640 1 -- 172.21.15.84:0/520166343 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4620056710 con 0x7f4638078ca0 2024-09-21T02:42:19.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.365+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f463802e640 con 0x7f4638078ca0 2024-09-21T02:42:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.367+0000 7f462ea00640 1 -- 172.21.15.84:0/520166343 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5644 (secure 0 0 0) 0x7f46200ae1d0 con 0x7f4638078ca0 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 88 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-09-21T02:30:39.705635+0000 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-09-21T02:41:44.334281+0000 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:crush_version 27 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:full_ratio 0.95 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:backfillfull_ratio 0.9 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:nearfull_ratio 0.85 2024-09-21T02:42:19.369 INFO:teuthology.orchestra.run.smithi084.stdout:require_min_compat_client luminous 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:min_compat_client luminous 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:require_osd_release squid 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:stretch_mode_enabled false 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:max_osd 12 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6802/3291842956,v1:172.21.15.84:6803/3291842956] [v2:172.21.15.84:6804/3291842956,v1:172.21.15.84:6805/3291842956] exists,up d5e3c2be-3797-41fc-ad09-a84eaae5cd87 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6800/1253575304,v1:172.21.15.90:6801/1253575304] [v2:172.21.15.90:6802/1253575304,v1:172.21.15.90:6803/1253575304] exists,up 04282e2a-4e57-4b6a-9e35-2acbf64bc65f 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 up in weight 1 up_from 18 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/105113584,v1:172.21.15.172:6801/105113584] [v2:172.21.15.172:6802/105113584,v1:172.21.15.172:6803/105113584] exists,up 44e5c979-386a-496f-97a0-6fd02825c725 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6810/2780019322,v1:172.21.15.84:6811/2780019322] [v2:172.21.15.84:6812/2780019322,v1:172.21.15.84:6813/2780019322] exists,up 990a6d3d-f181-4236-8f89-89ccf33456dc 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 up in weight 1 up_from 31 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6808/1991269390,v1:172.21.15.90:6809/1991269390] [v2:172.21.15.90:6810/1991269390,v1:172.21.15.90:6811/1991269390] exists,up 6d366acd-ad48-43e2-ad7e-eed923fbf8eb 2024-09-21T02:42:19.370 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 up in weight 1 up_from 35 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/3941830817,v1:172.21.15.172:6809/3941830817] [v2:172.21.15.172:6810/3941830817,v1:172.21.15.172:6811/3941830817] exists,up c12622ec-42b4-431d-be3a-09277322ecda 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 up in weight 1 up_from 41 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6818/4007584109,v1:172.21.15.84:6819/4007584109] [v2:172.21.15.84:6820/4007584109,v1:172.21.15.84:6821/4007584109] exists,up fd5c4982-d301-4b87-a9cc-14740596822d 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 up in weight 1 up_from 46 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6816/2835288640,v1:172.21.15.90:6817/2835288640] [v2:172.21.15.90:6818/2835288640,v1:172.21.15.90:6819/2835288640] exists,up 3fe3f253-331b-4188-b422-bae618bdd56f 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:osd.8 up in weight 1 up_from 52 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/3206361854,v1:172.21.15.172:6817/3206361854] [v2:172.21.15.172:6818/3206361854,v1:172.21.15.172:6819/3206361854] exists,up 7a9eb9c5-681c-4d53-bb24-a231ce58658e 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:osd.9 up in weight 1 up_from 58 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6826/3727244874,v1:172.21.15.84:6827/3727244874] [v2:172.21.15.84:6828/3727244874,v1:172.21.15.84:6829/3727244874] exists,up b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:osd.10 up in weight 1 up_from 63 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.90:6824/1478210023,v1:172.21.15.90:6825/1478210023] [v2:172.21.15.90:6826/1478210023,v1:172.21.15.90:6827/1478210023] exists,up 6b971755-045e-4107-aeb2-22aa69cfdea3 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:osd.11 up in weight 1 up_from 69 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/1518672432,v1:172.21.15.172:6825/1518672432] [v2:172.21.15.172:6826/1518672432,v1:172.21.15.172:6827/1518672432] exists,up 326bf4e4-01ff-42e4-8092-7c2d418273d7 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.8 [2,11] 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.b [2,4] 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.1c [8,11] 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.6 [3,6] 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.e [5,9] 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.13 [4,9] 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.2c [4,9] 2024-09-21T02:42:19.371 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.31 [4,8] 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 4.5 [5,8] 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 4.c [9,10] 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 4.17 [9,8] 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 4.19 [9,8] 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6801/3670733962 expires 2024-09-22T02:31:41.471413+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6800/3670733962 expires 2024-09-22T02:31:41.471413+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/3048700539 expires 2024-09-22T02:31:41.471413+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/1797182197 expires 2024-09-22T02:31:12.328817+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/2355445501 expires 2024-09-22T02:31:41.471413+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/239259500 expires 2024-09-22T02:31:12.328817+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6801/4193451827 expires 2024-09-22T02:31:12.328817+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/3180377571 expires 2024-09-22T02:31:41.471413+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/950512595 expires 2024-09-22T02:31:12.328817+0000 2024-09-21T02:42:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6800/4193451827 expires 2024-09-22T02:31:12.328817+0000 2024-09-21T02:42:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.369+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f461c0b6510 msgr2=0x7f461c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.369+0000 7f463d200640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f461c0b6510 0x7f461c0b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4628009bd0 tx=0x7f4628005f90 comp rx=0 tx=0).stop 2024-09-21T02:42:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.369+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4638078ca0 msgr2=0x7f46381a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.369+0000 7f463d200640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4638078ca0 0x7f46381a0cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f462000e9f0 tx=0x7f462000edf0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.369+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 shutdown_connections 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.370+0000 7f463d200640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f461c0b6510 0x7f461c0b8a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.370+0000 7f463d200640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4638078ca0 0x7f46381a0cf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.370+0000 7f463d200640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4638079640 0x7f46381a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.370+0000 7f463d200640 1 --2- 172.21.15.84:0/520166343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4638077c10 0x7f46381a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.370+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 >> 172.21.15.84:0/520166343 conn(0x7f46381012f0 msgr2=0x7f4638103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.370+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 shutdown_connections 2024-09-21T02:42:19.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:19.370+0000 7f463d200640 1 -- 172.21.15.84:0/520166343 wait complete. 2024-09-21T02:42:19.724 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:19 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/520166343' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T02:42:19.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:19 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/520166343' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T02:42:19.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:19 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/520166343' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T02:42:20.118 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T02:42:20.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:42:20.496 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:20.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:20 smithi172 ceph-mon[35067]: pgmap v397: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T02:42:20.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:20 smithi084 ceph-mon[30747]: pgmap v397: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T02:42:20.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:20 smithi090 ceph-mon[34571]: pgmap v397: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T02:42:21.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.124+0000 7f3169600640 1 -- 172.21.15.84:0/3123677447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164076080 msgr2=0x7f316410fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:21.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.124+0000 7f3169600640 1 --2- 172.21.15.84:0/3123677447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164076080 0x7f316410fc00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f314c009900 tx=0x7f314c02a410 comp rx=0 tx=0).stop 2024-09-21T02:42:21.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.125+0000 7f3169600640 1 -- 172.21.15.84:0/3123677447 shutdown_connections 2024-09-21T02:42:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.125+0000 7f3169600640 1 --2- 172.21.15.84:0/3123677447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3164110140 0x7f3164112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.125+0000 7f3169600640 1 --2- 172.21.15.84:0/3123677447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164076080 0x7f316410fc00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.125+0000 7f3169600640 1 --2- 172.21.15.84:0/3123677447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3164075730 0x7f3164075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.125+0000 7f3169600640 1 -- 172.21.15.84:0/3123677447 >> 172.21.15.84:0/3123677447 conn(0x7f316407b850 msgr2=0x7f316407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.125+0000 7f3169600640 1 -- 172.21.15.84:0/3123677447 shutdown_connections 2024-09-21T02:42:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.125+0000 7f3169600640 1 -- 172.21.15.84:0/3123677447 wait complete. 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.126+0000 7f3169600640 1 Processor -- start 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.126+0000 7f3169600640 1 -- start start 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.126+0000 7f3169600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164075730 0x7f316419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.126+0000 7f3169600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3164076080 0x7f316419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.126+0000 7f3169600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3164110140 0x7f31641a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.126+0000 7f3169600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3164115df0 con 0x7f3164075730 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.126+0000 7f3169600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3164115c70 con 0x7f3164110140 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.126+0000 7f3169600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3164115f70 con 0x7f3164076080 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3162a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164075730 0x7f316419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3162a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164075730 0x7f316419c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33802/0 (socket says 172.21.15.84:33802) 2024-09-21T02:42:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3162a00640 1 -- 172.21.15.84:0/2739151862 learned_addr learned my addr 172.21.15.84:0/2739151862 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f315a000640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3164076080 0x7f316419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3163400640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3164110140 0x7f31641a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3162a00640 1 -- 172.21.15.84:0/2739151862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3164076080 msgr2=0x7f316419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3162a00640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3164076080 0x7f316419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3162a00640 1 -- 172.21.15.84:0/2739151862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3164110140 msgr2=0x7f31641a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3162a00640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3164110140 0x7f31641a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.127+0000 7f3162a00640 1 -- 172.21.15.84:0/2739151862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31641a2730 con 0x7f3164075730 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.128+0000 7f3162a00640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164075730 0x7f316419c7c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f315400e9f0 tx=0x7f315400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.128+0000 7f315be00640 1 -- 172.21.15.84:0/2739151862 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315400ccc0 con 0x7f3164075730 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.128+0000 7f315be00640 1 -- 172.21.15.84:0/2739151862 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f315400ce60 con 0x7f3164075730 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.128+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31641a2a20 con 0x7f3164075730 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.128+0000 7f315be00640 1 -- 172.21.15.84:0/2739151862 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154010690 con 0x7f3164075730 2024-09-21T02:42:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.128+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31641a9180 con 0x7f3164075730 2024-09-21T02:42:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.129+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3164075b40 con 0x7f3164075730 2024-09-21T02:42:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.132+0000 7f315be00640 1 -- 172.21.15.84:0/2739151862 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f31540046c0 con 0x7f3164075730 2024-09-21T02:42:21.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.133+0000 7f315be00640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31480b6590 0x7f31480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:21.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.133+0000 7f315be00640 1 -- 172.21.15.84:0/2739151862 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f31540e7c20 con 0x7f3164075730 2024-09-21T02:42:21.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.133+0000 7f315a000640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31480b6590 0x7f31480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:21.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.134+0000 7f315a000640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31480b6590 0x7f31480b8aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f314c02aa00 tx=0x7f314c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:21.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.135+0000 7f315be00640 1 -- 172.21.15.84:0/2739151862 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31540ae120 con 0x7f3164075730 2024-09-21T02:42:21.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.358+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f316419d8f0 con 0x7f3164075730 2024-09-21T02:42:21.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.359+0000 7f315be00640 1 -- 172.21.15.84:0/2739151862 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11909 (secure 0 0 0) 0x7f316419d8f0 con 0x7f3164075730 2024-09-21T02:42:21.360 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:21.360 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"btime":"2024-09-21T02:40:45:465332+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:40:44.516130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:42:21.361 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-09-21T02:42:21.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.361+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31480b6590 msgr2=0x7f31480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:21.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.361+0000 7f3169600640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31480b6590 0x7f31480b8aa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f314c02aa00 tx=0x7f314c000bc0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.361+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164075730 msgr2=0x7f316419c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:21.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.361+0000 7f3169600640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164075730 0x7f316419c7c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f315400e9f0 tx=0x7f315400edf0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.362+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 shutdown_connections 2024-09-21T02:42:21.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.362+0000 7f3169600640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f31480b6590 0x7f31480b8aa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.362+0000 7f3169600640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3164076080 0x7f316419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.362+0000 7f3169600640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3164110140 0x7f31641a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.362+0000 7f3169600640 1 --2- 172.21.15.84:0/2739151862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3164075730 0x7f316419c7c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:21.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.362+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 >> 172.21.15.84:0/2739151862 conn(0x7f316407b850 msgr2=0x7f3164107ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:21.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.362+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 shutdown_connections 2024-09-21T02:42:21.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:21.362+0000 7f3169600640 1 -- 172.21.15.84:0/2739151862 wait complete. 2024-09-21T02:42:21.715 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:21 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2739151862' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:21 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2739151862' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:21.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:21 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2739151862' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:22.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:42:22.497 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:22.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:22 smithi172 ceph-mon[35067]: pgmap v398: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T02:42:22.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:22 smithi084 ceph-mon[30747]: pgmap v398: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T02:42:22.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:22 smithi090 ceph-mon[34571]: pgmap v398: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T02:42:23.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 -- 172.21.15.84:0/3410586890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01039b0 msgr2=0x7f60f0103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:23.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 --2- 172.21.15.84:0/3410586890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01039b0 0x7f60f0103dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009900 tx=0x7f60e002a410 comp rx=0 tx=0).stop 2024-09-21T02:42:23.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 -- 172.21.15.84:0/3410586890 shutdown_connections 2024-09-21T02:42:23.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 --2- 172.21.15.84:0/3410586890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f01092f0 0x7f60f0109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 --2- 172.21.15.84:0/3410586890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60f0109c40 0x7f60f0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 --2- 172.21.15.84:0/3410586890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01039b0 0x7f60f0103dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 -- 172.21.15.84:0/3410586890 >> 172.21.15.84:0/3410586890 conn(0x7f60f00ff440 msgr2=0x7f60f0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:23.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 -- 172.21.15.84:0/3410586890 shutdown_connections 2024-09-21T02:42:23.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.114+0000 7f60ef200640 1 -- 172.21.15.84:0/3410586890 wait complete. 2024-09-21T02:42:23.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.115+0000 7f60ef200640 1 Processor -- start 2024-09-21T02:42:23.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60ef200640 1 -- start start 2024-09-21T02:42:23.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60ef200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f01039b0 0x7f60f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:23.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60ef200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01092f0 0x7f60f0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:23.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60ef200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60f0109c40 0x7f60f0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:23.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60ef200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60f0113a40 con 0x7f60f01092f0 2024-09-21T02:42:23.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60ef200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60f01138c0 con 0x7f60f0109c40 2024-09-21T02:42:23.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60ef200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60f0113bc0 con 0x7f60f01039b0 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01092f0 0x7f60f0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60ede00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f01039b0 0x7f60f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01092f0 0x7f60f0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33832/0 (socket says 172.21.15.84:33832) 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.116+0000 7f60e7e00640 1 -- 172.21.15.84:0/3346910215 learned_addr learned my addr 172.21.15.84:0/3346910215 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.117+0000 7f60ee800640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60f0109c40 0x7f60f0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.117+0000 7f60e7e00640 1 -- 172.21.15.84:0/3346910215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f01039b0 msgr2=0x7f60f0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.117+0000 7f60e7e00640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f01039b0 0x7f60f0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.117+0000 7f60e7e00640 1 -- 172.21.15.84:0/3346910215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60f0109c40 msgr2=0x7f60f0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.117+0000 7f60e7e00640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60f0109c40 0x7f60f0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.117+0000 7f60e7e00640 1 -- 172.21.15.84:0/3346910215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f01a86b0 con 0x7f60f01092f0 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.117+0000 7f60e7e00640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01092f0 0x7f60f0075c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f60d800e9c0 tx=0x7f60d800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:23.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.118+0000 7f60e6a00640 1 -- 172.21.15.84:0/3346910215 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d800ccc0 con 0x7f60f01092f0 2024-09-21T02:42:23.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.118+0000 7f60e6a00640 1 -- 172.21.15.84:0/3346910215 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f60d80054f0 con 0x7f60f01092f0 2024-09-21T02:42:23.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.118+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f01a89a0 con 0x7f60f01092f0 2024-09-21T02:42:23.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.118+0000 7f60e6a00640 1 -- 172.21.15.84:0/3346910215 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8010430 con 0x7f60f01092f0 2024-09-21T02:42:23.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.118+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f01a8e90 con 0x7f60f01092f0 2024-09-21T02:42:23.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.119+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f0103dc0 con 0x7f60f01092f0 2024-09-21T02:42:23.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.121+0000 7f60e6a00640 1 -- 172.21.15.84:0/3346910215 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f60d80046c0 con 0x7f60f01092f0 2024-09-21T02:42:23.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.122+0000 7f60e6a00640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f60d40b6510 0x7f60d40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:23.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.123+0000 7f60e6a00640 1 -- 172.21.15.84:0/3346910215 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f60d80e7bf0 con 0x7f60f01092f0 2024-09-21T02:42:23.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.123+0000 7f60ede00640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f60d40b6510 0x7f60d40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:23.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.124+0000 7f60ede00640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f60d40b6510 0x7f60d40b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f60f0077160 tx=0x7f60e00058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:23.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.125+0000 7f60e6a00640 1 -- 172.21.15.84:0/3346910215 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60d8056710 con 0x7f60f01092f0 2024-09-21T02:42:23.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.348+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60f0076a10 con 0x7f60f01092f0 2024-09-21T02:42:23.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.349+0000 7f60e6a00640 1 -- 172.21.15.84:0/3346910215 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11909 (secure 0 0 0) 0x7f60d80ae090 con 0x7f60f01092f0 2024-09-21T02:42:23.350 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:23.350 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"btime":"2024-09-21T02:40:45:465332+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:40:44.516130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:42:23.350 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 26 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f60d40b6510 msgr2=0x7f60d40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f60d40b6510 0x7f60d40b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f60f0077160 tx=0x7f60e00058d0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01092f0 msgr2=0x7f60f0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01092f0 0x7f60f0075c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f60d800e9c0 tx=0x7f60d800ee80 comp rx=0 tx=0).stop 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 shutdown_connections 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60f0109c40 0x7f60f0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60f01092f0 0x7f60f0075c50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f60d40b6510 0x7f60d40b8a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 --2- 172.21.15.84:0/3346910215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60f01039b0 0x7f60f0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.351+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 >> 172.21.15.84:0/3346910215 conn(0x7f60f00ff440 msgr2=0x7f60f0108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:23.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.352+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 shutdown_connections 2024-09-21T02:42:23.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:23.352+0000 7f60ef200640 1 -- 172.21.15.84:0/3346910215 wait complete. 2024-09-21T02:42:23.707 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:23 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3346910215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:23.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:23 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3346910215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:23.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:23 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3346910215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:24.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:42:24.489 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:24.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:24 smithi172 ceph-mon[35067]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T02:42:24.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:24 smithi084 ceph-mon[30747]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T02:42:24.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:24 smithi090 ceph-mon[34571]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T02:42:25.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 -- 172.21.15.84:0/2889999738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 msgr2=0x7fc70010bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 --2- 172.21.15.84:0/2889999738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 0x7fc70010bae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009860 tx=0x7fc6ec02a340 comp rx=0 tx=0).stop 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 -- 172.21.15.84:0/2889999738 shutdown_connections 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 --2- 172.21.15.84:0/2889999738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc70010c020 0x7fc700112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 --2- 172.21.15.84:0/2889999738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 0x7fc70010bae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 --2- 172.21.15.84:0/2889999738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc700105d90 0x7fc7001061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 -- 172.21.15.84:0/2889999738 >> 172.21.15.84:0/2889999738 conn(0x7fc7001017c0 msgr2=0x7fc700103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 -- 172.21.15.84:0/2889999738 shutdown_connections 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.141+0000 7fc708000640 1 -- 172.21.15.84:0/2889999738 wait complete. 2024-09-21T02:42:25.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.142+0000 7fc708000640 1 Processor -- start 2024-09-21T02:42:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc708000640 1 -- start start 2024-09-21T02:42:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc708000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc700105d90 0x7fc70019c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc708000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 0x7fc70019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc708000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc70010c020 0x7fc7001a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc708000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc700115e00 con 0x7fc70010c020 2024-09-21T02:42:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc708000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc700115c80 con 0x7fc70010b6d0 2024-09-21T02:42:25.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc708000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc700115f80 con 0x7fc700105d90 2024-09-21T02:42:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc704c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 0x7fc70019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc706000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc70010c020 0x7fc7001a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc704c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 0x7fc70019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:59672/0 (socket says 172.21.15.84:59672) 2024-09-21T02:42:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc705600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc700105d90 0x7fc70019c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:25.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.143+0000 7fc704c00640 1 -- 172.21.15.84:0/1854122504 learned_addr learned my addr 172.21.15.84:0/1854122504 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.144+0000 7fc704c00640 1 -- 172.21.15.84:0/1854122504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc700105d90 msgr2=0x7fc70019c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.144+0000 7fc704c00640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc700105d90 0x7fc70019c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.144+0000 7fc704c00640 1 -- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc70010c020 msgr2=0x7fc7001a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.144+0000 7fc704c00640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc70010c020 0x7fc7001a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.144+0000 7fc704c00640 1 -- 172.21.15.84:0/1854122504 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7001a26e0 con 0x7fc70010b6d0 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.144+0000 7fc704c00640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 0x7fc70019cd10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec035040 tx=0x7fc6ec02aeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.145+0000 7fc6fe000640 1 -- 172.21.15.84:0/1854122504 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec03f020 con 0x7fc70010b6d0 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.145+0000 7fc6fe000640 1 -- 172.21.15.84:0/1854122504 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6ec033dd0 con 0x7fc70010b6d0 2024-09-21T02:42:25.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.145+0000 7fc6fe000640 1 -- 172.21.15.84:0/1854122504 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec037040 con 0x7fc70010b6d0 2024-09-21T02:42:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.145+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7001a2970 con 0x7fc70010b6d0 2024-09-21T02:42:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.145+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7001a9130 con 0x7fc70010b6d0 2024-09-21T02:42:25.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.146+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc700107010 con 0x7fc70010b6d0 2024-09-21T02:42:25.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.148+0000 7fc6fe000640 1 -- 172.21.15.84:0/1854122504 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc6ec042020 con 0x7fc70010b6d0 2024-09-21T02:42:25.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.150+0000 7fc6fe000640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6e80b6590 0x7fc6e80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:25.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.151+0000 7fc6fe000640 1 -- 172.21.15.84:0/1854122504 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc6ec107720 con 0x7fc70010b6d0 2024-09-21T02:42:25.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.151+0000 7fc705600640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6e80b6590 0x7fc6e80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:25.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.151+0000 7fc705600640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6e80b6590 0x7fc6e80b8aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009530 tx=0x7fc6f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:25.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.152+0000 7fc6fe000640 1 -- 172.21.15.84:0/1854122504 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6ec049020 con 0x7fc70010b6d0 2024-09-21T02:42:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.339+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc70010de10 con 0x7fc70010b6d0 2024-09-21T02:42:25.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.340+0000 7fc6fe000640 1 -- 172.21.15.84:0/1854122504 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24819 (secure 0 0 0) 0x7fc6ec0cdc40 con 0x7fc70010b6d0 2024-09-21T02:42:25.342 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:25.342 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:41:44.334281+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6e80b6590 msgr2=0x7fc6e80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6e80b6590 0x7fc6e80b8aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009530 tx=0x7fc6f4009260 comp rx=0 tx=0).stop 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 msgr2=0x7fc70019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 0x7fc70019cd10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec035040 tx=0x7fc6ec02aeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 shutdown_connections 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc70010c020 0x7fc7001a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc70010b6d0 0x7fc70019cd10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6e80b6590 0x7fc6e80b8aa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 --2- 172.21.15.84:0/1854122504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc700105d90 0x7fc70019c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:25.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 >> 172.21.15.84:0/1854122504 conn(0x7fc7001017c0 msgr2=0x7fc70010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:25.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.343+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 shutdown_connections 2024-09-21T02:42:25.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:25.344+0000 7fc708000640 1 -- 172.21.15.84:0/1854122504 wait complete. 2024-09-21T02:42:25.712 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:25 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1854122504' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:42:25.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:25 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1854122504' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:42:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:25 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1854122504' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:42:26.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:39:47.859217+0000', 'modified': '2024-09-21T02:40:44.516130+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24704, 'mds_1': 24703, 'mds_2': 24679}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24647': {'gid': 24647, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6835/1905318969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1905318969}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1905318969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24668': {'gid': 24668, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6837/939715852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 939715852}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 939715852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/2876777250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2876777250}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 2876777250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24679': {'gid': 24679, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.172:6837/3475533235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3475533235}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3475533235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24703': {'gid': 24703, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.172:6839/3937933536', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3937933536}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3937933536}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6839/3427873852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6838', 'nonce': 3427873852}, {'type': 'v1', 'addr': '172.21.15.90:6839', 'nonce': 3427873852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24704, 'qdb_cluster': [24704, 24703, 24679]} 2024-09-21T02:42:26.218 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T02:42:26.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T02:42:26.590 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:26.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:26 smithi084 ceph-mon[30747]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T02:42:26.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:26 smithi172 ceph-mon[35067]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T02:42:26.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:26 smithi090 ceph-mon[34571]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T02:42:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 -- 172.21.15.84:0/3070397326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f154010c040 msgr2=0x7f1540112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 --2- 172.21.15.84:0/3070397326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f154010c040 0x7f1540112870 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1538009ca0 tx=0x7f153802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 -- 172.21.15.84:0/3070397326 shutdown_connections 2024-09-21T02:42:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 --2- 172.21.15.84:0/3070397326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f154010c040 0x7f1540112870 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 --2- 172.21.15.84:0/3070397326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f154010b6f0 0x7f154010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 --2- 172.21.15.84:0/3070397326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1540105db0 0x7f15401061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 -- 172.21.15.84:0/3070397326 >> 172.21.15.84:0/3070397326 conn(0x7f15401017e0 msgr2=0x7f1540103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 -- 172.21.15.84:0/3070397326 shutdown_connections 2024-09-21T02:42:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.270+0000 7f1546e00640 1 -- 172.21.15.84:0/3070397326 wait complete. 2024-09-21T02:42:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.272+0000 7f1546e00640 1 Processor -- start 2024-09-21T02:42:27.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.272+0000 7f1546e00640 1 -- start start 2024-09-21T02:42:27.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.272+0000 7f1546e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1540105db0 0x7f154019c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.272+0000 7f1546e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f154010b6f0 0x7f154019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f1546e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154010c040 0x7f15401a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f1546e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1540115e40 con 0x7f1540105db0 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f1546e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1540115cc0 con 0x7f154010b6f0 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f1546e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1540115fc0 con 0x7f154010c040 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f153fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1540105db0 0x7f154019c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f153fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1540105db0 0x7f154019c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33864/0 (socket says 172.21.15.84:33864) 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f153fe00640 1 -- 172.21.15.84:0/1480289088 learned_addr learned my addr 172.21.15.84:0/1480289088 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f1537400640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f154010b6f0 0x7f154019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f1544e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154010c040 0x7f15401a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f153fe00640 1 -- 172.21.15.84:0/1480289088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154010c040 msgr2=0x7f15401a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f153fe00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154010c040 0x7f15401a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f153fe00640 1 -- 172.21.15.84:0/1480289088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f154010b6f0 msgr2=0x7f154019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f153fe00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f154010b6f0 0x7f154019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f153fe00640 1 -- 172.21.15.84:0/1480289088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15401a2760 con 0x7f1540105db0 2024-09-21T02:42:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.273+0000 7f1537400640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f154010b6f0 0x7f154019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.274+0000 7f153fe00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1540105db0 0x7f154019c7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f153000e9f0 tx=0x7f153000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.274+0000 7f153d600640 1 -- 172.21.15.84:0/1480289088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153000cd80 con 0x7f1540105db0 2024-09-21T02:42:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.274+0000 7f153d600640 1 -- 172.21.15.84:0/1480289088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f15300054f0 con 0x7f1540105db0 2024-09-21T02:42:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.274+0000 7f1546e00640 1 -- 172.21.15.84:0/1480289088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15401a2a50 con 0x7f1540105db0 2024-09-21T02:42:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.274+0000 7f153d600640 1 -- 172.21.15.84:0/1480289088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1530010690 con 0x7f1540105db0 2024-09-21T02:42:27.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.274+0000 7f1546e00640 1 -- 172.21.15.84:0/1480289088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15401a91b0 con 0x7f1540105db0 2024-09-21T02:42:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.277+0000 7f154da79740 1 Processor -- start 2024-09-21T02:42:27.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.277+0000 7f154da79740 1 -- start start 2024-09-21T02:42:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.277+0000 7f153d600640 1 -- 172.21.15.84:0/1480289088 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f15300046c0 con 0x7f1540105db0 2024-09-21T02:42:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f154da79740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f154da79740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f154da79740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 0x5572ca2b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f154da79740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5572ca22cd50 con 0x5572c9f0ef60 2024-09-21T02:42:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f154da79740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5572ca21c180 con 0x5572c9ee60a0 2024-09-21T02:42:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f154da79740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572ca21ff90 con 0x5572c9eee280 2024-09-21T02:42:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f1544e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f1544e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33872/0 (socket says 172.21.15.84:33872) 2024-09-21T02:42:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f1544e00640 1 -- 172.21.15.84:0/2468020419 learned_addr learned my addr 172.21.15.84:0/2468020419 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f153fe00640 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.278+0000 7f1537400640 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 0x5572ca2b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f153fe00640 1 -- 172.21.15.84:0/2468020419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 msgr2=0x5572ca2b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f153fe00640 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 0x5572ca2b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f153fe00640 1 -- 172.21.15.84:0/2468020419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 msgr2=0x5572ca2b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f153fe00640 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f153fe00640 1 -- 172.21.15.84:0/2468020419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572ca1e6a70 con 0x5572c9ee60a0 2024-09-21T02:42:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f153fe00640 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2b59d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15300e50f0 tx=0x7f15300edad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f186095567893d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f1535600640 1 -- 172.21.15.84:0/2468020419 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15300f6070 con 0x5572c9ee60a0 2024-09-21T02:42:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f1535600640 1 -- 172.21.15.84:0/2468020419 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f15300f2420 con 0x5572c9ee60a0 2024-09-21T02:42:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f153d600640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f15240b6510 0x7f15240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.279+0000 7f1535600640 1 -- 172.21.15.84:0/2468020419 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15300f15e0 con 0x5572c9ee60a0 2024-09-21T02:42:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.280+0000 7f153d600640 1 -- 172.21.15.84:0/1480289088 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f15300e7a40 con 0x7f1540105db0 2024-09-21T02:42:27.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.280+0000 7f1544e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f15240b6510 0x7f15240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.280+0000 7f154da79740 1 -- 172.21.15.84:0/2468020419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 msgr2=0x5572ca2b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2b59d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15300e50f0 tx=0x7f15300edad0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f1544e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f15240b6510 0x7f15240b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f153802f500 tx=0x7f153802f310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 -- 172.21.15.84:0/2468020419 shutdown_connections 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 0x5572ca2b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2b59d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 --2- 172.21.15.84:0/2468020419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 -- 172.21.15.84:0/2468020419 >> 172.21.15.84:0/2468020419 conn(0x5572c9f03350 msgr2=0x5572ca2b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:27.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 -- 172.21.15.84:0/2468020419 shutdown_connections 2024-09-21T02:42:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 -- 172.21.15.84:0/2468020419 wait complete. 2024-09-21T02:42:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.281+0000 7f154da79740 1 -- start start 2024-09-21T02:42:27.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.282+0000 7f154da79740 1 Processor -- start 2024-09-21T02:42:27.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.282+0000 7f154da79740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.282+0000 7f154da79740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.282+0000 7f154da79740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9f0ef60 0x5572ca2ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.282+0000 7f154da79740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5572ca07d5f0 con 0x5572c9eee280 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.282+0000 7f154da79740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5572ca1b7460 con 0x5572c9ee60a0 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.282+0000 7f154da79740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572ca2c3c70 con 0x5572c9f0ef60 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.282+0000 7f154da79740 10 client.0 _ll_register_callbacks cb 0x5572ca1c7210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f1537400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:59702/0 (socket says 172.21.15.84:59702) 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 -- 172.21.15.84:0/3421325112 learned_addr learned my addr 172.21.15.84:0/3421325112 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f1544e00640 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9f0ef60 0x5572ca2ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 -- 172.21.15.84:0/3421325112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9f0ef60 msgr2=0x5572ca2ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:27.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9f0ef60 0x5572ca2ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 -- 172.21.15.84:0/3421325112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 msgr2=0x5572ca2c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 -- 172.21.15.84:0/3421325112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c9f7a540 con 0x5572c9ee60a0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f1537400640 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f153fe00640 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c1070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15300ad770 tx=0x7f1530009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5b30e37260c0f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f152e000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.283+0000 7f152e000640 1 -- 172.21.15.84:0/3421325112 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15300f6070 con 0x5572c9ee60a0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 1 -- 172.21.15.84:0/3421325112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5572ca1b9a70 con 0x5572c9ee60a0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f152e000640 1 -- 172.21.15.84:0/3421325112 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f15300b6f70 con 0x5572c9ee60a0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f152e000640 1 -- 172.21.15.84:0/3421325112 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f15300a9e30 con 0x5572c9ee60a0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 10 client.25268 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 1 -- 172.21.15.84:0/3421325112 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5572ca1d46f0 con 0x5572c9ee60a0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f152e000640 1 -- 172.21.15.84:0/3421325112 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x5572ca1b9a70 con 0x5572c9ee60a0 2024-09-21T02:42:27.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f152e000640 1 -- 172.21.15.84:0/3421325112 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f15300a9130 con 0x5572c9ee60a0 2024-09-21T02:42:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 10 client.25268 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 10 client.25268 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T02:42:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 20 client.25268 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x5572c9ecd8e0 0x5572ca2d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 4 client.25268 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:27.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.284+0000 7f154da79740 1 -- 172.21.15.84:0/3421325112 --> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572ca22eca0 con 0x5572c9ecd8e0 2024-09-21T02:42:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.285+0000 7f1537400640 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x5572c9ecd8e0 0x5572ca2d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.285+0000 7f1537400640 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x5572c9ecd8e0 0x5572ca2d2ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4589245dc741a973 server_cookie=26c063c8a6ad1c81 in_seq=0 out_seq=0 2024-09-21T02:42:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.285+0000 7f152e000640 10 client.25268 ms_handle_connect on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.286+0000 7f152e000640 1 -- 172.21.15.84:0/3421325112 <== mds.2 v2:172.21.15.172:6836/3475533235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572ca22eca0 con 0x5572c9ecd8e0 2024-09-21T02:42:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.286+0000 7f152e000640 10 client.25268 handle_command_reply: tid=0 2024-09-21T02:42:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.286+0000 7f154da79740 1 client.25268 shutdown 2024-09-21T02:42:27.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 -- 172.21.15.84:0/3421325112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 msgr2=0x5572ca2c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c1070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f15300ad770 tx=0x7f1530009310 comp rx=0 tx=0).stop 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 -- 172.21.15.84:0/3421325112 shutdown_connections 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x5572c9ecd8e0 0x5572ca2d2ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9f0ef60 0x5572ca2ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 --2- 172.21.15.84:0/3421325112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c1070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f152e000640 0 client.25268 ms_handle_reset on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 -- 172.21.15.84:0/3421325112 >> 172.21.15.84:0/3421325112 conn(0x5572c9f03350 msgr2=0x5572ca2b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 -- 172.21.15.84:0/3421325112 shutdown_connections 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 1 -- 172.21.15.84:0/3421325112 wait complete. 2024-09-21T02:42:27.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.287+0000 7f154da79740 20 client.25268 trim_cache size 0 max 16384 2024-09-21T02:42:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.305+0000 7f154da79740 1 Processor -- start 2024-09-21T02:42:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f154da79740 1 -- start start 2024-09-21T02:42:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f154da79740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f154da79740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 0x5572ca2ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f154da79740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f154da79740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5572ca2d1330 con 0x5572c9f0ef60 2024-09-21T02:42:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f154da79740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5572ca2d1a00 con 0x5572c9ee60a0 2024-09-21T02:42:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f154da79740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572ca2d20d0 con 0x5572c9eee280 2024-09-21T02:42:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f1544e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f1544e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33892/0 (socket says 172.21.15.84:33892) 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f1544e00640 1 -- 172.21.15.84:0/2690020291 learned_addr learned my addr 172.21.15.84:0/2690020291 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f153fe00640 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.306+0000 7f1537400640 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 0x5572ca2ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f153fe00640 1 -- 172.21.15.84:0/2690020291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 msgr2=0x5572ca2ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f153fe00640 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 0x5572ca2ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f153fe00640 1 -- 172.21.15.84:0/2690020291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 msgr2=0x5572ca2cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f153fe00640 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f153fe00640 1 -- 172.21.15.84:0/2690020291 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572ca2b82f0 con 0x5572c9ee60a0 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f1544e00640 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f153fe00640 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c2aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15300a94f0 tx=0x7f15300edad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5739f7b8608664e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f1534c00640 1 -- 172.21.15.84:0/2690020291 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15300f6070 con 0x5572c9ee60a0 2024-09-21T02:42:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f1534c00640 1 -- 172.21.15.84:0/2690020291 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f15300056a0 con 0x5572c9ee60a0 2024-09-21T02:42:27.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.307+0000 7f1534c00640 1 -- 172.21.15.84:0/2690020291 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15300acf50 con 0x5572c9ee60a0 2024-09-21T02:42:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.308+0000 7f154da79740 1 -- 172.21.15.84:0/2690020291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 msgr2=0x5572ca2c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.308+0000 7f154da79740 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c2aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f15300a94f0 tx=0x7f15300edad0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.308+0000 7f154da79740 1 -- 172.21.15.84:0/2690020291 shutdown_connections 2024-09-21T02:42:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.308+0000 7f154da79740 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9eee280 0x5572ca2ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.308+0000 7f154da79740 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9f0ef60 0x5572ca2cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.308+0000 7f154da79740 1 --2- 172.21.15.84:0/2690020291 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9ee60a0 0x5572ca2c2aa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.308+0000 7f154da79740 1 -- 172.21.15.84:0/2690020291 >> 172.21.15.84:0/2690020291 conn(0x5572c9f03350 msgr2=0x5572ca2c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.308+0000 7f154da79740 1 -- 172.21.15.84:0/2690020291 shutdown_connections 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.309+0000 7f154da79740 1 -- 172.21.15.84:0/2690020291 wait complete. 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.309+0000 7f154da79740 1 -- start start 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.309+0000 7f154da79740 1 Processor -- start 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f154da79740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9ee60a0 0x5572ca2dbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f154da79740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2d5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f154da79740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9f0ef60 0x5572ca2d5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f154da79740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5572ca2d2e70 con 0x5572c9eee280 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f154da79740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5572ca2d27a0 con 0x5572c9f0ef60 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f154da79740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572ca2d3540 con 0x5572c9ee60a0 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f154da79740 10 client.0 _ll_register_callbacks cb 0x7f15300ed8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f153fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9ee60a0 0x5572ca2dbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f153fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9ee60a0 0x5572ca2dbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:50768/0 (socket says 172.21.15.84:50768) 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f153fe00640 1 -- 172.21.15.84:0/865424713 learned_addr learned my addr 172.21.15.84:0/865424713 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f1537400640 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f1544e00640 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9f0ef60 0x5572ca2d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f153fe00640 1 -- 172.21.15.84:0/865424713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9f0ef60 msgr2=0x5572ca2d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f153fe00640 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9f0ef60 0x5572ca2d5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f153fe00640 1 -- 172.21.15.84:0/865424713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 msgr2=0x5572ca2d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f153fe00640 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2d5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.310+0000 7f153fe00640 1 -- 172.21.15.84:0/865424713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572ca2d6000 con 0x5572c9ee60a0 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f153fe00640 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9ee60a0 0x5572ca2dbb70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f153000e9c0 tx=0x7f1530004b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b6b4af4d482063 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f152e000640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f152e000640 1 -- 172.21.15.84:0/865424713 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15300f6070 con 0x5572c9ee60a0 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f154da79740 1 -- 172.21.15.84:0/865424713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15300056a0 con 0x5572c9ee60a0 2024-09-21T02:42:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f152e000640 1 -- 172.21.15.84:0/865424713 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f15300aeb10 con 0x5572c9ee60a0 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f152e000640 1 -- 172.21.15.84:0/865424713 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f15300ad130 con 0x5572c9ee60a0 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f154da79740 10 client.25285 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f154da79740 1 -- 172.21.15.84:0/865424713 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5572ca2d6000 con 0x5572c9ee60a0 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.311+0000 7f152e000640 1 -- 172.21.15.84:0/865424713 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f15300056a0 con 0x5572c9ee60a0 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.312+0000 7f152e000640 1 -- 172.21.15.84:0/865424713 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f15300ac4b0 con 0x5572c9ee60a0 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.312+0000 7f154da79740 10 client.25285 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.312+0000 7f154da79740 10 client.25285 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.312+0000 7f154da79740 20 client.25285 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.312+0000 7f154da79740 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x5572c9ea2c90 0x5572ca3414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.312+0000 7f154da79740 4 client.25285 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.312+0000 7f154da79740 1 -- 172.21.15.84:0/865424713 --> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] -- command(tid 0: {"prefix": "status"}) -- 0x5572ca22a750 con 0x5572c9ea2c90 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.312+0000 7f1537400640 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x5572c9ea2c90 0x5572ca3414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f1537400640 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x5572c9ea2c90 0x5572ca3414b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab74cdf15528d95f server_cookie=5e725e04d32d23ec in_seq=0 out_seq=0 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f152e000640 10 client.25285 ms_handle_connect on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f152e000640 1 -- 172.21.15.84:0/865424713 <== mds.2 v2:172.21.15.172:6836/3475533235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5572ca22a750 con 0x5572c9ea2c90 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f152e000640 10 client.25285 handle_command_reply: tid=0 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 client.25285 shutdown 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 -- 172.21.15.84:0/865424713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9ee60a0 msgr2=0x5572ca2dbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9ee60a0 0x5572ca2dbb70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f153000e9c0 tx=0x7f1530004b70 comp rx=0 tx=0).stop 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 -- 172.21.15.84:0/865424713 shutdown_connections 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x5572c9ea2c90 0x5572ca3414b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5572c9f0ef60 0x5572ca2d5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c9eee280 0x5572ca2d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 --2- 172.21.15.84:0/865424713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c9ee60a0 0x5572ca2dbb70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f152e000640 0 client.25285 ms_handle_reset on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 -- 172.21.15.84:0/865424713 >> 172.21.15.84:0/865424713 conn(0x5572c9f03350 msgr2=0x5572ca2b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 -- 172.21.15.84:0/865424713 shutdown_connections 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.313+0000 7f154da79740 1 -- 172.21.15.84:0/865424713 wait complete. 2024-09-21T02:42:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f154da79740 20 client.25285 trim_cache size 0 max 16384 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24679, 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 106.92972700200001, 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 26, 2024-09-21T02:42:27.318 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:42:27.319 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:42:27.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 188.29230794 2024-09-21T02:42:27.319 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:42:27.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 -- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f15240b6510 msgr2=0x7f15240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f15240b6510 0x7f15240b8a20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f153802f500 tx=0x7f153802f310 comp rx=0 tx=0).stop 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 -- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1540105db0 msgr2=0x7f154019c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1540105db0 0x7f154019c7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f153000e9f0 tx=0x7f153000edf0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 -- 172.21.15.84:0/1480289088 shutdown_connections 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f15240b6510 0x7f15240b8a20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f154010c040 0x7f15401a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f154010b6f0 0x7f154019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 --2- 172.21.15.84:0/1480289088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1540105db0 0x7f154019c7f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.314+0000 7f1546e00640 1 -- 172.21.15.84:0/1480289088 >> 172.21.15.84:0/1480289088 conn(0x7f15401017e0 msgr2=0x7f1540108bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.315+0000 7f1546e00640 1 -- 172.21.15.84:0/1480289088 shutdown_connections 2024-09-21T02:42:27.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:27.315+0000 7f1546e00640 1 -- 172.21.15.84:0/1480289088 wait complete. 2024-09-21T02:42:27.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:27 smithi084 ceph-mon[30747]: pgmap v401: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T02:42:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:27 smithi172 ceph-mon[35067]: pgmap v401: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T02:42:28.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:27 smithi090 ceph-mon[34571]: pgmap v401: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T02:42:28.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T02:42:28.701 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 -- 172.21.15.84:0/1165967680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c4105d80 msgr2=0x7f17c4106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 --2- 172.21.15.84:0/1165967680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c4105d80 0x7f17c4106190 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009900 tx=0x7f17b802a410 comp rx=0 tx=0).stop 2024-09-21T02:42:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 -- 172.21.15.84:0/1165967680 shutdown_connections 2024-09-21T02:42:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 --2- 172.21.15.84:0/1165967680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c410c010 0x7f17c4112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 --2- 172.21.15.84:0/1165967680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c410b6c0 0x7f17c410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 --2- 172.21.15.84:0/1165967680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c4105d80 0x7f17c4106190 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 -- 172.21.15.84:0/1165967680 >> 172.21.15.84:0/1165967680 conn(0x7f17c4101810 msgr2=0x7f17c4103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:29.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 -- 172.21.15.84:0/1165967680 shutdown_connections 2024-09-21T02:42:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.396+0000 7f17cc200640 1 -- 172.21.15.84:0/1165967680 wait complete. 2024-09-21T02:42:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.398+0000 7f17cc200640 1 Processor -- start 2024-09-21T02:42:29.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.398+0000 7f17cc200640 1 -- start start 2024-09-21T02:42:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.398+0000 7f17cc200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c4105d80 0x7f17c419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.398+0000 7f17cc200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c410b6c0 0x7f17c419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.398+0000 7f17cc200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c410c010 0x7f17c41a2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.398+0000 7f17cc200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4115df0 con 0x7f17c410b6c0 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.398+0000 7f17cc200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4115c70 con 0x7f17c4105d80 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.398+0000 7f17cc200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4115f70 con 0x7f17c410c010 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c410b6c0 0x7f17c419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c9800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c4105d80 0x7f17c419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c410b6c0 0x7f17c419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33904/0 (socket says 172.21.15.84:33904) 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c9800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c4105d80 0x7f17c419c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:59742/0 (socket says 172.21.15.84:59742) 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c8e00640 1 -- 172.21.15.84:0/2849141355 learned_addr learned my addr 172.21.15.84:0/2849141355 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17ca200640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c410c010 0x7f17c41a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c9800640 1 -- 172.21.15.84:0/2849141355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c410c010 msgr2=0x7f17c41a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c9800640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c410c010 0x7f17c41a2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c9800640 1 -- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c410b6c0 msgr2=0x7f17c419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c9800640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c410b6c0 0x7f17c419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c9800640 1 -- 172.21.15.84:0/2849141355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c41a2770 con 0x7f17c4105d80 2024-09-21T02:42:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17ca200640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c410c010 0x7f17c41a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:42:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.399+0000 7f17c8e00640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c410b6c0 0x7f17c419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.400+0000 7f17c9800640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c4105d80 0x7f17c419c800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005940 tx=0x7f17b80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.400+0000 7f17c2000640 1 -- 172.21.15.84:0/2849141355 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b803f030 con 0x7f17c4105d80 2024-09-21T02:42:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.400+0000 7f17cc200640 1 -- 172.21.15.84:0/2849141355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c41a2a00 con 0x7f17c4105d80 2024-09-21T02:42:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.400+0000 7f17c2000640 1 -- 172.21.15.84:0/2849141355 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17b80318f0 con 0x7f17c4105d80 2024-09-21T02:42:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.400+0000 7f17c2000640 1 -- 172.21.15.84:0/2849141355 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8035070 con 0x7f17c4105d80 2024-09-21T02:42:29.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.400+0000 7f17cc200640 1 -- 172.21.15.84:0/2849141355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c41a91c0 con 0x7f17c4105d80 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.403+0000 7f17d2e49740 1 Processor -- start 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.403+0000 7f17d2e49740 1 -- start start 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9e2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c6130a0 0x561a7c9e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17d2e49740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561a7c959d50 con 0x561a7c61b280 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17d2e49740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561a7c949180 con 0x561a7c63bf60 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17d2e49740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a7c94cf90 con 0x561a7c6130a0 2024-09-21T02:42:29.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17ca200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9e2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9e2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33906/0 (socket says 172.21.15.84:33906) 2024-09-21T02:42:29.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17c8e00640 1 -- 172.21.15.84:0/1526512350 learned_addr learned my addr 172.21.15.84:0/1526512350 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17c2000640 1 -- 172.21.15.84:0/2849141355 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f17b8042030 con 0x7f17c4105d80 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17ca200640 1 -- 172.21.15.84:0/1526512350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c6130a0 msgr2=0x561a7c9e29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17ca200640 1 --2- 172.21.15.84:0/1526512350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c6130a0 0x561a7c9e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17ca200640 1 -- 172.21.15.84:0/1526512350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 msgr2=0x561a7c9e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17ca200640 1 --2- 172.21.15.84:0/1526512350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.404+0000 7f17ca200640 1 -- 172.21.15.84:0/1526512350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a7c913a70 con 0x561a7c63bf60 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.405+0000 7f17ca200640 1 --2- 172.21.15.84:0/1526512350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9e2490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009f80 tx=0x7f17bc00f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44724c024623952 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.405+0000 7f17b6a00640 1 -- 172.21.15.84:0/1526512350 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc015070 con 0x561a7c63bf60 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.405+0000 7f17b6a00640 1 -- 172.21.15.84:0/1526512350 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17bc011bd0 con 0x561a7c63bf60 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.405+0000 7f17b6a00640 1 -- 172.21.15.84:0/1526512350 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc01acd0 con 0x561a7c63bf60 2024-09-21T02:42:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17c2000640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f17ac0b6510 0x7f17ac0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17d2e49740 1 -- 172.21.15.84:0/1526512350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 msgr2=0x561a7c9e2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17d2e49740 1 --2- 172.21.15.84:0/1526512350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9e2490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009f80 tx=0x7f17bc00f7f0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17c2000640 1 -- 172.21.15.84:0/2849141355 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f17b8107a40 con 0x7f17c4105d80 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17d2e49740 1 -- 172.21.15.84:0/1526512350 shutdown_connections 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17d2e49740 1 --2- 172.21.15.84:0/1526512350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c6130a0 0x561a7c9e29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17d2e49740 1 --2- 172.21.15.84:0/1526512350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17d2e49740 1 --2- 172.21.15.84:0/1526512350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9e2490 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17d2e49740 1 -- 172.21.15.84:0/1526512350 >> 172.21.15.84:0/1526512350 conn(0x561a7c630350 msgr2=0x561a7c9e0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17c9800640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f17ac0b6510 0x7f17ac0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.406+0000 7f17d2e49740 1 -- 172.21.15.84:0/1526512350 shutdown_connections 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.407+0000 7f17d2e49740 1 -- 172.21.15.84:0/1526512350 wait complete. 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.407+0000 7f17c9800640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f17ac0b6510 0x7f17ac0b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f17b80cd770 tx=0x7f17b803b6b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.407+0000 7f17d2e49740 1 -- start start 2024-09-21T02:42:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.407+0000 7f17d2e49740 1 Processor -- start 2024-09-21T02:42:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7c9ee000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7c9ee540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17d2e49740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561a7c7aa5f0 con 0x561a7c6130a0 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17d2e49740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561a7c8e4460 con 0x561a7c63bf60 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17d2e49740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a7c9f0c70 con 0x561a7c61b280 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17d2e49740 10 client.0 _ll_register_callbacks cb 0x561a7c8f4210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7c9ee540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17ca200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7c9ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7c9ee540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:50818/0 (socket says 172.21.15.84:50818) 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17c8e00640 1 -- 172.21.15.84:0/549754603 learned_addr learned my addr 172.21.15.84:0/549754603 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.408+0000 7f17ca200640 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.409+0000 7f17ca200640 1 -- 172.21.15.84:0/549754603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 msgr2=0x561a7c9ee540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:29.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.409+0000 7f17ca200640 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7c9ee540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.409+0000 7f17ca200640 1 -- 172.21.15.84:0/549754603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 msgr2=0x561a7c9f9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.409+0000 7f17ca200640 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9f9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.409+0000 7f17ca200640 1 -- 172.21.15.84:0/549754603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a7c6a7540 con 0x561a7c6130a0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.409+0000 7f17ca200640 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7c9ee000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00a010 tx=0x7f17bc01a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b27ecada7b9733 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.409+0000 7f17ab400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.409+0000 7f17ab400640 1 -- 172.21.15.84:0/549754603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc015040 con 0x561a7c6130a0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.410+0000 7f17ab400640 1 -- 172.21.15.84:0/549754603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f17bc01cde0 con 0x561a7c6130a0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.410+0000 7f17d2e49740 1 -- 172.21.15.84:0/549754603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a7c8e6a70 con 0x561a7c6130a0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.410+0000 7f17ab400640 1 -- 172.21.15.84:0/549754603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f17bc01aa50 con 0x561a7c6130a0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.410+0000 7f17d2e49740 10 client.15279 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.410+0000 7f17d2e49740 1 -- 172.21.15.84:0/549754603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561a7c9016f0 con 0x561a7c6130a0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.410+0000 7f17ab400640 1 -- 172.21.15.84:0/549754603 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x561a7c8e6a70 con 0x561a7c6130a0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.410+0000 7f17ab400640 1 -- 172.21.15.84:0/549754603 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f17bc028020 con 0x561a7c6130a0 2024-09-21T02:42:29.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.410+0000 7f17d2e49740 10 client.15279 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.411+0000 7f17d2e49740 10 client.15279 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T02:42:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.411+0000 7f17d2e49740 20 client.15279 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.411+0000 7f17d2e49740 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x561a7c5fa8e0 0x561a7ca00250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.411+0000 7f17d2e49740 4 client.15279 mds_command: new command op to 24703 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:29.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.411+0000 7f17d2e49740 1 -- 172.21.15.84:0/549754603 --> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a7c95bca0 con 0x561a7c5fa8e0 2024-09-21T02:42:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.411+0000 7f17c8e00640 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x561a7c5fa8e0 0x561a7ca00250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.412+0000 7f17c8e00640 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x561a7c5fa8e0 0x561a7ca00250 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83065f6ba2ade984 server_cookie=cf8806b918c601d7 in_seq=0 out_seq=0 2024-09-21T02:42:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.412+0000 7f17ab400640 10 client.15279 ms_handle_connect on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.412+0000 7f17ab400640 1 -- 172.21.15.84:0/549754603 <== mds.1 v2:172.21.15.172:6838/3937933536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a7c95bca0 con 0x561a7c5fa8e0 2024-09-21T02:42:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.412+0000 7f17ab400640 10 client.15279 handle_command_reply: tid=0 2024-09-21T02:42:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 client.15279 shutdown 2024-09-21T02:42:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 -- 172.21.15.84:0/549754603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 msgr2=0x561a7c9ee000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7c9ee000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00a010 tx=0x7f17bc01a8b0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 -- 172.21.15.84:0/549754603 shutdown_connections 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7c9ee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x561a7c5fa8e0 0x561a7ca00250 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7c9f9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 --2- 172.21.15.84:0/549754603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7c9ee000 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17ab400640 0 client.15279 ms_handle_reset on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 -- 172.21.15.84:0/549754603 >> 172.21.15.84:0/549754603 conn(0x561a7c630350 msgr2=0x561a7c9e5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 -- 172.21.15.84:0/549754603 shutdown_connections 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 1 -- 172.21.15.84:0/549754603 wait complete. 2024-09-21T02:42:29.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.413+0000 7f17d2e49740 20 client.15279 trim_cache size 0 max 16384 2024-09-21T02:42:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17d2e49740 1 Processor -- start 2024-09-21T02:42:29.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17d2e49740 1 -- start start 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c6130a0 0x561a7ca00250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c63bf60 0x561a7c9e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17d2e49740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561a7c9fe590 con 0x561a7c61b280 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17d2e49740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561a7c9fec60 con 0x561a7c6130a0 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17d2e49740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a7c9ff330 con 0x561a7c63bf60 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17c8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9f9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33924/0 (socket says 172.21.15.84:33924) 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17c8e00640 1 -- 172.21.15.84:0/2373288113 learned_addr learned my addr 172.21.15.84:0/2373288113 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.432+0000 7f17ca200640 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c63bf60 0x561a7c9e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17ca200640 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c6130a0 0x561a7ca00250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17ca200640 1 -- 172.21.15.84:0/2373288113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c6130a0 msgr2=0x561a7ca00250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17ca200640 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c6130a0 0x561a7ca00250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17ca200640 1 -- 172.21.15.84:0/2373288113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 msgr2=0x561a7c9f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17ca200640 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9f9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17ca200640 1 -- 172.21.15.84:0/2373288113 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a7c9faf80 con 0x561a7c63bf60 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17ca200640 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c63bf60 0x561a7c9e8f40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17bc011500 tx=0x7f17bc00f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83ae61004c0fab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17b6000640 1 -- 172.21.15.84:0/2373288113 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc015070 con 0x561a7c63bf60 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17b6000640 1 -- 172.21.15.84:0/2373288113 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17bc00fcf0 con 0x561a7c63bf60 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.433+0000 7f17b6000640 1 -- 172.21.15.84:0/2373288113 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc01c110 con 0x561a7c63bf60 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 -- 172.21.15.84:0/2373288113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c63bf60 msgr2=0x561a7c9e8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c63bf60 0x561a7c9e8f40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17bc011500 tx=0x7f17bc00f7f0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 -- 172.21.15.84:0/2373288113 shutdown_connections 2024-09-21T02:42:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c63bf60 0x561a7c9e8f40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c61b280 0x561a7c9f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2373288113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c6130a0 0x561a7ca00250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 -- 172.21.15.84:0/2373288113 >> 172.21.15.84:0/2373288113 conn(0x561a7c630350 msgr2=0x561a7c9edfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 -- 172.21.15.84:0/2373288113 shutdown_connections 2024-09-21T02:42:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.434+0000 7f17d2e49740 1 -- 172.21.15.84:0/2373288113 wait complete. 2024-09-21T02:42:29.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.435+0000 7f17d2e49740 1 -- start start 2024-09-21T02:42:29.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.435+0000 7f17d2e49740 1 Processor -- start 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.435+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7ca08d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.435+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7ca07960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17d2e49740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7ca07ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17d2e49740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561a7ca000d0 con 0x561a7c6130a0 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17d2e49740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561a7c9ffa00 con 0x561a7c63bf60 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17d2e49740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a7ca007a0 con 0x561a7c61b280 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17d2e49740 10 client.0 _ll_register_callbacks cb 0x7f17bc01ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7ca08d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7ca08d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33936/0 (socket says 172.21.15.84:33936) 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 -- 172.21.15.84:0/2335192555 learned_addr learned my addr 172.21.15.84:0/2335192555 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17c8e00640 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7ca07960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7ca07ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 -- 172.21.15.84:0/2335192555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 msgr2=0x561a7ca07960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7ca07960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 -- 172.21.15.84:0/2335192555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 msgr2=0x561a7ca07ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7ca07ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.436+0000 7f17ca200640 1 -- 172.21.15.84:0/2335192555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a7ca08650 con 0x561a7c6130a0 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.437+0000 7f17ca200640 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7ca08d40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f17bc01af50 tx=0x7f17bc01bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb12c28facffc14d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.437+0000 7f17ab400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.437+0000 7f17ab400640 1 -- 172.21.15.84:0/2335192555 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc015070 con 0x561a7c6130a0 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.437+0000 7f17ab400640 1 -- 172.21.15.84:0/2335192555 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f17bc01abf0 con 0x561a7c6130a0 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.437+0000 7f17d2e49740 1 -- 172.21.15.84:0/2335192555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17bc00fcf0 con 0x561a7c6130a0 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.437+0000 7f17ab400640 1 -- 172.21.15.84:0/2335192555 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f17bc049050 con 0x561a7c6130a0 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.437+0000 7f17d2e49740 10 client.15285 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.437+0000 7f17d2e49740 1 -- 172.21.15.84:0/2335192555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561a7ca73f30 con 0x561a7c6130a0 2024-09-21T02:42:29.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17ab400640 1 -- 172.21.15.84:0/2335192555 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17bc00fcf0 con 0x561a7c6130a0 2024-09-21T02:42:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17ab400640 1 -- 172.21.15.84:0/2335192555 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f17bc028040 con 0x561a7c6130a0 2024-09-21T02:42:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17d2e49740 10 client.15285 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17d2e49740 10 client.15285 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T02:42:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17d2e49740 20 client.15285 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x561a7c5cfc90 0x561a7ca77330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17d2e49740 4 client.15285 mds_command: new command op to 24703 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:42:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17d2e49740 1 -- 172.21.15.84:0/2335192555 --> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] -- command(tid 0: {"prefix": "status"}) -- 0x561a7c957750 con 0x561a7c5cfc90 2024-09-21T02:42:29.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.438+0000 7f17c8e00640 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x561a7c5cfc90 0x561a7ca77330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17c8e00640 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x561a7c5cfc90 0x561a7ca77330 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a8658b5523a97f7e server_cookie=7d7730d242719d4a in_seq=0 out_seq=0 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17ab400640 10 client.15285 ms_handle_connect on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17ab400640 1 -- 172.21.15.84:0/2335192555 <== mds.1 v2:172.21.15.172:6838/3937933536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561a7c957750 con 0x561a7c5cfc90 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17ab400640 10 client.15285 handle_command_reply: tid=0 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 client.15285 shutdown 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 -- 172.21.15.84:0/2335192555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 msgr2=0x561a7ca08d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7ca08d40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f17bc01af50 tx=0x7f17bc01bfd0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 -- 172.21.15.84:0/2335192555 shutdown_connections 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a7c61b280 0x561a7ca07960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x561a7c5cfc90 0x561a7ca77330 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561a7c63bf60 0x561a7ca07ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 --2- 172.21.15.84:0/2335192555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561a7c6130a0 0x561a7ca08d40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.439+0000 7f17d2e49740 1 -- 172.21.15.84:0/2335192555 >> 172.21.15.84:0/2335192555 conn(0x561a7c630350 msgr2=0x561a7c9e8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.440+0000 7f17ab400640 0 client.15285 ms_handle_reset on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:29.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.440+0000 7f17d2e49740 1 -- 172.21.15.84:0/2335192555 shutdown_connections 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.440+0000 7f17d2e49740 1 -- 172.21.15.84:0/2335192555 wait complete. 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.440+0000 7f17d2e49740 20 client.15285 trim_cache size 0 max 16384 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24703, 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 110.07767777700001, 2024-09-21T02:42:29.444 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 26, 2024-09-21T02:42:29.445 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:42:29.445 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:42:29.445 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 185.078051235 2024-09-21T02:42:29.445 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:42:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.440+0000 7f17cc200640 1 -- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f17ac0b6510 msgr2=0x7f17ac0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.440+0000 7f17cc200640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f17ac0b6510 0x7f17ac0b8a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f17b80cd770 tx=0x7f17b803b6b0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 -- 172.21.15.84:0/2849141355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c4105d80 msgr2=0x7f17c419c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c4105d80 0x7f17c419c800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005940 tx=0x7f17b80042f0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 -- 172.21.15.84:0/2849141355 shutdown_connections 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f17ac0b6510 0x7f17ac0b8a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c410c010 0x7f17c41a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17c410b6c0 0x7f17c419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 --2- 172.21.15.84:0/2849141355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c4105d80 0x7f17c419c800 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 -- 172.21.15.84:0/2849141355 >> 172.21.15.84:0/2849141355 conn(0x7f17c4101810 msgr2=0x7f17c4103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 -- 172.21.15.84:0/2849141355 shutdown_connections 2024-09-21T02:42:29.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:29.441+0000 7f17cc200640 1 -- 172.21.15.84:0/2849141355 wait complete. 2024-09-21T02:42:29.967 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:29 smithi084 ceph-mon[30747]: pgmap v402: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:29 smithi172 ceph-mon[35067]: pgmap v402: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:29 smithi090 ceph-mon[34571]: pgmap v402: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:30.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:42:30.805 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 -- 172.21.15.84:0/1856457216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b74105d90 msgr2=0x7f5b741061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 --2- 172.21.15.84:0/1856457216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b74105d90 0x7f5b741061a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009900 tx=0x7f5b6802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 -- 172.21.15.84:0/1856457216 shutdown_connections 2024-09-21T02:42:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 --2- 172.21.15.84:0/1856457216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b7410c020 0x7f5b74112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 --2- 172.21.15.84:0/1856457216 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7410b6d0 0x7f5b7410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 --2- 172.21.15.84:0/1856457216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b74105d90 0x7f5b741061a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 -- 172.21.15.84:0/1856457216 >> 172.21.15.84:0/1856457216 conn(0x7f5b741017c0 msgr2=0x7f5b74103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:31.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 -- 172.21.15.84:0/1856457216 shutdown_connections 2024-09-21T02:42:31.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.431+0000 7f5b7c400640 1 -- 172.21.15.84:0/1856457216 wait complete. 2024-09-21T02:42:31.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.433+0000 7f5b7c400640 1 Processor -- start 2024-09-21T02:42:31.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.433+0000 7f5b7c400640 1 -- start start 2024-09-21T02:42:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.433+0000 7f5b7c400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b74105d90 0x7f5b7419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.433+0000 7f5b7c400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7410b6d0 0x7f5b7419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.433+0000 7f5b7c400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7410c020 0x7f5b741a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.433+0000 7f5b7c400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74115e00 con 0x7f5b7410b6d0 2024-09-21T02:42:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.433+0000 7f5b7c400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74115c80 con 0x7f5b7410c020 2024-09-21T02:42:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.433+0000 7f5b7c400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b74115f80 con 0x7f5b74105d90 2024-09-21T02:42:31.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b74105d90 0x7f5b7419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7410b6d0 0x7f5b7419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b74105d90 0x7f5b7419c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:48784/0 (socket says 172.21.15.84:48784) 2024-09-21T02:42:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79a00640 1 -- 172.21.15.84:0/2847055984 learned_addr learned my addr 172.21.15.84:0/2847055984 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:31.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b7a400640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7410c020 0x7f5b741a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79a00640 1 -- 172.21.15.84:0/2847055984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7410c020 msgr2=0x7f5b741a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79a00640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7410c020 0x7f5b741a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79a00640 1 -- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7410b6d0 msgr2=0x7f5b7419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79a00640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7410b6d0 0x7f5b7419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.434+0000 7f5b79a00640 1 -- 172.21.15.84:0/2847055984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b741a2720 con 0x7f5b74105d90 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.435+0000 7f5b79a00640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b74105d90 0x7f5b7419c7b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b68005ab0 tx=0x7f5b680040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.435+0000 7f5b72000640 1 -- 172.21.15.84:0/2847055984 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6803f030 con 0x7f5b74105d90 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.435+0000 7f5b7c400640 1 -- 172.21.15.84:0/2847055984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b741a29b0 con 0x7f5b74105d90 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.435+0000 7f5b72000640 1 -- 172.21.15.84:0/2847055984 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5b68003ac0 con 0x7f5b74105d90 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.435+0000 7f5b72000640 1 -- 172.21.15.84:0/2847055984 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68035070 con 0x7f5b74105d90 2024-09-21T02:42:31.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.435+0000 7f5b7c400640 1 -- 172.21.15.84:0/2847055984 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b741a9170 con 0x7f5b74105d90 2024-09-21T02:42:31.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.439+0000 7f5b83201740 1 Processor -- start 2024-09-21T02:42:31.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.439+0000 7f5b83201740 1 -- start start 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.439+0000 7f5b83201740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.439+0000 7f5b83201740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.439+0000 7f5b83201740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.439+0000 7f5b83201740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f41363fd50 con 0x55f413301280 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.439+0000 7f5b83201740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f41362f180 con 0x55f413321f60 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.439+0000 7f5b83201740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f413632f90 con 0x55f4132f90a0 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b79000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b7a400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b79000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39064/0 (socket says 172.21.15.84:39064) 2024-09-21T02:42:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b7a400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:34584/0 (socket says 172.21.15.84:34584) 2024-09-21T02:42:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b79000640 1 -- 172.21.15.84:0/1291956488 learned_addr learned my addr 172.21.15.84:0/1291956488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:31.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b7a400640 1 -- 172.21.15.84:0/1291956488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 msgr2=0x55f4136c89d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b7a400640 1 --2- 172.21.15.84:0/1291956488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136c89d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b7a400640 1 -- 172.21.15.84:0/1291956488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 msgr2=0x55f4136c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b7a400640 1 --2- 172.21.15.84:0/1291956488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b7a400640 1 -- 172.21.15.84:0/1291956488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4135f9a70 con 0x55f413321f60 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b72000640 1 -- 172.21.15.84:0/2847055984 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5b68042030 con 0x7f5b74105d90 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.440+0000 7f5b7a400640 1 --2- 172.21.15.84:0/1291956488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c8490 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009f00 tx=0x7f5b6c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7410b4e41966b534 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.441+0000 7f5b66a00640 1 -- 172.21.15.84:0/1291956488 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c004d20 con 0x55f413321f60 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.441+0000 7f5b66a00640 1 -- 172.21.15.84:0/1291956488 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5b6c004030 con 0x55f413321f60 2024-09-21T02:42:31.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.441+0000 7f5b66a00640 1 -- 172.21.15.84:0/1291956488 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c005280 con 0x55f413321f60 2024-09-21T02:42:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 -- 172.21.15.84:0/1291956488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 msgr2=0x55f4136c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 --2- 172.21.15.84:0/1291956488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c8490 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009f00 tx=0x7f5b6c011810 comp rx=0 tx=0).stop 2024-09-21T02:42:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 -- 172.21.15.84:0/1291956488 shutdown_connections 2024-09-21T02:42:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 --2- 172.21.15.84:0/1291956488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 --2- 172.21.15.84:0/1291956488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 --2- 172.21.15.84:0/1291956488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c8490 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 -- 172.21.15.84:0/1291956488 >> 172.21.15.84:0/1291956488 conn(0x55f413316350 msgr2=0x55f4136c6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 -- 172.21.15.84:0/1291956488 shutdown_connections 2024-09-21T02:42:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b83201740 1 -- 172.21.15.84:0/1291956488 wait complete. 2024-09-21T02:42:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.442+0000 7f5b72000640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b5c0b64a0 0x7f5b5c0b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.443+0000 7f5b72000640 1 -- 172.21.15.84:0/2847055984 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f5b68107db0 con 0x7f5b74105d90 2024-09-21T02:42:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.443+0000 7f5b79000640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b5c0b64a0 0x7f5b5c0b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.443+0000 7f5b83201740 1 -- start start 2024-09-21T02:42:31.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.443+0000 7f5b83201740 1 Processor -- start 2024-09-21T02:42:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.443+0000 7f5b79000640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b5c0b64a0 0x7f5b5c0b89b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009cc0 tx=0x7f5b60005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:31.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.443+0000 7f5b83201740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b83201740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413301280 0x55f4136d4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b83201740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413321f60 0x55f4136dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b83201740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f4134905f0 con 0x55f413321f60 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b83201740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f4135ca460 con 0x55f413301280 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b83201740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f4136d6c70 con 0x55f4132f90a0 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b83201740 10 client.0 _ll_register_callbacks cb 0x55f4135da210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413301280 0x55f4136d4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413301280 0x55f4136d4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:34586/0 (socket says 172.21.15.84:34586) 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79000640 1 -- 172.21.15.84:0/188906244 learned_addr learned my addr 172.21.15.84:0/188906244 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b7a400640 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413321f60 0x55f4136dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79a00640 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79000640 1 -- 172.21.15.84:0/188906244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 msgr2=0x55f4136d40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79000640 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136d40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79000640 1 -- 172.21.15.84:0/188906244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413321f60 msgr2=0x55f4136dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:31.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79000640 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413321f60 0x55f4136dff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79000640 1 -- 172.21.15.84:0/188906244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f41338d540 con 0x55f413301280 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.444+0000 7f5b79a00640 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136d40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.445+0000 7f5b79000640 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413301280 0x55f4136d4620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b600045f0 tx=0x7f5b60004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8362a2a773fc086 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.445+0000 7f5b5b400640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.445+0000 7f5b5b400640 1 -- 172.21.15.84:0/188906244 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60009e30 con 0x55f413301280 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.445+0000 7f5b83201740 1 -- 172.21.15.84:0/188906244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f4135cca70 con 0x55f413301280 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.445+0000 7f5b5b400640 1 -- 172.21.15.84:0/188906244 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f5b6001f640 con 0x55f413301280 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.445+0000 7f5b5b400640 1 -- 172.21.15.84:0/188906244 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5b6001f880 con 0x55f413301280 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.445+0000 7f5b83201740 10 client.25304 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.445+0000 7f5b83201740 1 -- 172.21.15.84:0/188906244 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f4135e76f0 con 0x55f413301280 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.446+0000 7f5b5b400640 1 -- 172.21.15.84:0/188906244 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55f4135cca70 con 0x55f413301280 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.446+0000 7f5b5b400640 1 -- 172.21.15.84:0/188906244 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5b60027070 con 0x55f413301280 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.446+0000 7f5b83201740 10 client.25304 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:31.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.446+0000 7f5b83201740 10 client.25304 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:42:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.446+0000 7f5b83201740 20 client.25304 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.446+0000 7f5b83201740 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f4132e08e0 0x55f4136e6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.446+0000 7f5b83201740 4 client.25304 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.446+0000 7f5b83201740 1 -- 172.21.15.84:0/188906244 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f413641ca0 con 0x55f4132e08e0 2024-09-21T02:42:31.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.447+0000 7f5b79a00640 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f4132e08e0 0x55f4136e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.447+0000 7f5b79a00640 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f4132e08e0 0x55f4136e6620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=428593ad9530053 server_cookie=2b6c9f6722f8789d in_seq=0 out_seq=0 2024-09-21T02:42:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.447+0000 7f5b5b400640 10 client.25304 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b5b400640 1 -- 172.21.15.84:0/188906244 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f413641ca0 con 0x55f4132e08e0 2024-09-21T02:42:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b5b400640 10 client.25304 handle_command_reply: tid=0 2024-09-21T02:42:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 client.25304 shutdown 2024-09-21T02:42:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 -- 172.21.15.84:0/188906244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413301280 msgr2=0x55f4136d4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413301280 0x55f4136d4620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b600045f0 tx=0x7f5b60004730 comp rx=0 tx=0).stop 2024-09-21T02:42:31.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 -- 172.21.15.84:0/188906244 shutdown_connections 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f4132e08e0 0x55f4136e6620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413321f60 0x55f4136dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413301280 0x55f4136d4620 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 --2- 172.21.15.84:0/188906244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136d40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b5b400640 0 client.25304 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 -- 172.21.15.84:0/188906244 >> 172.21.15.84:0/188906244 conn(0x55f413316350 msgr2=0x55f4136cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 -- 172.21.15.84:0/188906244 shutdown_connections 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 1 -- 172.21.15.84:0/188906244 wait complete. 2024-09-21T02:42:31.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.448+0000 7f5b83201740 20 client.25304 trim_cache size 0 max 16384 2024-09-21T02:42:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.467+0000 7f5b83201740 1 Processor -- start 2024-09-21T02:42:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.467+0000 7f5b83201740 1 -- start start 2024-09-21T02:42:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.467+0000 7f5b83201740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4132f90a0 0x55f4136e6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.467+0000 7f5b83201740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f413301280 0x55f4136dfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.467+0000 7f5b83201740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.467+0000 7f5b83201740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f4136e4960 con 0x55f4132f90a0 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.467+0000 7f5b83201740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f4136e5030 con 0x55f413321f60 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.467+0000 7f5b83201740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f4136e5700 con 0x55f413301280 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4132f90a0 0x55f4136e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4132f90a0 0x55f4136e6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39080/0 (socket says 172.21.15.84:39080) 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79a00640 1 -- 172.21.15.84:0/1827643706 learned_addr learned my addr 172.21.15.84:0/1827643706 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b7a400640 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79000640 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f413301280 0x55f4136dfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79a00640 1 -- 172.21.15.84:0/1827643706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f413301280 msgr2=0x55f4136dfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79a00640 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f413301280 0x55f4136dfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79a00640 1 -- 172.21.15.84:0/1827643706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 msgr2=0x55f4136c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79a00640 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.468+0000 7f5b79a00640 1 -- 172.21.15.84:0/1827643706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4136d36c0 con 0x55f4132f90a0 2024-09-21T02:42:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.469+0000 7f5b79a00640 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4132f90a0 0x55f4136e6620 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5b68005940 tx=0x7f5b6802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c527fec675c310 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.469+0000 7f5b66000640 1 -- 172.21.15.84:0/1827643706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68049040 con 0x55f4132f90a0 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.469+0000 7f5b66000640 1 -- 172.21.15.84:0/1827643706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5b680d2070 con 0x55f4132f90a0 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.469+0000 7f5b66000640 1 -- 172.21.15.84:0/1827643706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68003c70 con 0x55f4132f90a0 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 -- 172.21.15.84:0/1827643706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4132f90a0 msgr2=0x55f4136e6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4132f90a0 0x55f4136e6620 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5b68005940 tx=0x7f5b6802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 -- 172.21.15.84:0/1827643706 shutdown_connections 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f413301280 0x55f4136dfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 --2- 172.21.15.84:0/1827643706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4132f90a0 0x55f4136e6620 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 -- 172.21.15.84:0/1827643706 >> 172.21.15.84:0/1827643706 conn(0x55f413316350 msgr2=0x55f4136d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 -- 172.21.15.84:0/1827643706 shutdown_connections 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 -- 172.21.15.84:0/1827643706 wait complete. 2024-09-21T02:42:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 -- start start 2024-09-21T02:42:31.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.470+0000 7f5b83201740 1 Processor -- start 2024-09-21T02:42:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b83201740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b83201740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b83201740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136ee310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b83201740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f4136e64a0 con 0x55f413301280 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b83201740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f4136e5dd0 con 0x55f413321f60 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b83201740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f4136e6b70 con 0x55f4132f90a0 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b83201740 10 client.0 _ll_register_callbacks cb 0x7f5b600044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b79000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b79000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136e90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39090/0 (socket says 172.21.15.84:39090) 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b79000640 1 -- 172.21.15.84:0/2234708706 learned_addr learned my addr 172.21.15.84:0/2234708706 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.471+0000 7f5b79a00640 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b7a400640 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136ee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b79000640 1 -- 172.21.15.84:0/2234708706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 msgr2=0x55f4136e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b79000640 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b79000640 1 -- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 msgr2=0x55f4136ee310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b79000640 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136ee310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b79000640 1 -- 172.21.15.84:0/2234708706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4136e9940 con 0x55f413301280 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b7a400640 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136ee310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b79000640 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136e90c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5b60029e80 tx=0x7f5b6001f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc17d15c0f086d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b5b400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b5b400640 1 -- 172.21.15.84:0/2234708706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6003c060 con 0x55f413301280 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b5b400640 1 -- 172.21.15.84:0/2234708706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f5b6001d820 con 0x55f413301280 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.472+0000 7f5b83201740 1 -- 172.21.15.84:0/2234708706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b680d2070 con 0x55f413301280 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b5b400640 1 -- 172.21.15.84:0/2234708706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5b6001fe30 con 0x55f413301280 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b83201740 10 client.15303 fetch_fsmap learned FSMap version 26 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b83201740 1 -- 172.21.15.84:0/2234708706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f413752060 con 0x55f413301280 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b5b400640 1 -- 172.21.15.84:0/2234708706 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5b680d2070 con 0x55f413301280 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b5b400640 1 -- 172.21.15.84:0/2234708706 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5b60027040 con 0x55f413301280 2024-09-21T02:42:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b83201740 10 client.15303 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b83201740 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b83201740 20 client.15303 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b83201740 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f4132b5c90 0x55f413755930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b83201740 4 client.15303 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.473+0000 7f5b83201740 1 -- 172.21.15.84:0/2234708706 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "status"}) -- 0x55f41363d750 con 0x55f4132b5c90 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.474+0000 7f5b79a00640 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f4132b5c90 0x55f413755930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.474+0000 7f5b79a00640 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f4132b5c90 0x55f413755930 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9cf3576be44252f server_cookie=1e54c6a4a6283b76 in_seq=0 out_seq=0 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.474+0000 7f5b5b400640 10 client.15303 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.474+0000 7f5b5b400640 1 -- 172.21.15.84:0/2234708706 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f41363d750 con 0x55f4132b5c90 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.474+0000 7f5b5b400640 10 client.15303 handle_command_reply: tid=0 2024-09-21T02:42:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.474+0000 7f5b83201740 1 client.15303 shutdown 2024-09-21T02:42:31.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 -- 172.21.15.84:0/2234708706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 msgr2=0x55f4136e90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136e90c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5b60029e80 tx=0x7f5b6001f640 comp rx=0 tx=0).stop 2024-09-21T02:42:31.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 -- 172.21.15.84:0/2234708706 shutdown_connections 2024-09-21T02:42:31.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f4132b5c90 0x55f413755930 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f413321f60 0x55f4136ee310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f413301280 0x55f4136e90c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 --2- 172.21.15.84:0/2234708706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4132f90a0 0x55f4136e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 -- 172.21.15.84:0/2234708706 >> 172.21.15.84:0/2234708706 conn(0x55f413316350 msgr2=0x55f4136c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b5b400640 0 client.15303 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 -- 172.21.15.84:0/2234708706 shutdown_connections 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 1 -- 172.21.15.84:0/2234708706 wait complete. 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.475+0000 7f5b83201740 20 client.15303 trim_cache size 0 max 16384 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:42:31.480 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24704, 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 162.62981068799999, 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 26, 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 86, 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 177.18206894299999 2024-09-21T02:42:31.481 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 -- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b5c0b64a0 msgr2=0x7f5b5c0b89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b5c0b64a0 0x7f5b5c0b89b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009cc0 tx=0x7f5b60005f90 comp rx=0 tx=0).stop 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 -- 172.21.15.84:0/2847055984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b74105d90 msgr2=0x7f5b7419c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b74105d90 0x7f5b7419c7b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b68005ab0 tx=0x7f5b680040c0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 -- 172.21.15.84:0/2847055984 shutdown_connections 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b7410c020 0x7f5b741a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7410b6d0 0x7f5b7419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f5b5c0b64a0 0x7f5b5c0b89b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 --2- 172.21.15.84:0/2847055984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b74105d90 0x7f5b7419c7b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 -- 172.21.15.84:0/2847055984 >> 172.21.15.84:0/2847055984 conn(0x7f5b741017c0 msgr2=0x7f5b7410ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:31.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 -- 172.21.15.84:0/2847055984 shutdown_connections 2024-09-21T02:42:31.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:31.476+0000 7f5b7c400640 1 -- 172.21.15.84:0/2847055984 wait complete. 2024-09-21T02:42:31.993 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:31 smithi084 ceph-mon[30747]: pgmap v403: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:31 smithi172 ceph-mon[35067]: pgmap v403: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:32.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:31 smithi090 ceph-mon[34571]: pgmap v403: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:32.378 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T02:42:32.397 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T02:42:32.397 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T02:42:32.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:32.397 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T02:42:32.434 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T02:42:32.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:32.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T02:42:32.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:32.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-09-21T02:42:32.861 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-21T02:42:32.861 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T02:42:32.861 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T02:42:32.861 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T02:42:33.232 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 -- 172.21.15.84:0/3465731686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 msgr2=0x7f15b8110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 --2- 172.21.15.84:0/3465731686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 0x7f15b8110320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009ca0 tx=0x7f15b002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:42:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 -- 172.21.15.84:0/3465731686 shutdown_connections 2024-09-21T02:42:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 --2- 172.21.15.84:0/3465731686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 0x7f15b8110320 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 --2- 172.21.15.84:0/3465731686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15b8105320 0x7f15b810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 --2- 172.21.15.84:0/3465731686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15b81049d0 0x7f15b8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 -- 172.21.15.84:0/3465731686 >> 172.21.15.84:0/3465731686 conn(0x7f15b8079740 msgr2=0x7f15b8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 -- 172.21.15.84:0/3465731686 shutdown_connections 2024-09-21T02:42:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.875+0000 7f15bf000640 1 -- 172.21.15.84:0/3465731686 wait complete. 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bf000640 1 Processor -- start 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bf000640 1 -- start start 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bf000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15b81049d0 0x7f15b819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bf000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15b8105320 0x7f15b819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bf000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 0x7f15b819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bf000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f15b8113bd0 con 0x7f15b810de30 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bf000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15b8113a50 con 0x7f15b81049d0 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bf000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15b8113d50 con 0x7f15b8105320 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.877+0000 7f15bd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 0x7f15b819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:33.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15bd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 0x7f15b819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39118/0 (socket says 172.21.15.84:39118) 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15afe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15b8105320 0x7f15b819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15bd000640 1 -- 172.21.15.84:0/4192593471 learned_addr learned my addr 172.21.15.84:0/4192593471 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15b7e00640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15b81049d0 0x7f15b819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15bd000640 1 -- 172.21.15.84:0/4192593471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15b8105320 msgr2=0x7f15b819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15bd000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15b8105320 0x7f15b819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15bd000640 1 -- 172.21.15.84:0/4192593471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15b81049d0 msgr2=0x7f15b819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15bd000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15b81049d0 0x7f15b819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15bd000640 1 -- 172.21.15.84:0/4192593471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b81a0530 con 0x7f15b810de30 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.878+0000 7f15bd000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 0x7f15b819fe00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f15b0033040 tx=0x7f15b0003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.879+0000 7f15b5600640 1 -- 172.21.15.84:0/4192593471 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b0031650 con 0x7f15b810de30 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.879+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b81a07c0 con 0x7f15b810de30 2024-09-21T02:42:33.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.879+0000 7f15b5600640 1 -- 172.21.15.84:0/4192593471 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f15b00317f0 con 0x7f15b810de30 2024-09-21T02:42:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.879+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b81a6f80 con 0x7f15b810de30 2024-09-21T02:42:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.879+0000 7f15b5600640 1 -- 172.21.15.84:0/4192593471 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b002fa20 con 0x7f15b810de30 2024-09-21T02:42:33.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.880+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b806c240 con 0x7f15b810de30 2024-09-21T02:42:33.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.883+0000 7f15b5600640 1 -- 172.21.15.84:0/4192593471 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f15b002fbc0 con 0x7f15b810de30 2024-09-21T02:42:33.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.884+0000 7f15b5600640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f159c0b6510 0x7f159c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:33.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.884+0000 7f15b5600640 1 -- 172.21.15.84:0/4192593471 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f15b0108a30 con 0x7f15b810de30 2024-09-21T02:42:33.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.884+0000 7f15b7e00640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f159c0b6510 0x7f159c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:33.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.885+0000 7f15b7e00640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f159c0b6510 0x7f159c0b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15b806c940 tx=0x7f15a8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:33.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:33.886+0000 7f15b5600640 1 -- 172.21.15.84:0/4192593471 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15b00cef30 con 0x7f15b810de30 2024-09-21T02:42:34.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:33 smithi172 ceph-mon[35067]: pgmap v404: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:34.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:33 smithi084 ceph-mon[30747]: pgmap v404: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:34.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:33 smithi090 ceph-mon[34571]: pgmap v404: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.111+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f15b8104de0 con 0x7f15b810de30 2024-09-21T02:42:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.112+0000 7f15b5600640 1 -- 172.21.15.84:0/4192593471 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+88 (secure 0 0 0) 0x7f15b00d3310 con 0x7f15b810de30 2024-09-21T02:42:34.113 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.114+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f159c0b6510 msgr2=0x7f159c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.114+0000 7f15bf000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f159c0b6510 0x7f159c0b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15b806c940 tx=0x7f15a8005f90 comp rx=0 tx=0).stop 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.114+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 msgr2=0x7f15b819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.114+0000 7f15bf000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 0x7f15b819fe00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f15b0033040 tx=0x7f15b0003c90 comp rx=0 tx=0).stop 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.115+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 shutdown_connections 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.115+0000 7f15bf000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f159c0b6510 0x7f159c0b8a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.115+0000 7f15bf000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15b8105320 0x7f15b819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.115+0000 7f15bf000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15b810de30 0x7f15b819fe00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.115+0000 7f15bf000640 1 --2- 172.21.15.84:0/4192593471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15b81049d0 0x7f15b819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.115+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 >> 172.21.15.84:0/4192593471 conn(0x7f15b8079740 msgr2=0x7f15b80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.115+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 shutdown_connections 2024-09-21T02:42:34.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:34.115+0000 7f15bf000640 1 -- 172.21.15.84:0/4192593471 wait complete. 2024-09-21T02:42:34.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:34 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4192593471' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:42:34.902 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T02:42:34.903 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T02:42:34.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-09-21T02:42:34.903 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T02:42:34.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T02:42:34.903 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T02:42:34.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T02:42:34.903 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T02:42:34.903 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T02:42:34.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:34.903 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-09-21T02:42:34.940 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T02:42:34.940 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T02:42:34.940 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T02:42:34.940 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 41982sec preferred_lft 41982sec 2024-09-21T02:42:34.941 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2024-09-21T02:42:34.942 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T02:42:34.942 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T02:42:34.942 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:42:34.942 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:42:34.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-09-21T02:42:34.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-09-21T02:42:34.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-09-21T02:42:34.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T02:42:34.942 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:42:35.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:34 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4192593471' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:42:35.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:34 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4192593471' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T02:42:35.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:42:35.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:35.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:35.165 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T02:42:35.222 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-09-21T02:42:35.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:35.225 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-09-21T02:42:35.261 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-09-21T02:42:35.261 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T02:42:35.261 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T02:42:35.262 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T02:42:35.262 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T02:42:35.262 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:42:35.262 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:42:35.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T02:42:35.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T02:42:35.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T02:42:35.262 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:42:35.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:42:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:35.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:35.461 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T02:42:35.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:35.497 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-09-21T02:42:35.573 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:42:35.573 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:42:35.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T02:42:35.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T02:42:35.573 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:42:35.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:42:35.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:35.754 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T02:42:35.754 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:42:35.754 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:42:35.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T02:42:35.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T02:42:35.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T02:42:35.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T02:42:35.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T02:42:35.755 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:42:35.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:42:35.962 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:35 smithi084 ceph-mon[30747]: pgmap v405: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:42:35.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:35.975 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T02:42:35.975 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T02:42:35.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-09-21T02:42:35.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T02:42:35.975 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T02:42:36.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:35 smithi172 ceph-mon[35067]: pgmap v405: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:42:36.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:35 smithi090 ceph-mon[34571]: pgmap v405: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T02:42:36.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:42:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:36.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:42:36.141 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T02:42:36.176 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T02:42:36.178 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T02:42:36.179 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T02:42:36.251 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T02:42:36.252 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T02:42:36.252 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/5d55f446-c258-45c4-954d-801cc1d5889f 2024-09-21T02:42:36.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:36.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/5d55f446-c258-45c4-954d-801cc1d5889f /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-21T02:42:36.447 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-21T02:42:36.447 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-21T02:42:36.447 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2024-09-21T02:42:37.116 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-21T02:42:37.116 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-21T02:42:37.116 INFO:teuthology.orchestra.run.smithi084.stdout:invalid new device string format 2024-09-21T02:42:37.116 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:6789,172.21.15.90:6789,172.21.15.172:6789" 2024-09-21T02:42:37.116 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.84:6789,172.21.15.90:6789,172.21.15.172:6789:/volumes/qa/sv_1/5d55f446-c258-45c4-954d-801cc1d5889f 2024-09-21T02:42:37.117 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=5b18da14-77c1-11ef-baf5-efdc52797490" will pass to kernel 2024-09-21T02:42:37.118 INFO:teuthology.orchestra.run.smithi084.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T02:42:37.119 INFO:teuthology.orchestra.run.smithi084.stdout: You just mounted a file system that supports labels which does not 2024-09-21T02:42:37.119 INFO:teuthology.orchestra.run.smithi084.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T02:42:37.119 INFO:teuthology.orchestra.run.smithi084.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T02:42:37.119 INFO:teuthology.orchestra.run.smithi084.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T02:42:37.122 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T02:42:37.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:42:37.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T02:42:37.184 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T02:42:37.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:42:37.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:37.277 INFO:teuthology.orchestra.run.smithi084.stdout:client25324 2024-09-21T02:42:37.277 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:42:37.277 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:42:37.314 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T02:42:37.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:42:37.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:37.443 INFO:teuthology.orchestra.run.smithi084.stdout:client25324 2024-09-21T02:42:37.443 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T02:42:37.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T02:42:37.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:37.531 INFO:teuthology.orchestra.run.smithi084.stdout:client25324 2024-09-21T02:42:37.532 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5b18da14-77c1-11ef-baf5-efdc52797490.client25324/status') 2024-09-21T02:42:37.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T02:42:37.631 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.25324 (3)172.21.15.84:0/2298931576 2024-09-21T02:42:37.631 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2024-09-21T02:42:37.631 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2024-09-21T02:42:37.632 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2024-09-21T02:42:37.632 INFO:teuthology.orchestra.run.smithi084.stderr:71 bytes copied, 7.0765e-05 s, 1.0 MB/s 2024-09-21T02:42:37.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T02:42:37.642 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T02:42:37.654 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T02:42:37.654 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:42:37.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T02:42:37.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 -- 172.21.15.84:0/3921896400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4106850 msgr2=0x7fb4f4108cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:37.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/3921896400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4106850 0x7fb4f4108cd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009900 tx=0x7fb4e002a410 comp rx=0 tx=0).stop 2024-09-21T02:42:37.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 -- 172.21.15.84:0/3921896400 shutdown_connections 2024-09-21T02:42:37.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/3921896400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4f4109410 0x7fb4f410b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:37.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/3921896400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4106850 0x7fb4f4108cd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:37.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/3921896400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f406c4b0 0x7fb4f4106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:37.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 -- 172.21.15.84:0/3921896400 >> 172.21.15.84:0/3921896400 conn(0x7fb4f40fdf30 msgr2=0x7fb4f41003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:37.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 -- 172.21.15.84:0/3921896400 shutdown_connections 2024-09-21T02:42:37.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.871+0000 7fb4fbc00640 1 -- 172.21.15.84:0/3921896400 wait complete. 2024-09-21T02:42:37.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4fbc00640 1 Processor -- start 2024-09-21T02:42:37.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4fbc00640 1 -- start start 2024-09-21T02:42:37.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4fbc00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4f406c4b0 0x7fb4f4103950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:37.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4fbc00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f4106850 0x7fb4f4102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4fbc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4109410 0x7fb4f4102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4fbc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f410f450 con 0x7fb4f4109410 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4fbc00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f410f2d0 con 0x7fb4f4106850 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4fbc00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f410f5d0 con 0x7fb4f406c4b0 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4f9c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4109410 0x7fb4f4102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4f9200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4f406c4b0 0x7fb4f4103950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4f9c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4109410 0x7fb4f4102750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39138/0 (socket says 172.21.15.84:39138) 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.872+0000 7fb4f9c00640 1 -- 172.21.15.84:0/1868905738 learned_addr learned my addr 172.21.15.84:0/1868905738 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.873+0000 7fb4f3e00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f4106850 0x7fb4f4102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.873+0000 7fb4f9200640 1 -- 172.21.15.84:0/1868905738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f4106850 msgr2=0x7fb4f4102210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.873+0000 7fb4f9200640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f4106850 0x7fb4f4102210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.873+0000 7fb4f9200640 1 -- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4109410 msgr2=0x7fb4f4102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.873+0000 7fb4f9200640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4109410 0x7fb4f4102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:37.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.873+0000 7fb4f9200640 1 -- 172.21.15.84:0/1868905738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f4102e80 con 0x7fb4f406c4b0 2024-09-21T02:42:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.873+0000 7fb4f9c00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4109410 0x7fb4f4102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.873+0000 7fb4f9200640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4f406c4b0 0x7fb4f4103950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800e9f0 tx=0x7fb4e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.874+0000 7fb4f1600640 1 -- 172.21.15.84:0/1868905738 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800cd80 con 0x7fb4f406c4b0 2024-09-21T02:42:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.874+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f41a40b0 con 0x7fb4f406c4b0 2024-09-21T02:42:37.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.874+0000 7fb4f1600640 1 -- 172.21.15.84:0/1868905738 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4e80035f0 con 0x7fb4f406c4b0 2024-09-21T02:42:37.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.874+0000 7fb4f1600640 1 -- 172.21.15.84:0/1868905738 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8010670 con 0x7fb4f406c4b0 2024-09-21T02:42:37.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.874+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f41a4570 con 0x7fb4f406c4b0 2024-09-21T02:42:37.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.875+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f40ffa50 con 0x7fb4f406c4b0 2024-09-21T02:42:37.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.877+0000 7fb4f1600640 1 -- 172.21.15.84:0/1868905738 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb4e80037a0 con 0x7fb4f406c4b0 2024-09-21T02:42:37.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.879+0000 7fb4f1600640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb4dc0b6510 0x7fb4dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:37.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.879+0000 7fb4f1600640 1 -- 172.21.15.84:0/1868905738 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fb4e80e79d0 con 0x7fb4f406c4b0 2024-09-21T02:42:37.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.879+0000 7fb4f3e00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb4dc0b6510 0x7fb4dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:37.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.880+0000 7fb4f3e00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb4dc0b6510 0x7fb4dc0b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009230 tx=0x7fb4e0031470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:37.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:37.883+0000 7fb4f1600640 1 -- 172.21.15.84:0/1868905738 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4e80ade70 con 0x7fb4f406c4b0 2024-09-21T02:42:38.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:37 smithi172 ceph-mon[35067]: pgmap v406: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:38.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:37 smithi084 ceph-mon[30747]: pgmap v406: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:37 smithi090 ceph-mon[34571]: pgmap v406: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:42:38.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.110+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fb4f402e640 con 0x7fb4f406c4b0 2024-09-21T02:42:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.706+0000 7fb4f1600640 1 -- 172.21.15.84:0/1868905738 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fb4e80b2250 con 0x7fb4f406c4b0 2024-09-21T02:42:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb4dc0b6510 msgr2=0x7fb4dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb4dc0b6510 0x7fb4dc0b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009230 tx=0x7fb4e0031470 comp rx=0 tx=0).stop 2024-09-21T02:42:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4f406c4b0 msgr2=0x7fb4f4103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4f406c4b0 0x7fb4f4103950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800e9f0 tx=0x7fb4e800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 shutdown_connections 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4f4109410 0x7fb4f4102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4f4106850 0x7fb4f4102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb4dc0b6510 0x7fb4dc0b8a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 --2- 172.21.15.84:0/1868905738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4f406c4b0 0x7fb4f4103950 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 >> 172.21.15.84:0/1868905738 conn(0x7fb4f40fdf30 msgr2=0x7fb4f4104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 shutdown_connections 2024-09-21T02:42:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.709+0000 7fb4fbc00640 1 -- 172.21.15.84:0/1868905738 wait complete. 2024-09-21T02:42:38.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T02:42:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.952+0000 7fe6cee00640 1 -- 172.21.15.84:0/3993311364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c81058d0 msgr2=0x7fe6c8105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.952+0000 7fe6cee00640 1 --2- 172.21.15.84:0/3993311364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c81058d0 0x7fe6c8105d40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009900 tx=0x7fe6b802a410 comp rx=0 tx=0).stop 2024-09-21T02:42:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.952+0000 7fe6cee00640 1 -- 172.21.15.84:0/3993311364 shutdown_connections 2024-09-21T02:42:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.952+0000 7fe6cee00640 1 --2- 172.21.15.84:0/3993311364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c81072f0 0x7fe6c810dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.952+0000 7fe6cee00640 1 --2- 172.21.15.84:0/3993311364 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6c8106950 0x7fe6c8106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.952+0000 7fe6cee00640 1 --2- 172.21.15.84:0/3993311364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c81058d0 0x7fe6c8105d40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.952+0000 7fe6cee00640 1 -- 172.21.15.84:0/3993311364 >> 172.21.15.84:0/3993311364 conn(0x7fe6c8101230 msgr2=0x7fe6c81036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:38.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.953+0000 7fe6cee00640 1 -- 172.21.15.84:0/3993311364 shutdown_connections 2024-09-21T02:42:38.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.953+0000 7fe6cee00640 1 -- 172.21.15.84:0/3993311364 wait complete. 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cee00640 1 Processor -- start 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cee00640 1 -- start start 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cee00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6c81058d0 0x7fe6c819c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cee00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c8106950 0x7fe6c819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cee00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c81072f0 0x7fe6c819d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cee00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c81116c0 con 0x7fe6c8106950 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cee00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8111540 con 0x7fe6c81058d0 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cee00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8111840 con 0x7fe6c81072f0 2024-09-21T02:42:38.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6c7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c8106950 0x7fe6c819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6c7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c8106950 0x7fe6c819c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39158/0 (socket says 172.21.15.84:39158) 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6c7400640 1 -- 172.21.15.84:0/1140464905 learned_addr learned my addr 172.21.15.84:0/1140464905 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6cce00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c81072f0 0x7fe6c819d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.954+0000 7fe6c7e00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6c81058d0 0x7fe6c819c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c7400640 1 -- 172.21.15.84:0/1140464905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c81072f0 msgr2=0x7fe6c819d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c7400640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c81072f0 0x7fe6c819d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c7400640 1 -- 172.21.15.84:0/1140464905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6c81058d0 msgr2=0x7fe6c819c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c7400640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6c81058d0 0x7fe6c819c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c7400640 1 -- 172.21.15.84:0/1140464905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c819dc50 con 0x7fe6c8106950 2024-09-21T02:42:38.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c7400640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c8106950 0x7fe6c819c880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400e9f0 tx=0x7fe6b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c4c00640 1 -- 172.21.15.84:0/1140464905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400cd80 con 0x7fe6c8106950 2024-09-21T02:42:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c4c00640 1 -- 172.21.15.84:0/1140464905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe6b4010900 con 0x7fe6c8106950 2024-09-21T02:42:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c819df40 con 0x7fe6c8106950 2024-09-21T02:42:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6c4c00640 1 -- 172.21.15.84:0/1140464905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4018920 con 0x7fe6c8106950 2024-09-21T02:42:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.955+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c81a4630 con 0x7fe6c8106950 2024-09-21T02:42:38.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.957+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c810caa0 con 0x7fe6c8106950 2024-09-21T02:42:38.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.960+0000 7fe6c4c00640 1 -- 172.21.15.84:0/1140464905 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe6b4010ab0 con 0x7fe6c8106950 2024-09-21T02:42:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.961+0000 7fe6c4c00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6ac0b6590 0x7fe6ac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.961+0000 7fe6c4c00640 1 -- 172.21.15.84:0/1140464905 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fe6b40e7e50 con 0x7fe6c8106950 2024-09-21T02:42:38.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.961+0000 7fe6c7e00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6ac0b6590 0x7fe6ac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:38.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.962+0000 7fe6c7e00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6ac0b6590 0x7fe6ac0b8aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004770 tx=0x7fe6b8031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:38.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:38.962+0000 7fe6c4c00640 1 -- 172.21.15.84:0/1140464905 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6b40b26d0 con 0x7fe6c8106950 2024-09-21T02:42:39.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:38 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1868905738' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T02:42:39.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:38 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T02:42:39.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:38 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1868905738' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T02:42:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:38 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T02:42:39.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:38 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1868905738' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T02:42:39.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:38 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T02:42:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.180+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fe6c80638a0 con 0x7fe6ac0b6590 2024-09-21T02:42:39.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.206+0000 7fe6c4c00640 1 -- 172.21.15.84:0/1140464905 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fe6c80638a0 con 0x7fe6ac0b6590 2024-09-21T02:42:39.208 INFO:teuthology.orchestra.run.smithi084.stdout:{} 2024-09-21T02:42:39.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6ac0b6590 msgr2=0x7fe6ac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6ac0b6590 0x7fe6ac0b8aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004770 tx=0x7fe6b8031510 comp rx=0 tx=0).stop 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c8106950 msgr2=0x7fe6c819c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c8106950 0x7fe6c819c880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400e9f0 tx=0x7fe6b400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 shutdown_connections 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6ac0b6590 0x7fe6ac0b8aa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6c81072f0 0x7fe6c819d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6c8106950 0x7fe6c819c880 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 --2- 172.21.15.84:0/1140464905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe6c81058d0 0x7fe6c819c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.208+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 >> 172.21.15.84:0/1140464905 conn(0x7fe6c8101230 msgr2=0x7fe6c8109c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.209+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 shutdown_connections 2024-09-21T02:42:39.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:39.209+0000 7fe6cee00640 1 -- 172.21.15.84:0/1140464905 wait complete. 2024-09-21T02:42:39.235 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T02:42:39.245 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T02:42:39.302 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:42:39.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T02:42:39.307 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T02:42:39.344 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T02:42:39.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:42:39.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:42:39.186+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:42:39.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:42:39.186+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:42:39.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:42:39.186+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:42:39.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:42:39.186+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:42:39.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:42:39.186+0000 7f951bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T02:42:39.716 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:40.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:39 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T02:42:40.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:39 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:42:40.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:39 smithi172 ceph-mon[35067]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:40.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:39 smithi172 ceph-mon[35067]: pgmap v407: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T02:42:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:42:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-mon[30747]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:39 smithi084 ceph-mon[30747]: pgmap v407: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:40.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:39 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T02:42:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:39 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:42:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:39 smithi090 ceph-mon[34571]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T02:42:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:39 smithi090 ceph-mon[34571]: pgmap v407: 129 pgs: 129 active+clean; 647 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:42:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 -- 172.21.15.84:0/2278540388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc64410de30 msgr2=0x7fc644110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 --2- 172.21.15.84:0/2278540388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc64410de30 0x7fc644110320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009ca0 tx=0x7fc63c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 -- 172.21.15.84:0/2278540388 shutdown_connections 2024-09-21T02:42:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 --2- 172.21.15.84:0/2278540388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc644105320 0x7fc64410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 --2- 172.21.15.84:0/2278540388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc64410de30 0x7fc644110320 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 --2- 172.21.15.84:0/2278540388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6441049d0 0x7fc644104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 -- 172.21.15.84:0/2278540388 >> 172.21.15.84:0/2278540388 conn(0x7fc644079740 msgr2=0x7fc644079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 -- 172.21.15.84:0/2278540388 shutdown_connections 2024-09-21T02:42:40.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.360+0000 7fc649600640 1 -- 172.21.15.84:0/2278540388 wait complete. 2024-09-21T02:42:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.361+0000 7fc649600640 1 Processor -- start 2024-09-21T02:42:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc649600640 1 -- start start 2024-09-21T02:42:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc649600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6441049d0 0x7fc64419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc649600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc644105320 0x7fc64419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc649600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64410de30 0x7fc6441a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:40.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc649600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc644113bf0 con 0x7fc6441049d0 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc649600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc644113a70 con 0x7fc64410de30 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc649600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc644113d70 con 0x7fc644105320 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc642a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6441049d0 0x7fc64419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc63a000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc644105320 0x7fc64419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc63a000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc644105320 0x7fc64419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:39960/0 (socket says 172.21.15.84:39960) 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc63a000640 1 -- 172.21.15.84:0/3693454477 learned_addr learned my addr 172.21.15.84:0/3693454477 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.362+0000 7fc643400640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64410de30 0x7fc6441a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc642a00640 1 -- 172.21.15.84:0/3693454477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc644105320 msgr2=0x7fc64419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc642a00640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc644105320 0x7fc64419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc642a00640 1 -- 172.21.15.84:0/3693454477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64410de30 msgr2=0x7fc6441a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc642a00640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64410de30 0x7fc6441a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc642a00640 1 -- 172.21.15.84:0/3693454477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6441a26b0 con 0x7fc6441049d0 2024-09-21T02:42:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc642a00640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6441049d0 0x7fc64419c740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc63400e9c0 tx=0x7fc63400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc63be00640 1 -- 172.21.15.84:0/3693454477 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400ccc0 con 0x7fc6441049d0 2024-09-21T02:42:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc63be00640 1 -- 172.21.15.84:0/3693454477 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6340035f0 con 0x7fc6441049d0 2024-09-21T02:42:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6441a29a0 con 0x7fc6441049d0 2024-09-21T02:42:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.363+0000 7fc63be00640 1 -- 172.21.15.84:0/3693454477 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400ce60 con 0x7fc6441049d0 2024-09-21T02:42:40.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.364+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6441a9100 con 0x7fc6441049d0 2024-09-21T02:42:40.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.365+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64406c240 con 0x7fc6441049d0 2024-09-21T02:42:40.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.370+0000 7fc63be00640 1 -- 172.21.15.84:0/3693454477 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc6340037a0 con 0x7fc6441049d0 2024-09-21T02:42:40.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.370+0000 7fc63be00640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6280b6510 0x7fc6280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:40.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.371+0000 7fc63be00640 1 -- 172.21.15.84:0/3693454477 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc6340e7bb0 con 0x7fc6441049d0 2024-09-21T02:42:40.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.371+0000 7fc63a000640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6280b6510 0x7fc6280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:40.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.371+0000 7fc63a000640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6280b6510 0x7fc6280b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc64410fa60 tx=0x7fc62c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:40.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.373+0000 7fc63be00640 1 -- 172.21.15.84:0/3693454477 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc6340ae0e0 con 0x7fc6441049d0 2024-09-21T02:42:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.560+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc64410d320 con 0x7fc6280b6510 2024-09-21T02:42:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.568+0000 7fc63be00640 1 -- 172.21.15.84:0/3693454477 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340471 (secure 0 0 0) 0x7fc64410d320 con 0x7fc6280b6510 2024-09-21T02:42:40.573 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:40.574 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6280b6510 msgr2=0x7fc6280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6280b6510 0x7fc6280b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc64410fa60 tx=0x7fc62c005f90 comp rx=0 tx=0).stop 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6441049d0 msgr2=0x7fc64419c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6441049d0 0x7fc64419c740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc63400e9c0 tx=0x7fc63400ee80 comp rx=0 tx=0).stop 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 shutdown_connections 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc6280b6510 0x7fc6280b8a20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc644105320 0x7fc64419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc64410de30 0x7fc6441a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 --2- 172.21.15.84:0/3693454477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6441049d0 0x7fc64419c740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:40.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 >> 172.21.15.84:0/3693454477 conn(0x7fc644079740 msgr2=0x7fc64410cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:40.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.572+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 shutdown_connections 2024-09-21T02:42:40.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:40.573+0000 7fc649600640 1 -- 172.21.15.84:0/3693454477 wait complete. 2024-09-21T02:42:41.424 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2024-09-21T02:42:39.629572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662663,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":788,"num_read_kb":497,"num_write":301,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392380,"kb_used_data":14012,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549444,"statfs":{"total":1151940427776,"available":1151538630656,"internally_reserved":0,"allocated":14348288,"data_stored":8092379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003703"},"pg_stats":[{"pgid":"2.1f","version":"84'9","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348659+0000","last_change":"2024-09-21T02:39:43.823658+0000","last_active":"2024-09-21T02:41:44.348659+0000","last_peered":"2024-09-21T02:41:44.348659+0000","last_clean":"2024-09-21T02:41:44.348659+0000","last_became_active":"2024-09-21T02:39:43.823211+0000","last_became_peered":"2024-09-21T02:39:43.823211+0000","last_unstale":"2024-09-21T02:41:44.348659+0000","last_undegraded":"2024-09-21T02:41:44.348659+0000","last_fullsized":"2024-09-21T02:41:44.348659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:00.505552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.806777+0000","last_change":"2024-09-21T02:39:46.850819+0000","last_active":"2024-09-21T02:42:11.806777+0000","last_peered":"2024-09-21T02:42:11.806777+0000","last_clean":"2024-09-21T02:42:11.806777+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:42:11.806777+0000","last_undegraded":"2024-09-21T02:42:11.806777+0000","last_fullsized":"2024-09-21T02:42:11.806777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:21.280788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.699306+0000","last_change":"2024-09-21T02:41:44.698816+0000","last_active":"2024-09-21T02:41:44.699306+0000","last_peered":"2024-09-21T02:41:44.699306+0000","last_clean":"2024-09-21T02:41:44.699306+0000","last_became_active":"2024-09-21T02:41:44.698135+0000","last_became_peered":"2024-09-21T02:41:44.698135+0000","last_unstale":"2024-09-21T02:41:44.699306+0000","last_undegraded":"2024-09-21T02:41:44.699306+0000","last_fullsized":"2024-09-21T02:41:44.699306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:09.002148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342951+0000","last_change":"2024-09-21T02:39:43.828030+0000","last_active":"2024-09-21T02:41:44.342951+0000","last_peered":"2024-09-21T02:41:44.342951+0000","last_clean":"2024-09-21T02:41:44.342951+0000","last_became_active":"2024-09-21T02:39:43.827692+0000","last_became_peered":"2024-09-21T02:39:43.827692+0000","last_unstale":"2024-09-21T02:41:44.342951+0000","last_undegraded":"2024-09-21T02:41:44.342951+0000","last_fullsized":"2024-09-21T02:41:44.342951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:32.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.828650+0000","last_change":"2024-09-21T02:39:46.854718+0000","last_active":"2024-09-21T02:42:11.828650+0000","last_peered":"2024-09-21T02:42:11.828650+0000","last_clean":"2024-09-21T02:42:11.828650+0000","last_became_active":"2024-09-21T02:39:46.854355+0000","last_became_peered":"2024-09-21T02:39:46.854355+0000","last_unstale":"2024-09-21T02:42:11.828650+0000","last_undegraded":"2024-09-21T02:42:11.828650+0000","last_fullsized":"2024-09-21T02:42:11.828650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:58.894397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486275+0000","last_change":"2024-09-21T02:39:56.930764+0000","last_active":"2024-09-21T02:41:44.486275+0000","last_peered":"2024-09-21T02:41:44.486275+0000","last_clean":"2024-09-21T02:41:44.486275+0000","last_became_active":"2024-09-21T02:39:56.930243+0000","last_became_peered":"2024-09-21T02:39:56.930243+0000","last_unstale":"2024-09-21T02:41:44.486275+0000","last_undegraded":"2024-09-21T02:41:44.486275+0000","last_fullsized":"2024-09-21T02:41:44.486275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:20.283102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697482+0000","last_change":"2024-09-21T02:39:43.824749+0000","last_active":"2024-09-21T02:41:44.697482+0000","last_peered":"2024-09-21T02:41:44.697482+0000","last_clean":"2024-09-21T02:41:44.697482+0000","last_became_active":"2024-09-21T02:39:43.824385+0000","last_became_peered":"2024-09-21T02:39:43.824385+0000","last_unstale":"2024-09-21T02:41:44.697482+0000","last_undegraded":"2024-09-21T02:41:44.697482+0000","last_fullsized":"2024-09-21T02:41:44.697482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833157+0000","last_change":"2024-09-21T02:39:46.856048+0000","last_active":"2024-09-21T02:42:11.833157+0000","last_peered":"2024-09-21T02:42:11.833157+0000","last_clean":"2024-09-21T02:42:11.833157+0000","last_became_active":"2024-09-21T02:39:46.855687+0000","last_became_peered":"2024-09-21T02:39:46.855687+0000","last_unstale":"2024-09-21T02:42:11.833157+0000","last_undegraded":"2024-09-21T02:42:11.833157+0000","last_fullsized":"2024-09-21T02:42:11.833157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:11.708028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487682+0000","last_change":"2024-09-21T02:39:56.931495+0000","last_active":"2024-09-21T02:41:44.487682+0000","last_peered":"2024-09-21T02:41:44.487682+0000","last_clean":"2024-09-21T02:41:44.487682+0000","last_became_active":"2024-09-21T02:39:56.930586+0000","last_became_peered":"2024-09-21T02:39:56.930586+0000","last_unstale":"2024-09-21T02:41:44.487682+0000","last_undegraded":"2024-09-21T02:41:44.487682+0000","last_fullsized":"2024-09-21T02:41:44.487682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:56.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343041+0000","last_change":"2024-09-21T02:40:43.408517+0000","last_active":"2024-09-21T02:41:44.343041+0000","last_peered":"2024-09-21T02:41:44.343041+0000","last_clean":"2024-09-21T02:41:44.343041+0000","last_became_active":"2024-09-21T02:40:43.402800+0000","last_became_peered":"2024-09-21T02:40:43.402800+0000","last_unstale":"2024-09-21T02:41:44.343041+0000","last_undegraded":"2024-09-21T02:41:44.343041+0000","last_fullsized":"2024-09-21T02:41:44.343041+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:46.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824825+0000","last_change":"2024-09-21T02:39:46.855990+0000","last_active":"2024-09-21T02:42:11.824825+0000","last_peered":"2024-09-21T02:42:11.824825+0000","last_clean":"2024-09-21T02:42:11.824825+0000","last_became_active":"2024-09-21T02:39:46.855602+0000","last_became_peered":"2024-09-21T02:39:46.855602+0000","last_unstale":"2024-09-21T02:42:11.824825+0000","last_undegraded":"2024-09-21T02:42:11.824825+0000","last_fullsized":"2024-09-21T02:42:11.824825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:43.207141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487155+0000","last_change":"2024-09-21T02:39:56.924868+0000","last_active":"2024-09-21T02:41:44.487155+0000","last_peered":"2024-09-21T02:41:44.487155+0000","last_clean":"2024-09-21T02:41:44.487155+0000","last_became_active":"2024-09-21T02:39:56.924353+0000","last_became_peered":"2024-09-21T02:39:56.924353+0000","last_unstale":"2024-09-21T02:41:44.487155+0000","last_undegraded":"2024-09-21T02:41:44.487155+0000","last_fullsized":"2024-09-21T02:41:44.487155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:48.095244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834867+0000","last_change":"2024-09-21T02:39:46.853077+0000","last_active":"2024-09-21T02:42:11.834867+0000","last_peered":"2024-09-21T02:42:11.834867+0000","last_clean":"2024-09-21T02:42:11.834867+0000","last_became_active":"2024-09-21T02:39:46.852691+0000","last_became_peered":"2024-09-21T02:39:46.852691+0000","last_unstale":"2024-09-21T02:42:11.834867+0000","last_undegraded":"2024-09-21T02:42:11.834867+0000","last_fullsized":"2024-09-21T02:42:11.834867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:12.427934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696864+0000","last_change":"2024-09-21T02:40:43.411229+0000","last_active":"2024-09-21T02:41:44.696864+0000","last_peered":"2024-09-21T02:41:44.696864+0000","last_clean":"2024-09-21T02:41:44.696864+0000","last_became_active":"2024-09-21T02:40:43.404833+0000","last_became_peered":"2024-09-21T02:40:43.404833+0000","last_unstale":"2024-09-21T02:41:44.696864+0000","last_undegraded":"2024-09-21T02:41:44.696864+0000","last_fullsized":"2024-09-21T02:41:44.696864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:22.812239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487302+0000","last_change":"2024-09-21T02:39:56.922205+0000","last_active":"2024-09-21T02:41:44.487302+0000","last_peered":"2024-09-21T02:41:44.487302+0000","last_clean":"2024-09-21T02:41:44.487302+0000","last_became_active":"2024-09-21T02:39:56.921702+0000","last_became_peered":"2024-09-21T02:39:56.921702+0000","last_unstale":"2024-09-21T02:41:44.487302+0000","last_undegraded":"2024-09-21T02:41:44.487302+0000","last_fullsized":"2024-09-21T02:41:44.487302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:07.622691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820298+0000","last_change":"2024-09-21T02:39:46.846380+0000","last_active":"2024-09-21T02:42:11.820298+0000","last_peered":"2024-09-21T02:42:11.820298+0000","last_clean":"2024-09-21T02:42:11.820298+0000","last_became_active":"2024-09-21T02:39:46.845972+0000","last_became_peered":"2024-09-21T02:39:46.845972+0000","last_unstale":"2024-09-21T02:42:11.820298+0000","last_undegraded":"2024-09-21T02:42:11.820298+0000","last_fullsized":"2024-09-21T02:42:11.820298+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:44.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344699+0000","last_change":"2024-09-21T02:39:43.824394+0000","last_active":"2024-09-21T02:41:44.344699+0000","last_peered":"2024-09-21T02:41:44.344699+0000","last_clean":"2024-09-21T02:41:44.344699+0000","last_became_active":"2024-09-21T02:39:43.823947+0000","last_became_peered":"2024-09-21T02:39:43.823947+0000","last_unstale":"2024-09-21T02:41:44.344699+0000","last_undegraded":"2024-09-21T02:41:44.344699+0000","last_fullsized":"2024-09-21T02:41:44.344699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.083281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487442+0000","last_change":"2024-09-21T02:40:43.413833+0000","last_active":"2024-09-21T02:41:44.487442+0000","last_peered":"2024-09-21T02:41:44.487442+0000","last_clean":"2024-09-21T02:41:44.487442+0000","last_became_active":"2024-09-21T02:40:43.413319+0000","last_became_peered":"2024-09-21T02:40:43.413319+0000","last_unstale":"2024-09-21T02:41:44.487442+0000","last_undegraded":"2024-09-21T02:41:44.487442+0000","last_fullsized":"2024-09-21T02:41:44.487442+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:40.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823558+0000","last_change":"2024-09-21T02:39:46.845544+0000","last_active":"2024-09-21T02:42:11.823558+0000","last_peered":"2024-09-21T02:42:11.823558+0000","last_clean":"2024-09-21T02:42:11.823558+0000","last_became_active":"2024-09-21T02:39:46.845162+0000","last_became_peered":"2024-09-21T02:39:46.845162+0000","last_unstale":"2024-09-21T02:42:11.823558+0000","last_undegraded":"2024-09-21T02:42:11.823558+0000","last_fullsized":"2024-09-21T02:42:11.823558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:46.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342517+0000","last_change":"2024-09-21T02:39:43.825182+0000","last_active":"2024-09-21T02:41:44.342517+0000","last_peered":"2024-09-21T02:41:44.342517+0000","last_clean":"2024-09-21T02:41:44.342517+0000","last_became_active":"2024-09-21T02:39:43.824774+0000","last_became_peered":"2024-09-21T02:39:43.824774+0000","last_unstale":"2024-09-21T02:41:44.342517+0000","last_undegraded":"2024-09-21T02:41:44.342517+0000","last_fullsized":"2024-09-21T02:41:44.342517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:41.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348526+0000","last_change":"2024-09-21T02:39:56.935765+0000","last_active":"2024-09-21T02:41:44.348526+0000","last_peered":"2024-09-21T02:41:44.348526+0000","last_clean":"2024-09-21T02:41:44.348526+0000","last_became_active":"2024-09-21T02:39:56.933218+0000","last_became_peered":"2024-09-21T02:39:56.933218+0000","last_unstale":"2024-09-21T02:41:44.348526+0000","last_undegraded":"2024-09-21T02:41:44.348526+0000","last_fullsized":"2024-09-21T02:41:44.348526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:28.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.782193+0000","last_change":"2024-09-21T02:39:46.853769+0000","last_active":"2024-09-21T02:42:11.782193+0000","last_peered":"2024-09-21T02:42:11.782193+0000","last_clean":"2024-09-21T02:42:11.782193+0000","last_became_active":"2024-09-21T02:39:46.853347+0000","last_became_peered":"2024-09-21T02:39:46.853347+0000","last_unstale":"2024-09-21T02:42:11.782193+0000","last_undegraded":"2024-09-21T02:42:11.782193+0000","last_fullsized":"2024-09-21T02:42:11.782193+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:01.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486557+0000","last_change":"2024-09-21T02:40:43.408316+0000","last_active":"2024-09-21T02:41:44.486557+0000","last_peered":"2024-09-21T02:41:44.486557+0000","last_clean":"2024-09-21T02:41:44.486557+0000","last_became_active":"2024-09-21T02:40:43.402877+0000","last_became_peered":"2024-09-21T02:40:43.402877+0000","last_unstale":"2024-09-21T02:41:44.486557+0000","last_undegraded":"2024-09-21T02:41:44.486557+0000","last_fullsized":"2024-09-21T02:41:44.486557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.712477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487516+0000","last_change":"2024-09-21T02:39:56.928251+0000","last_active":"2024-09-21T02:41:44.487516+0000","last_peered":"2024-09-21T02:41:44.487516+0000","last_clean":"2024-09-21T02:41:44.487516+0000","last_became_active":"2024-09-21T02:39:56.927772+0000","last_became_peered":"2024-09-21T02:39:56.927772+0000","last_unstale":"2024-09-21T02:41:44.487516+0000","last_undegraded":"2024-09-21T02:41:44.487516+0000","last_fullsized":"2024-09-21T02:41:44.487516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:40.762245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.825403+0000","last_change":"2024-09-21T02:40:43.418238+0000","last_active":"2024-09-21T02:42:11.825403+0000","last_peered":"2024-09-21T02:42:11.825403+0000","last_clean":"2024-09-21T02:42:11.825403+0000","last_became_active":"2024-09-21T02:40:43.417728+0000","last_became_peered":"2024-09-21T02:40:43.417728+0000","last_unstale":"2024-09-21T02:42:11.825403+0000","last_undegraded":"2024-09-21T02:42:11.825403+0000","last_fullsized":"2024-09-21T02:42:11.825403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:35.244275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487639+0000","last_change":"2024-09-21T02:39:43.840567+0000","last_active":"2024-09-21T02:41:44.487639+0000","last_peered":"2024-09-21T02:41:44.487639+0000","last_clean":"2024-09-21T02:41:44.487639+0000","last_became_active":"2024-09-21T02:39:43.840279+0000","last_became_peered":"2024-09-21T02:39:43.840279+0000","last_unstale":"2024-09-21T02:41:44.487639+0000","last_undegraded":"2024-09-21T02:41:44.487639+0000","last_fullsized":"2024-09-21T02:41:44.487639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:42.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345589+0000","last_change":"2024-09-21T02:39:56.920425+0000","last_active":"2024-09-21T02:41:44.345589+0000","last_peered":"2024-09-21T02:41:44.345589+0000","last_clean":"2024-09-21T02:41:44.345589+0000","last_became_active":"2024-09-21T02:39:56.919610+0000","last_became_peered":"2024-09-21T02:39:56.919610+0000","last_unstale":"2024-09-21T02:41:44.345589+0000","last_undegraded":"2024-09-21T02:41:44.345589+0000","last_fullsized":"2024-09-21T02:41:44.345589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818198+0000","last_change":"2024-09-21T02:39:46.845188+0000","last_active":"2024-09-21T02:42:11.818198+0000","last_peered":"2024-09-21T02:42:11.818198+0000","last_clean":"2024-09-21T02:42:11.818198+0000","last_became_active":"2024-09-21T02:39:46.844818+0000","last_became_peered":"2024-09-21T02:39:46.844818+0000","last_unstale":"2024-09-21T02:42:11.818198+0000","last_undegraded":"2024-09-21T02:42:11.818198+0000","last_fullsized":"2024-09-21T02:42:11.818198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.853370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'12","reported_seq":58,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:55.649306+0000","last_change":"2024-09-21T02:39:43.822226+0000","last_active":"2024-09-21T02:41:55.649306+0000","last_peered":"2024-09-21T02:41:55.649306+0000","last_clean":"2024-09-21T02:41:55.649306+0000","last_became_active":"2024-09-21T02:39:43.821798+0000","last_became_peered":"2024-09-21T02:39:43.821798+0000","last_unstale":"2024-09-21T02:41:55.649306+0000","last_undegraded":"2024-09-21T02:41:55.649306+0000","last_fullsized":"2024-09-21T02:41:55.649306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:38.822330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342201+0000","last_change":"2024-09-21T02:39:56.919521+0000","last_active":"2024-09-21T02:41:44.342201+0000","last_peered":"2024-09-21T02:41:44.342201+0000","last_clean":"2024-09-21T02:41:44.342201+0000","last_became_active":"2024-09-21T02:39:56.918042+0000","last_became_peered":"2024-09-21T02:39:56.918042+0000","last_unstale":"2024-09-21T02:41:44.342201+0000","last_undegraded":"2024-09-21T02:41:44.342201+0000","last_fullsized":"2024-09-21T02:41:44.342201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:21.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823167+0000","last_change":"2024-09-21T02:39:46.861856+0000","last_active":"2024-09-21T02:42:11.823167+0000","last_peered":"2024-09-21T02:42:11.823167+0000","last_clean":"2024-09-21T02:42:11.823167+0000","last_became_active":"2024-09-21T02:39:46.861416+0000","last_became_peered":"2024-09-21T02:39:46.861416+0000","last_unstale":"2024-09-21T02:42:11.823167+0000","last_undegraded":"2024-09-21T02:42:11.823167+0000","last_fullsized":"2024-09-21T02:42:11.823167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:46.547988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697505+0000","last_change":"2024-09-21T02:39:43.826232+0000","last_active":"2024-09-21T02:41:44.697505+0000","last_peered":"2024-09-21T02:41:44.697505+0000","last_clean":"2024-09-21T02:41:44.697505+0000","last_became_active":"2024-09-21T02:39:43.825789+0000","last_became_peered":"2024-09-21T02:39:43.825789+0000","last_unstale":"2024-09-21T02:41:44.697505+0000","last_undegraded":"2024-09-21T02:41:44.697505+0000","last_fullsized":"2024-09-21T02:41:44.697505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:19.465106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342950+0000","last_change":"2024-09-21T02:39:56.917802+0000","last_active":"2024-09-21T02:41:44.342950+0000","last_peered":"2024-09-21T02:41:44.342950+0000","last_clean":"2024-09-21T02:41:44.342950+0000","last_became_active":"2024-09-21T02:39:56.917286+0000","last_became_peered":"2024-09-21T02:39:56.917286+0000","last_unstale":"2024-09-21T02:41:44.342950+0000","last_undegraded":"2024-09-21T02:41:44.342950+0000","last_fullsized":"2024-09-21T02:41:44.342950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:19.055218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.814958+0000","last_change":"2024-09-21T02:39:46.858829+0000","last_active":"2024-09-21T02:42:11.814958+0000","last_peered":"2024-09-21T02:42:11.814958+0000","last_clean":"2024-09-21T02:42:11.814958+0000","last_became_active":"2024-09-21T02:39:46.858392+0000","last_became_peered":"2024-09-21T02:39:46.858392+0000","last_unstale":"2024-09-21T02:42:11.814958+0000","last_undegraded":"2024-09-21T02:42:11.814958+0000","last_fullsized":"2024-09-21T02:42:11.814958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:29.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348631+0000","last_change":"2024-09-21T02:39:43.825129+0000","last_active":"2024-09-21T02:41:44.348631+0000","last_peered":"2024-09-21T02:41:44.348631+0000","last_clean":"2024-09-21T02:41:44.348631+0000","last_became_active":"2024-09-21T02:39:43.824756+0000","last_became_peered":"2024-09-21T02:39:43.824756+0000","last_unstale":"2024-09-21T02:41:44.348631+0000","last_undegraded":"2024-09-21T02:41:44.348631+0000","last_fullsized":"2024-09-21T02:41:44.348631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:28.771033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696680+0000","last_change":"2024-09-21T02:39:56.929186+0000","last_active":"2024-09-21T02:41:44.696680+0000","last_peered":"2024-09-21T02:41:44.696680+0000","last_clean":"2024-09-21T02:41:44.696680+0000","last_became_active":"2024-09-21T02:39:56.928608+0000","last_became_peered":"2024-09-21T02:39:56.928608+0000","last_unstale":"2024-09-21T02:41:44.696680+0000","last_undegraded":"2024-09-21T02:41:44.696680+0000","last_fullsized":"2024-09-21T02:41:44.696680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:47.860230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819801+0000","last_change":"2024-09-21T02:39:46.860375+0000","last_active":"2024-09-21T02:42:11.819801+0000","last_peered":"2024-09-21T02:42:11.819801+0000","last_clean":"2024-09-21T02:42:11.819801+0000","last_became_active":"2024-09-21T02:39:46.860035+0000","last_became_peered":"2024-09-21T02:39:46.860035+0000","last_unstale":"2024-09-21T02:42:11.819801+0000","last_undegraded":"2024-09-21T02:42:11.819801+0000","last_fullsized":"2024-09-21T02:42:11.819801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:07.761203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346270+0000","last_change":"2024-09-21T02:39:43.827869+0000","last_active":"2024-09-21T02:41:44.346270+0000","last_peered":"2024-09-21T02:41:44.346270+0000","last_clean":"2024-09-21T02:41:44.346270+0000","last_became_active":"2024-09-21T02:39:43.827375+0000","last_became_peered":"2024-09-21T02:39:43.827375+0000","last_unstale":"2024-09-21T02:41:44.346270+0000","last_undegraded":"2024-09-21T02:41:44.346270+0000","last_fullsized":"2024-09-21T02:41:44.346270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:48.257387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346779+0000","last_change":"2024-09-21T02:39:56.917766+0000","last_active":"2024-09-21T02:41:44.346779+0000","last_peered":"2024-09-21T02:41:44.346779+0000","last_clean":"2024-09-21T02:41:44.346779+0000","last_became_active":"2024-09-21T02:39:56.917309+0000","last_became_peered":"2024-09-21T02:39:56.917309+0000","last_unstale":"2024-09-21T02:41:44.346779+0000","last_undegraded":"2024-09-21T02:41:44.346779+0000","last_fullsized":"2024-09-21T02:41:44.346779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:36.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.816648+0000","last_change":"2024-09-21T02:39:46.851416+0000","last_active":"2024-09-21T02:42:11.816648+0000","last_peered":"2024-09-21T02:42:11.816648+0000","last_clean":"2024-09-21T02:42:11.816648+0000","last_became_active":"2024-09-21T02:39:46.851055+0000","last_became_peered":"2024-09-21T02:39:46.851055+0000","last_unstale":"2024-09-21T02:42:11.816648+0000","last_undegraded":"2024-09-21T02:42:11.816648+0000","last_fullsized":"2024-09-21T02:42:11.816648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:50.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'5","reported_seq":165,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:34.591026+0000","last_change":"2024-09-21T02:39:43.825162+0000","last_active":"2024-09-21T02:42:34.591026+0000","last_peered":"2024-09-21T02:42:34.591026+0000","last_clean":"2024-09-21T02:42:34.591026+0000","last_became_active":"2024-09-21T02:39:43.824811+0000","last_became_peered":"2024-09-21T02:39:43.824811+0000","last_unstale":"2024-09-21T02:42:34.591026+0000","last_undegraded":"2024-09-21T02:42:34.591026+0000","last_fullsized":"2024-09-21T02:42:34.591026+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:10.020902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346813+0000","last_change":"2024-09-21T02:39:56.920750+0000","last_active":"2024-09-21T02:41:44.346813+0000","last_peered":"2024-09-21T02:41:44.346813+0000","last_clean":"2024-09-21T02:41:44.346813+0000","last_became_active":"2024-09-21T02:39:56.920245+0000","last_became_peered":"2024-09-21T02:39:56.920245+0000","last_unstale":"2024-09-21T02:41:44.346813+0000","last_undegraded":"2024-09-21T02:41:44.346813+0000","last_fullsized":"2024-09-21T02:41:44.346813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:53.718596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.816452+0000","last_change":"2024-09-21T02:39:46.854202+0000","last_active":"2024-09-21T02:42:11.816452+0000","last_peered":"2024-09-21T02:42:11.816452+0000","last_clean":"2024-09-21T02:42:11.816452+0000","last_became_active":"2024-09-21T02:39:46.853076+0000","last_became_peered":"2024-09-21T02:39:46.853076+0000","last_unstale":"2024-09-21T02:42:11.816452+0000","last_undegraded":"2024-09-21T02:42:11.816452+0000","last_fullsized":"2024-09-21T02:42:11.816452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:59.729777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345691+0000","last_change":"2024-09-21T02:39:43.826351+0000","last_active":"2024-09-21T02:41:44.345691+0000","last_peered":"2024-09-21T02:41:44.345691+0000","last_clean":"2024-09-21T02:41:44.345691+0000","last_became_active":"2024-09-21T02:39:43.825683+0000","last_became_peered":"2024-09-21T02:39:43.825683+0000","last_unstale":"2024-09-21T02:41:44.345691+0000","last_undegraded":"2024-09-21T02:41:44.345691+0000","last_fullsized":"2024-09-21T02:41:44.345691+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:16.934280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348917+0000","last_change":"2024-09-21T02:39:56.937591+0000","last_active":"2024-09-21T02:41:44.348917+0000","last_peered":"2024-09-21T02:41:44.348917+0000","last_clean":"2024-09-21T02:41:44.348917+0000","last_became_active":"2024-09-21T02:39:56.937178+0000","last_became_peered":"2024-09-21T02:39:56.937178+0000","last_unstale":"2024-09-21T02:41:44.348917+0000","last_undegraded":"2024-09-21T02:41:44.348917+0000","last_fullsized":"2024-09-21T02:41:44.348917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:21.218393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830551+0000","last_change":"2024-09-21T02:39:46.858255+0000","last_active":"2024-09-21T02:42:11.830551+0000","last_peered":"2024-09-21T02:42:11.830551+0000","last_clean":"2024-09-21T02:42:11.830551+0000","last_became_active":"2024-09-21T02:39:46.856726+0000","last_became_peered":"2024-09-21T02:39:46.856726+0000","last_unstale":"2024-09-21T02:42:11.830551+0000","last_undegraded":"2024-09-21T02:42:11.830551+0000","last_fullsized":"2024-09-21T02:42:11.830551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:33.890538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487791+0000","last_change":"2024-09-21T02:39:43.823562+0000","last_active":"2024-09-21T02:41:44.487791+0000","last_peered":"2024-09-21T02:41:44.487791+0000","last_clean":"2024-09-21T02:41:44.487791+0000","last_became_active":"2024-09-21T02:39:43.823142+0000","last_became_peered":"2024-09-21T02:39:43.823142+0000","last_unstale":"2024-09-21T02:41:44.487791+0000","last_undegraded":"2024-09-21T02:41:44.487791+0000","last_fullsized":"2024-09-21T02:41:44.487791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:36.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345775+0000","last_change":"2024-09-21T02:38:27.972237+0000","last_active":"2024-09-21T02:41:44.345775+0000","last_peered":"2024-09-21T02:41:44.345775+0000","last_clean":"2024-09-21T02:41:44.345775+0000","last_became_active":"2024-09-21T02:38:27.966297+0000","last_became_peered":"2024-09-21T02:38:27.966297+0000","last_unstale":"2024-09-21T02:41:44.345775+0000","last_undegraded":"2024-09-21T02:41:44.345775+0000","last_fullsized":"2024-09-21T02:41:44.345775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_clean_scrub_stamp":"2024-09-21T02:34:42.292034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:24.592682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.702822+0000","last_change":"2024-09-21T02:41:44.702415+0000","last_active":"2024-09-21T02:41:44.702822+0000","last_peered":"2024-09-21T02:41:44.702822+0000","last_clean":"2024-09-21T02:41:44.702822+0000","last_became_active":"2024-09-21T02:41:44.698199+0000","last_became_peered":"2024-09-21T02:41:44.698199+0000","last_unstale":"2024-09-21T02:41:44.702822+0000","last_undegraded":"2024-09-21T02:41:44.702822+0000","last_fullsized":"2024-09-21T02:41:44.702822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:03.191052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.835131+0000","last_change":"2024-09-21T02:39:46.851466+0000","last_active":"2024-09-21T02:42:11.835131+0000","last_peered":"2024-09-21T02:42:11.835131+0000","last_clean":"2024-09-21T02:42:11.835131+0000","last_became_active":"2024-09-21T02:39:46.849945+0000","last_became_peered":"2024-09-21T02:39:46.849945+0000","last_unstale":"2024-09-21T02:42:11.835131+0000","last_undegraded":"2024-09-21T02:42:11.835131+0000","last_fullsized":"2024-09-21T02:42:11.835131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:07.424794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345165+0000","last_change":"2024-09-21T02:39:43.840894+0000","last_active":"2024-09-21T02:41:44.345165+0000","last_peered":"2024-09-21T02:41:44.345165+0000","last_clean":"2024-09-21T02:41:44.345165+0000","last_became_active":"2024-09-21T02:39:43.840437+0000","last_became_peered":"2024-09-21T02:39:43.840437+0000","last_unstale":"2024-09-21T02:41:44.345165+0000","last_undegraded":"2024-09-21T02:41:44.345165+0000","last_fullsized":"2024-09-21T02:41:44.345165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:31.741218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486908+0000","last_change":"2024-09-21T02:39:56.924563+0000","last_active":"2024-09-21T02:41:44.486908+0000","last_peered":"2024-09-21T02:41:44.486908+0000","last_clean":"2024-09-21T02:41:44.486908+0000","last_became_active":"2024-09-21T02:39:56.923791+0000","last_became_peered":"2024-09-21T02:39:56.923791+0000","last_unstale":"2024-09-21T02:41:44.486908+0000","last_undegraded":"2024-09-21T02:41:44.486908+0000","last_fullsized":"2024-09-21T02:41:44.486908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:03.409737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822963+0000","last_change":"2024-09-21T02:39:46.858712+0000","last_active":"2024-09-21T02:42:11.822963+0000","last_peered":"2024-09-21T02:42:11.822963+0000","last_clean":"2024-09-21T02:42:11.822963+0000","last_became_active":"2024-09-21T02:39:46.858339+0000","last_became_peered":"2024-09-21T02:39:46.858339+0000","last_unstale":"2024-09-21T02:42:11.822963+0000","last_undegraded":"2024-09-21T02:42:11.822963+0000","last_fullsized":"2024-09-21T02:42:11.822963+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.015904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.349194+0000","last_change":"2024-09-21T02:39:43.829127+0000","last_active":"2024-09-21T02:41:44.349194+0000","last_peered":"2024-09-21T02:41:44.349194+0000","last_clean":"2024-09-21T02:41:44.349194+0000","last_became_active":"2024-09-21T02:39:43.828136+0000","last_became_peered":"2024-09-21T02:39:43.828136+0000","last_unstale":"2024-09-21T02:41:44.349194+0000","last_undegraded":"2024-09-21T02:41:44.349194+0000","last_fullsized":"2024-09-21T02:41:44.349194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:39.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486621+0000","last_change":"2024-09-21T02:39:56.930823+0000","last_active":"2024-09-21T02:41:44.486621+0000","last_peered":"2024-09-21T02:41:44.486621+0000","last_clean":"2024-09-21T02:41:44.486621+0000","last_became_active":"2024-09-21T02:39:56.930379+0000","last_became_peered":"2024-09-21T02:39:56.930379+0000","last_unstale":"2024-09-21T02:41:44.486621+0000","last_undegraded":"2024-09-21T02:41:44.486621+0000","last_fullsized":"2024-09-21T02:41:44.486621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:01.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.832118+0000","last_change":"2024-09-21T02:39:46.846873+0000","last_active":"2024-09-21T02:42:11.832118+0000","last_peered":"2024-09-21T02:42:11.832118+0000","last_clean":"2024-09-21T02:42:11.832118+0000","last_became_active":"2024-09-21T02:39:46.846502+0000","last_became_peered":"2024-09-21T02:39:46.846502+0000","last_unstale":"2024-09-21T02:42:11.832118+0000","last_undegraded":"2024-09-21T02:42:11.832118+0000","last_fullsized":"2024-09-21T02:42:11.832118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:20.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346975+0000","last_change":"2024-09-21T02:39:43.832273+0000","last_active":"2024-09-21T02:41:44.346975+0000","last_peered":"2024-09-21T02:41:44.346975+0000","last_clean":"2024-09-21T02:41:44.346975+0000","last_became_active":"2024-09-21T02:39:43.831705+0000","last_became_peered":"2024-09-21T02:39:43.831705+0000","last_unstale":"2024-09-21T02:41:44.346975+0000","last_undegraded":"2024-09-21T02:41:44.346975+0000","last_fullsized":"2024-09-21T02:41:44.346975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:31.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348025+0000","last_change":"2024-09-21T02:39:56.920277+0000","last_active":"2024-09-21T02:41:44.348025+0000","last_peered":"2024-09-21T02:41:44.348025+0000","last_clean":"2024-09-21T02:41:44.348025+0000","last_became_active":"2024-09-21T02:39:56.919885+0000","last_became_peered":"2024-09-21T02:39:56.919885+0000","last_unstale":"2024-09-21T02:41:44.348025+0000","last_undegraded":"2024-09-21T02:41:44.348025+0000","last_fullsized":"2024-09-21T02:41:44.348025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:32.750878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819927+0000","last_change":"2024-09-21T02:40:43.413459+0000","last_active":"2024-09-21T02:42:11.819927+0000","last_peered":"2024-09-21T02:42:11.819927+0000","last_clean":"2024-09-21T02:42:11.819927+0000","last_became_active":"2024-09-21T02:40:43.413012+0000","last_became_peered":"2024-09-21T02:40:43.413012+0000","last_unstale":"2024-09-21T02:42:11.819927+0000","last_undegraded":"2024-09-21T02:42:11.819927+0000","last_fullsized":"2024-09-21T02:42:11.819927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:23.971450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697477+0000","last_change":"2024-09-21T02:39:43.821955+0000","last_active":"2024-09-21T02:41:44.697477+0000","last_peered":"2024-09-21T02:41:44.697477+0000","last_clean":"2024-09-21T02:41:44.697477+0000","last_became_active":"2024-09-21T02:39:43.820480+0000","last_became_peered":"2024-09-21T02:39:43.820480+0000","last_unstale":"2024-09-21T02:41:44.697477+0000","last_undegraded":"2024-09-21T02:41:44.697477+0000","last_fullsized":"2024-09-21T02:41:44.697477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:51.201528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348049+0000","last_change":"2024-09-21T02:39:56.922017+0000","last_active":"2024-09-21T02:41:44.348049+0000","last_peered":"2024-09-21T02:41:44.348049+0000","last_clean":"2024-09-21T02:41:44.348049+0000","last_became_active":"2024-09-21T02:39:56.921616+0000","last_became_peered":"2024-09-21T02:39:56.921616+0000","last_unstale":"2024-09-21T02:41:44.348049+0000","last_undegraded":"2024-09-21T02:41:44.348049+0000","last_fullsized":"2024-09-21T02:41:44.348049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:38.499302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818794+0000","last_change":"2024-09-21T02:39:46.855445+0000","last_active":"2024-09-21T02:42:11.818794+0000","last_peered":"2024-09-21T02:42:11.818794+0000","last_clean":"2024-09-21T02:42:11.818794+0000","last_became_active":"2024-09-21T02:39:46.855053+0000","last_became_peered":"2024-09-21T02:39:46.855053+0000","last_unstale":"2024-09-21T02:42:11.818794+0000","last_undegraded":"2024-09-21T02:42:11.818794+0000","last_fullsized":"2024-09-21T02:42:11.818794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:19.122862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696637+0000","last_change":"2024-09-21T02:39:43.822744+0000","last_active":"2024-09-21T02:41:44.696637+0000","last_peered":"2024-09-21T02:41:44.696637+0000","last_clean":"2024-09-21T02:41:44.696637+0000","last_became_active":"2024-09-21T02:39:43.822339+0000","last_became_peered":"2024-09-21T02:39:43.822339+0000","last_unstale":"2024-09-21T02:41:44.696637+0000","last_undegraded":"2024-09-21T02:41:44.696637+0000","last_fullsized":"2024-09-21T02:41:44.696637+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:21.370224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346987+0000","last_change":"2024-09-21T02:39:56.929280+0000","last_active":"2024-09-21T02:41:44.346987+0000","last_peered":"2024-09-21T02:41:44.346987+0000","last_clean":"2024-09-21T02:41:44.346987+0000","last_became_active":"2024-09-21T02:39:56.928826+0000","last_became_peered":"2024-09-21T02:39:56.928826+0000","last_unstale":"2024-09-21T02:41:44.346987+0000","last_undegraded":"2024-09-21T02:41:44.346987+0000","last_fullsized":"2024-09-21T02:41:44.346987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:01.597772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.829790+0000","last_change":"2024-09-21T02:39:46.852466+0000","last_active":"2024-09-21T02:42:11.829790+0000","last_peered":"2024-09-21T02:42:11.829790+0000","last_clean":"2024-09-21T02:42:11.829790+0000","last_became_active":"2024-09-21T02:39:46.852113+0000","last_became_peered":"2024-09-21T02:39:46.852113+0000","last_unstale":"2024-09-21T02:42:11.829790+0000","last_undegraded":"2024-09-21T02:42:11.829790+0000","last_fullsized":"2024-09-21T02:42:11.829790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:26.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'5","reported_seq":167,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:33.589888+0000","last_change":"2024-09-21T02:39:43.822241+0000","last_active":"2024-09-21T02:42:33.589888+0000","last_peered":"2024-09-21T02:42:33.589888+0000","last_clean":"2024-09-21T02:42:33.589888+0000","last_became_active":"2024-09-21T02:39:43.820813+0000","last_became_peered":"2024-09-21T02:39:43.820813+0000","last_unstale":"2024-09-21T02:42:33.589888+0000","last_undegraded":"2024-09-21T02:42:33.589888+0000","last_fullsized":"2024-09-21T02:42:33.589888+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:09.749207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697239+0000","last_change":"2024-09-21T02:40:43.405942+0000","last_active":"2024-09-21T02:41:44.697239+0000","last_peered":"2024-09-21T02:41:44.697239+0000","last_clean":"2024-09-21T02:41:44.697239+0000","last_became_active":"2024-09-21T02:40:43.405455+0000","last_became_peered":"2024-09-21T02:40:43.405455+0000","last_unstale":"2024-09-21T02:41:44.697239+0000","last_undegraded":"2024-09-21T02:41:44.697239+0000","last_fullsized":"2024-09-21T02:41:44.697239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:28.594724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833646+0000","last_change":"2024-09-21T02:40:43.417498+0000","last_active":"2024-09-21T02:42:11.833646+0000","last_peered":"2024-09-21T02:42:11.833646+0000","last_clean":"2024-09-21T02:42:11.833646+0000","last_became_active":"2024-09-21T02:40:43.417203+0000","last_became_peered":"2024-09-21T02:40:43.417203+0000","last_unstale":"2024-09-21T02:42:11.833646+0000","last_undegraded":"2024-09-21T02:42:11.833646+0000","last_fullsized":"2024-09-21T02:42:11.833646+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:43.618931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348740+0000","last_change":"2024-09-21T02:39:43.827493+0000","last_active":"2024-09-21T02:41:44.348740+0000","last_peered":"2024-09-21T02:41:44.348740+0000","last_clean":"2024-09-21T02:41:44.348740+0000","last_became_active":"2024-09-21T02:39:43.826824+0000","last_became_peered":"2024-09-21T02:39:43.826824+0000","last_unstale":"2024-09-21T02:41:44.348740+0000","last_undegraded":"2024-09-21T02:41:44.348740+0000","last_fullsized":"2024-09-21T02:41:44.348740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:21.320101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343157+0000","last_change":"2024-09-21T02:39:56.929122+0000","last_active":"2024-09-21T02:41:44.343157+0000","last_peered":"2024-09-21T02:41:44.343157+0000","last_clean":"2024-09-21T02:41:44.343157+0000","last_became_active":"2024-09-21T02:39:56.928633+0000","last_became_peered":"2024-09-21T02:39:56.928633+0000","last_unstale":"2024-09-21T02:41:44.343157+0000","last_undegraded":"2024-09-21T02:41:44.343157+0000","last_fullsized":"2024-09-21T02:41:44.343157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:56.599982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.815820+0000","last_change":"2024-09-21T02:39:46.866922+0000","last_active":"2024-09-21T02:42:11.815820+0000","last_peered":"2024-09-21T02:42:11.815820+0000","last_clean":"2024-09-21T02:42:11.815820+0000","last_became_active":"2024-09-21T02:39:46.866061+0000","last_became_peered":"2024-09-21T02:39:46.866061+0000","last_unstale":"2024-09-21T02:42:11.815820+0000","last_undegraded":"2024-09-21T02:42:11.815820+0000","last_fullsized":"2024-09-21T02:42:11.815820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:02.707212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344889+0000","last_change":"2024-09-21T02:39:43.824188+0000","last_active":"2024-09-21T02:41:44.344889+0000","last_peered":"2024-09-21T02:41:44.344889+0000","last_clean":"2024-09-21T02:41:44.344889+0000","last_became_active":"2024-09-21T02:39:43.823760+0000","last_became_peered":"2024-09-21T02:39:43.823760+0000","last_unstale":"2024-09-21T02:41:44.344889+0000","last_undegraded":"2024-09-21T02:41:44.344889+0000","last_fullsized":"2024-09-21T02:41:44.344889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:56.770947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348930+0000","last_change":"2024-09-21T02:39:56.920213+0000","last_active":"2024-09-21T02:41:44.348930+0000","last_peered":"2024-09-21T02:41:44.348930+0000","last_clean":"2024-09-21T02:41:44.348930+0000","last_became_active":"2024-09-21T02:39:56.919796+0000","last_became_peered":"2024-09-21T02:39:56.919796+0000","last_unstale":"2024-09-21T02:41:44.348930+0000","last_undegraded":"2024-09-21T02:41:44.348930+0000","last_fullsized":"2024-09-21T02:41:44.348930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:32.162844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820668+0000","last_change":"2024-09-21T02:39:46.846759+0000","last_active":"2024-09-21T02:42:11.820668+0000","last_peered":"2024-09-21T02:42:11.820668+0000","last_clean":"2024-09-21T02:42:11.820668+0000","last_became_active":"2024-09-21T02:39:46.846315+0000","last_became_peered":"2024-09-21T02:39:46.846315+0000","last_unstale":"2024-09-21T02:42:11.820668+0000","last_undegraded":"2024-09-21T02:42:11.820668+0000","last_fullsized":"2024-09-21T02:42:11.820668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:41.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'35","reported_seq":316,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:35.593172+0000","last_change":"2024-09-21T02:39:43.824564+0000","last_active":"2024-09-21T02:42:35.593172+0000","last_peered":"2024-09-21T02:42:35.593172+0000","last_clean":"2024-09-21T02:42:35.593172+0000","last_became_active":"2024-09-21T02:39:43.824190+0000","last_became_peered":"2024-09-21T02:39:43.824190+0000","last_unstale":"2024-09-21T02:42:35.593172+0000","last_undegraded":"2024-09-21T02:42:35.593172+0000","last_fullsized":"2024-09-21T02:42:35.593172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:45.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67387,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":183,"num_write":36,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348367+0000","last_change":"2024-09-21T02:39:56.928936+0000","last_active":"2024-09-21T02:41:44.348367+0000","last_peered":"2024-09-21T02:41:44.348367+0000","last_clean":"2024-09-21T02:41:44.348367+0000","last_became_active":"2024-09-21T02:39:56.927999+0000","last_became_peered":"2024-09-21T02:39:56.927999+0000","last_unstale":"2024-09-21T02:41:44.348367+0000","last_undegraded":"2024-09-21T02:41:44.348367+0000","last_fullsized":"2024-09-21T02:41:44.348367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:33.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833671+0000","last_change":"2024-09-21T02:39:46.860572+0000","last_active":"2024-09-21T02:42:11.833671+0000","last_peered":"2024-09-21T02:42:11.833671+0000","last_clean":"2024-09-21T02:42:11.833671+0000","last_became_active":"2024-09-21T02:39:46.860073+0000","last_became_peered":"2024-09-21T02:39:46.860073+0000","last_unstale":"2024-09-21T02:42:11.833671+0000","last_undegraded":"2024-09-21T02:42:11.833671+0000","last_fullsized":"2024-09-21T02:42:11.833671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:48.355107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.349149+0000","last_change":"2024-09-21T02:39:43.828437+0000","last_active":"2024-09-21T02:41:44.349149+0000","last_peered":"2024-09-21T02:41:44.349149+0000","last_clean":"2024-09-21T02:41:44.349149+0000","last_became_active":"2024-09-21T02:39:43.828033+0000","last_became_peered":"2024-09-21T02:39:43.828033+0000","last_unstale":"2024-09-21T02:41:44.349149+0000","last_undegraded":"2024-09-21T02:41:44.349149+0000","last_fullsized":"2024-09-21T02:41:44.349149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:24.065773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487351+0000","last_change":"2024-09-21T02:39:56.937714+0000","last_active":"2024-09-21T02:41:44.487351+0000","last_peered":"2024-09-21T02:41:44.487351+0000","last_clean":"2024-09-21T02:41:44.487351+0000","last_became_active":"2024-09-21T02:39:56.937145+0000","last_became_peered":"2024-09-21T02:39:56.937145+0000","last_unstale":"2024-09-21T02:41:44.487351+0000","last_undegraded":"2024-09-21T02:41:44.487351+0000","last_fullsized":"2024-09-21T02:41:44.487351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:59.265795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.826005+0000","last_change":"2024-09-21T02:39:46.864600+0000","last_active":"2024-09-21T02:42:11.826005+0000","last_peered":"2024-09-21T02:42:11.826005+0000","last_clean":"2024-09-21T02:42:11.826005+0000","last_became_active":"2024-09-21T02:39:46.862043+0000","last_became_peered":"2024-09-21T02:39:46.862043+0000","last_unstale":"2024-09-21T02:42:11.826005+0000","last_undegraded":"2024-09-21T02:42:11.826005+0000","last_fullsized":"2024-09-21T02:42:11.826005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.119974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346236+0000","last_change":"2024-09-21T02:39:43.825910+0000","last_active":"2024-09-21T02:41:44.346236+0000","last_peered":"2024-09-21T02:41:44.346236+0000","last_clean":"2024-09-21T02:41:44.346236+0000","last_became_active":"2024-09-21T02:39:43.825370+0000","last_became_peered":"2024-09-21T02:39:43.825370+0000","last_unstale":"2024-09-21T02:41:44.346236+0000","last_undegraded":"2024-09-21T02:41:44.346236+0000","last_fullsized":"2024-09-21T02:41:44.346236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:05.410114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348035+0000","last_change":"2024-09-21T02:39:56.935321+0000","last_active":"2024-09-21T02:41:44.348035+0000","last_peered":"2024-09-21T02:41:44.348035+0000","last_clean":"2024-09-21T02:41:44.348035+0000","last_became_active":"2024-09-21T02:39:56.931669+0000","last_became_peered":"2024-09-21T02:39:56.931669+0000","last_unstale":"2024-09-21T02:41:44.348035+0000","last_undegraded":"2024-09-21T02:41:44.348035+0000","last_fullsized":"2024-09-21T02:41:44.348035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:20.323574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.832138+0000","last_change":"2024-09-21T02:39:46.853469+0000","last_active":"2024-09-21T02:42:11.832138+0000","last_peered":"2024-09-21T02:42:11.832138+0000","last_clean":"2024-09-21T02:42:11.832138+0000","last_became_active":"2024-09-21T02:39:46.853133+0000","last_became_peered":"2024-09-21T02:39:46.853133+0000","last_unstale":"2024-09-21T02:42:11.832138+0000","last_undegraded":"2024-09-21T02:42:11.832138+0000","last_fullsized":"2024-09-21T02:42:11.832138+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.055341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'4","reported_seq":164,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:34.591368+0000","last_change":"2024-09-21T02:39:43.828678+0000","last_active":"2024-09-21T02:42:34.591368+0000","last_peered":"2024-09-21T02:42:34.591368+0000","last_clean":"2024-09-21T02:42:34.591368+0000","last_became_active":"2024-09-21T02:39:43.828281+0000","last_became_peered":"2024-09-21T02:39:43.828281+0000","last_unstale":"2024-09-21T02:42:34.591368+0000","last_undegraded":"2024-09-21T02:42:34.591368+0000","last_fullsized":"2024-09-21T02:42:34.591368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:42.678028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342305+0000","last_change":"2024-09-21T02:39:56.920489+0000","last_active":"2024-09-21T02:41:44.342305+0000","last_peered":"2024-09-21T02:41:44.342305+0000","last_clean":"2024-09-21T02:41:44.342305+0000","last_became_active":"2024-09-21T02:39:56.920031+0000","last_became_peered":"2024-09-21T02:39:56.920031+0000","last_unstale":"2024-09-21T02:41:44.342305+0000","last_undegraded":"2024-09-21T02:41:44.342305+0000","last_fullsized":"2024-09-21T02:41:44.342305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:56.576113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486936+0000","last_change":"2024-09-21T02:39:56.922470+0000","last_active":"2024-09-21T02:41:44.486936+0000","last_peered":"2024-09-21T02:41:44.486936+0000","last_clean":"2024-09-21T02:41:44.486936+0000","last_became_active":"2024-09-21T02:39:56.922014+0000","last_became_peered":"2024-09-21T02:39:56.922014+0000","last_unstale":"2024-09-21T02:41:44.486936+0000","last_undegraded":"2024-09-21T02:41:44.486936+0000","last_fullsized":"2024-09-21T02:41:44.486936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:25.307835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812435+0000","last_change":"2024-09-21T02:39:46.852869+0000","last_active":"2024-09-21T02:42:11.812435+0000","last_peered":"2024-09-21T02:42:11.812435+0000","last_clean":"2024-09-21T02:42:11.812435+0000","last_became_active":"2024-09-21T02:39:46.852237+0000","last_became_peered":"2024-09-21T02:39:46.852237+0000","last_unstale":"2024-09-21T02:42:11.812435+0000","last_undegraded":"2024-09-21T02:42:11.812435+0000","last_fullsized":"2024-09-21T02:42:11.812435+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:10.729381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348373+0000","last_change":"2024-09-21T02:39:43.827358+0000","last_active":"2024-09-21T02:41:44.348373+0000","last_peered":"2024-09-21T02:41:44.348373+0000","last_clean":"2024-09-21T02:41:44.348373+0000","last_became_active":"2024-09-21T02:39:43.826910+0000","last_became_peered":"2024-09-21T02:39:43.826910+0000","last_unstale":"2024-09-21T02:41:44.348373+0000","last_undegraded":"2024-09-21T02:41:44.348373+0000","last_fullsized":"2024-09-21T02:41:44.348373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:48.528314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343598+0000","last_change":"2024-09-21T02:39:56.930809+0000","last_active":"2024-09-21T02:41:44.343598+0000","last_peered":"2024-09-21T02:41:44.343598+0000","last_clean":"2024-09-21T02:41:44.343598+0000","last_became_active":"2024-09-21T02:39:56.930355+0000","last_became_peered":"2024-09-21T02:39:56.930355+0000","last_unstale":"2024-09-21T02:41:44.343598+0000","last_undegraded":"2024-09-21T02:41:44.343598+0000","last_fullsized":"2024-09-21T02:41:44.343598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:41.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823944+0000","last_change":"2024-09-21T02:39:46.856046+0000","last_active":"2024-09-21T02:42:11.823944+0000","last_peered":"2024-09-21T02:42:11.823944+0000","last_clean":"2024-09-21T02:42:11.823944+0000","last_became_active":"2024-09-21T02:39:46.855675+0000","last_became_peered":"2024-09-21T02:39:46.855675+0000","last_unstale":"2024-09-21T02:42:11.823944+0000","last_undegraded":"2024-09-21T02:42:11.823944+0000","last_fullsized":"2024-09-21T02:42:11.823944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.547082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346460+0000","last_change":"2024-09-21T02:39:43.828888+0000","last_active":"2024-09-21T02:41:44.346460+0000","last_peered":"2024-09-21T02:41:44.346460+0000","last_clean":"2024-09-21T02:41:44.346460+0000","last_became_active":"2024-09-21T02:39:43.828340+0000","last_became_peered":"2024-09-21T02:39:43.828340+0000","last_unstale":"2024-09-21T02:41:44.346460+0000","last_undegraded":"2024-09-21T02:41:44.346460+0000","last_fullsized":"2024-09-21T02:41:44.346460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:09.017191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487223+0000","last_change":"2024-09-21T02:39:43.828957+0000","last_active":"2024-09-21T02:41:44.487223+0000","last_peered":"2024-09-21T02:41:44.487223+0000","last_clean":"2024-09-21T02:41:44.487223+0000","last_became_active":"2024-09-21T02:39:43.827899+0000","last_became_peered":"2024-09-21T02:39:43.827899+0000","last_unstale":"2024-09-21T02:41:44.487223+0000","last_undegraded":"2024-09-21T02:41:44.487223+0000","last_fullsized":"2024-09-21T02:41:44.487223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:36.727082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.827569+0000","last_change":"2024-09-21T02:39:46.855278+0000","last_active":"2024-09-21T02:42:11.827569+0000","last_peered":"2024-09-21T02:42:11.827569+0000","last_clean":"2024-09-21T02:42:11.827569+0000","last_became_active":"2024-09-21T02:39:46.854905+0000","last_became_peered":"2024-09-21T02:39:46.854905+0000","last_unstale":"2024-09-21T02:42:11.827569+0000","last_undegraded":"2024-09-21T02:42:11.827569+0000","last_fullsized":"2024-09-21T02:42:11.827569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.244912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344742+0000","last_change":"2024-09-21T02:39:56.931183+0000","last_active":"2024-09-21T02:41:44.344742+0000","last_peered":"2024-09-21T02:41:44.344742+0000","last_clean":"2024-09-21T02:41:44.344742+0000","last_became_active":"2024-09-21T02:39:56.930776+0000","last_became_peered":"2024-09-21T02:39:56.930776+0000","last_unstale":"2024-09-21T02:41:44.344742+0000","last_undegraded":"2024-09-21T02:41:44.344742+0000","last_fullsized":"2024-09-21T02:41:44.344742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:56.272272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:34.592194+0000","last_change":"2024-09-21T02:39:43.823668+0000","last_active":"2024-09-21T02:42:34.592194+0000","last_peered":"2024-09-21T02:42:34.592194+0000","last_clean":"2024-09-21T02:42:34.592194+0000","last_became_active":"2024-09-21T02:39:43.823132+0000","last_became_peered":"2024-09-21T02:39:43.823132+0000","last_unstale":"2024-09-21T02:42:34.592194+0000","last_undegraded":"2024-09-21T02:42:34.592194+0000","last_fullsized":"2024-09-21T02:42:34.592194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:33.187554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822148+0000","last_change":"2024-09-21T02:39:46.845740+0000","last_active":"2024-09-21T02:42:11.822148+0000","last_peered":"2024-09-21T02:42:11.822148+0000","last_clean":"2024-09-21T02:42:11.822148+0000","last_became_active":"2024-09-21T02:39:46.845361+0000","last_became_peered":"2024-09-21T02:39:46.845361+0000","last_unstale":"2024-09-21T02:42:11.822148+0000","last_undegraded":"2024-09-21T02:42:11.822148+0000","last_fullsized":"2024-09-21T02:42:11.822148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.546769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344941+0000","last_change":"2024-09-21T02:39:56.919760+0000","last_active":"2024-09-21T02:41:44.344941+0000","last_peered":"2024-09-21T02:41:44.344941+0000","last_clean":"2024-09-21T02:41:44.344941+0000","last_became_active":"2024-09-21T02:39:56.919315+0000","last_became_peered":"2024-09-21T02:39:56.919315+0000","last_unstale":"2024-09-21T02:41:44.344941+0000","last_undegraded":"2024-09-21T02:41:44.344941+0000","last_fullsized":"2024-09-21T02:41:44.344941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:52.889707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823082+0000","last_change":"2024-09-21T02:39:46.848040+0000","last_active":"2024-09-21T02:42:11.823082+0000","last_peered":"2024-09-21T02:42:11.823082+0000","last_clean":"2024-09-21T02:42:11.823082+0000","last_became_active":"2024-09-21T02:39:46.847627+0000","last_became_peered":"2024-09-21T02:39:46.847627+0000","last_unstale":"2024-09-21T02:42:11.823082+0000","last_undegraded":"2024-09-21T02:42:11.823082+0000","last_fullsized":"2024-09-21T02:42:11.823082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:14.139156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.814594+0000","last_change":"2024-09-21T02:39:46.853208+0000","last_active":"2024-09-21T02:42:11.814594+0000","last_peered":"2024-09-21T02:42:11.814594+0000","last_clean":"2024-09-21T02:42:11.814594+0000","last_became_active":"2024-09-21T02:39:46.852821+0000","last_became_peered":"2024-09-21T02:39:46.852821+0000","last_unstale":"2024-09-21T02:42:11.814594+0000","last_undegraded":"2024-09-21T02:42:11.814594+0000","last_fullsized":"2024-09-21T02:42:11.814594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:24.597702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.817363+0000","last_change":"2024-09-21T02:39:46.866239+0000","last_active":"2024-09-21T02:42:11.817363+0000","last_peered":"2024-09-21T02:42:11.817363+0000","last_clean":"2024-09-21T02:42:11.817363+0000","last_became_active":"2024-09-21T02:39:46.865935+0000","last_became_peered":"2024-09-21T02:39:46.865935+0000","last_unstale":"2024-09-21T02:42:11.817363+0000","last_undegraded":"2024-09-21T02:42:11.817363+0000","last_fullsized":"2024-09-21T02:42:11.817363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.420521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.827231+0000","last_change":"2024-09-21T02:39:46.861857+0000","last_active":"2024-09-21T02:42:11.827231+0000","last_peered":"2024-09-21T02:42:11.827231+0000","last_clean":"2024-09-21T02:42:11.827231+0000","last_became_active":"2024-09-21T02:39:46.861512+0000","last_became_peered":"2024-09-21T02:39:46.861512+0000","last_unstale":"2024-09-21T02:42:11.827231+0000","last_undegraded":"2024-09-21T02:42:11.827231+0000","last_fullsized":"2024-09-21T02:42:11.827231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.044159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824496+0000","last_change":"2024-09-21T02:39:46.858655+0000","last_active":"2024-09-21T02:42:11.824496+0000","last_peered":"2024-09-21T02:42:11.824496+0000","last_clean":"2024-09-21T02:42:11.824496+0000","last_became_active":"2024-09-21T02:39:46.858376+0000","last_became_peered":"2024-09-21T02:39:46.858376+0000","last_unstale":"2024-09-21T02:42:11.824496+0000","last_undegraded":"2024-09-21T02:42:11.824496+0000","last_fullsized":"2024-09-21T02:42:11.824496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:16.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822418+0000","last_change":"2024-09-21T02:39:46.847973+0000","last_active":"2024-09-21T02:42:11.822418+0000","last_peered":"2024-09-21T02:42:11.822418+0000","last_clean":"2024-09-21T02:42:11.822418+0000","last_became_active":"2024-09-21T02:39:46.846957+0000","last_became_peered":"2024-09-21T02:39:46.846957+0000","last_unstale":"2024-09-21T02:42:11.822418+0000","last_undegraded":"2024-09-21T02:42:11.822418+0000","last_fullsized":"2024-09-21T02:42:11.822418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:44.077854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812203+0000","last_change":"2024-09-21T02:39:46.851310+0000","last_active":"2024-09-21T02:42:11.812203+0000","last_peered":"2024-09-21T02:42:11.812203+0000","last_clean":"2024-09-21T02:42:11.812203+0000","last_became_active":"2024-09-21T02:39:46.850666+0000","last_became_peered":"2024-09-21T02:39:46.850666+0000","last_unstale":"2024-09-21T02:42:11.812203+0000","last_undegraded":"2024-09-21T02:42:11.812203+0000","last_fullsized":"2024-09-21T02:42:11.812203+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:48.354795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.801547+0000","last_change":"2024-09-21T02:39:46.857409+0000","last_active":"2024-09-21T02:42:11.801547+0000","last_peered":"2024-09-21T02:42:11.801547+0000","last_clean":"2024-09-21T02:42:11.801547+0000","last_became_active":"2024-09-21T02:39:46.856974+0000","last_became_peered":"2024-09-21T02:39:46.856974+0000","last_unstale":"2024-09-21T02:42:11.801547+0000","last_undegraded":"2024-09-21T02:42:11.801547+0000","last_fullsized":"2024-09-21T02:42:11.801547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.140154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818137+0000","last_change":"2024-09-21T02:39:46.844168+0000","last_active":"2024-09-21T02:42:11.818137+0000","last_peered":"2024-09-21T02:42:11.818137+0000","last_clean":"2024-09-21T02:42:11.818137+0000","last_became_active":"2024-09-21T02:39:46.843509+0000","last_became_peered":"2024-09-21T02:39:46.843509+0000","last_unstale":"2024-09-21T02:42:11.818137+0000","last_undegraded":"2024-09-21T02:42:11.818137+0000","last_fullsized":"2024-09-21T02:42:11.818137+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.899890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.817598+0000","last_change":"2024-09-21T02:39:46.854805+0000","last_active":"2024-09-21T02:42:11.817598+0000","last_peered":"2024-09-21T02:42:11.817598+0000","last_clean":"2024-09-21T02:42:11.817598+0000","last_became_active":"2024-09-21T02:39:46.850248+0000","last_became_peered":"2024-09-21T02:39:46.850248+0000","last_unstale":"2024-09-21T02:42:11.817598+0000","last_undegraded":"2024-09-21T02:42:11.817598+0000","last_fullsized":"2024-09-21T02:42:11.817598+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:45.628337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834880+0000","last_change":"2024-09-21T02:39:46.866278+0000","last_active":"2024-09-21T02:42:11.834880+0000","last_peered":"2024-09-21T02:42:11.834880+0000","last_clean":"2024-09-21T02:42:11.834880+0000","last_became_active":"2024-09-21T02:39:46.865810+0000","last_became_peered":"2024-09-21T02:39:46.865810+0000","last_unstale":"2024-09-21T02:42:11.834880+0000","last_undegraded":"2024-09-21T02:42:11.834880+0000","last_fullsized":"2024-09-21T02:42:11.834880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.754340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824217+0000","last_change":"2024-09-21T02:39:46.857721+0000","last_active":"2024-09-21T02:42:11.824217+0000","last_peered":"2024-09-21T02:42:11.824217+0000","last_clean":"2024-09-21T02:42:11.824217+0000","last_became_active":"2024-09-21T02:39:46.853640+0000","last_became_peered":"2024-09-21T02:39:46.853640+0000","last_unstale":"2024-09-21T02:42:11.824217+0000","last_undegraded":"2024-09-21T02:42:11.824217+0000","last_fullsized":"2024-09-21T02:42:11.824217+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:54.019607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819500+0000","last_change":"2024-09-21T02:40:43.413457+0000","last_active":"2024-09-21T02:42:11.819500+0000","last_peered":"2024-09-21T02:42:11.819500+0000","last_clean":"2024-09-21T02:42:11.819500+0000","last_became_active":"2024-09-21T02:40:43.413000+0000","last_became_peered":"2024-09-21T02:40:43.413000+0000","last_unstale":"2024-09-21T02:42:11.819500+0000","last_undegraded":"2024-09-21T02:42:11.819500+0000","last_fullsized":"2024-09-21T02:42:11.819500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:27.775410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818391+0000","last_change":"2024-09-21T02:39:46.857169+0000","last_active":"2024-09-21T02:42:11.818391+0000","last_peered":"2024-09-21T02:42:11.818391+0000","last_clean":"2024-09-21T02:42:11.818391+0000","last_became_active":"2024-09-21T02:39:46.856757+0000","last_became_peered":"2024-09-21T02:39:46.856757+0000","last_unstale":"2024-09-21T02:42:11.818391+0000","last_undegraded":"2024-09-21T02:42:11.818391+0000","last_fullsized":"2024-09-21T02:42:11.818391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:36.729746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812141+0000","last_change":"2024-09-21T02:39:46.854162+0000","last_active":"2024-09-21T02:42:11.812141+0000","last_peered":"2024-09-21T02:42:11.812141+0000","last_clean":"2024-09-21T02:42:11.812141+0000","last_became_active":"2024-09-21T02:39:46.853697+0000","last_became_peered":"2024-09-21T02:39:46.853697+0000","last_unstale":"2024-09-21T02:42:11.812141+0000","last_undegraded":"2024-09-21T02:42:11.812141+0000","last_fullsized":"2024-09-21T02:42:11.812141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.605606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830324+0000","last_change":"2024-09-21T02:39:46.853570+0000","last_active":"2024-09-21T02:42:11.830324+0000","last_peered":"2024-09-21T02:42:11.830324+0000","last_clean":"2024-09-21T02:42:11.830324+0000","last_became_active":"2024-09-21T02:39:46.853074+0000","last_became_peered":"2024-09-21T02:39:46.853074+0000","last_unstale":"2024-09-21T02:42:11.830324+0000","last_undegraded":"2024-09-21T02:42:11.830324+0000","last_fullsized":"2024-09-21T02:42:11.830324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:02.642887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834080+0000","last_change":"2024-09-21T02:39:46.850070+0000","last_active":"2024-09-21T02:42:11.834080+0000","last_peered":"2024-09-21T02:42:11.834080+0000","last_clean":"2024-09-21T02:42:11.834080+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:42:11.834080+0000","last_undegraded":"2024-09-21T02:42:11.834080+0000","last_fullsized":"2024-09-21T02:42:11.834080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:59.185574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822391+0000","last_change":"2024-09-21T02:40:43.403735+0000","last_active":"2024-09-21T02:42:11.822391+0000","last_peered":"2024-09-21T02:42:11.822391+0000","last_clean":"2024-09-21T02:42:11.822391+0000","last_became_active":"2024-09-21T02:40:43.403330+0000","last_became_peered":"2024-09-21T02:40:43.403330+0000","last_unstale":"2024-09-21T02:42:11.822391+0000","last_undegraded":"2024-09-21T02:42:11.822391+0000","last_fullsized":"2024-09-21T02:42:11.822391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:35.043475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.821969+0000","last_change":"2024-09-21T02:39:46.850811+0000","last_active":"2024-09-21T02:42:11.821969+0000","last_peered":"2024-09-21T02:42:11.821969+0000","last_clean":"2024-09-21T02:42:11.821969+0000","last_became_active":"2024-09-21T02:39:46.850423+0000","last_became_peered":"2024-09-21T02:39:46.850423+0000","last_unstale":"2024-09-21T02:42:11.821969+0000","last_undegraded":"2024-09-21T02:42:11.821969+0000","last_fullsized":"2024-09-21T02:42:11.821969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:47.343607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822683+0000","last_change":"2024-09-21T02:39:46.851169+0000","last_active":"2024-09-21T02:42:11.822683+0000","last_peered":"2024-09-21T02:42:11.822683+0000","last_clean":"2024-09-21T02:42:11.822683+0000","last_became_active":"2024-09-21T02:39:46.850258+0000","last_became_peered":"2024-09-21T02:39:46.850258+0000","last_unstale":"2024-09-21T02:42:11.822683+0000","last_undegraded":"2024-09-21T02:42:11.822683+0000","last_fullsized":"2024-09-21T02:42:11.822683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:02.588325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.808504+0000","last_change":"2024-09-21T02:39:46.854082+0000","last_active":"2024-09-21T02:42:11.808504+0000","last_peered":"2024-09-21T02:42:11.808504+0000","last_clean":"2024-09-21T02:42:11.808504+0000","last_became_active":"2024-09-21T02:39:46.852226+0000","last_became_peered":"2024-09-21T02:39:46.852226+0000","last_unstale":"2024-09-21T02:42:11.808504+0000","last_undegraded":"2024-09-21T02:42:11.808504+0000","last_fullsized":"2024-09-21T02:42:11.808504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:41.960472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.835143+0000","last_change":"2024-09-21T02:39:46.856222+0000","last_active":"2024-09-21T02:42:11.835143+0000","last_peered":"2024-09-21T02:42:11.835143+0000","last_clean":"2024-09-21T02:42:11.835143+0000","last_became_active":"2024-09-21T02:39:46.855868+0000","last_became_peered":"2024-09-21T02:39:46.855868+0000","last_unstale":"2024-09-21T02:42:11.835143+0000","last_undegraded":"2024-09-21T02:42:11.835143+0000","last_fullsized":"2024-09-21T02:42:11.835143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:31.396030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.811992+0000","last_change":"2024-09-21T02:39:46.862312+0000","last_active":"2024-09-21T02:42:11.811992+0000","last_peered":"2024-09-21T02:42:11.811992+0000","last_clean":"2024-09-21T02:42:11.811992+0000","last_became_active":"2024-09-21T02:39:46.861921+0000","last_became_peered":"2024-09-21T02:39:46.861921+0000","last_unstale":"2024-09-21T02:42:11.811992+0000","last_undegraded":"2024-09-21T02:42:11.811992+0000","last_fullsized":"2024-09-21T02:42:11.811992+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:33.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833822+0000","last_change":"2024-09-21T02:39:46.851155+0000","last_active":"2024-09-21T02:42:11.833822+0000","last_peered":"2024-09-21T02:42:11.833822+0000","last_clean":"2024-09-21T02:42:11.833822+0000","last_became_active":"2024-09-21T02:39:46.850809+0000","last_became_peered":"2024-09-21T02:39:46.850809+0000","last_unstale":"2024-09-21T02:42:11.833822+0000","last_undegraded":"2024-09-21T02:42:11.833822+0000","last_fullsized":"2024-09-21T02:42:11.833822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820047+0000","last_change":"2024-09-21T02:39:46.850585+0000","last_active":"2024-09-21T02:42:11.820047+0000","last_peered":"2024-09-21T02:42:11.820047+0000","last_clean":"2024-09-21T02:42:11.820047+0000","last_became_active":"2024-09-21T02:39:46.850114+0000","last_became_peered":"2024-09-21T02:39:46.850114+0000","last_unstale":"2024-09-21T02:42:11.820047+0000","last_undegraded":"2024-09-21T02:42:11.820047+0000","last_fullsized":"2024-09-21T02:42:11.820047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:04.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.829001+0000","last_change":"2024-09-21T02:39:46.850416+0000","last_active":"2024-09-21T02:42:11.829001+0000","last_peered":"2024-09-21T02:42:11.829001+0000","last_clean":"2024-09-21T02:42:11.829001+0000","last_became_active":"2024-09-21T02:39:46.850035+0000","last_became_peered":"2024-09-21T02:39:46.850035+0000","last_unstale":"2024-09-21T02:42:11.829001+0000","last_undegraded":"2024-09-21T02:42:11.829001+0000","last_fullsized":"2024-09-21T02:42:11.829001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:09.139331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.813518+0000","last_change":"2024-09-21T02:39:46.861376+0000","last_active":"2024-09-21T02:42:11.813518+0000","last_peered":"2024-09-21T02:42:11.813518+0000","last_clean":"2024-09-21T02:42:11.813518+0000","last_became_active":"2024-09-21T02:39:46.861011+0000","last_became_peered":"2024-09-21T02:39:46.861011+0000","last_unstale":"2024-09-21T02:42:11.813518+0000","last_undegraded":"2024-09-21T02:42:11.813518+0000","last_fullsized":"2024-09-21T02:42:11.813518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:45.123705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.821886+0000","last_change":"2024-09-21T02:39:46.846135+0000","last_active":"2024-09-21T02:42:11.821886+0000","last_peered":"2024-09-21T02:42:11.821886+0000","last_clean":"2024-09-21T02:42:11.821886+0000","last_became_active":"2024-09-21T02:39:46.845693+0000","last_became_peered":"2024-09-21T02:39:46.845693+0000","last_unstale":"2024-09-21T02:42:11.821886+0000","last_undegraded":"2024-09-21T02:42:11.821886+0000","last_fullsized":"2024-09-21T02:42:11.821886+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:55.830932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.808763+0000","last_change":"2024-09-21T02:39:46.853300+0000","last_active":"2024-09-21T02:42:11.808763+0000","last_peered":"2024-09-21T02:42:11.808763+0000","last_clean":"2024-09-21T02:42:11.808763+0000","last_became_active":"2024-09-21T02:39:46.852953+0000","last_became_peered":"2024-09-21T02:39:46.852953+0000","last_unstale":"2024-09-21T02:42:11.808763+0000","last_undegraded":"2024-09-21T02:42:11.808763+0000","last_fullsized":"2024-09-21T02:42:11.808763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:04.475743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822522+0000","last_change":"2024-09-21T02:39:46.854976+0000","last_active":"2024-09-21T02:42:11.822522+0000","last_peered":"2024-09-21T02:42:11.822522+0000","last_clean":"2024-09-21T02:42:11.822522+0000","last_became_active":"2024-09-21T02:39:46.852970+0000","last_became_peered":"2024-09-21T02:39:46.852970+0000","last_unstale":"2024-09-21T02:42:11.822522+0000","last_undegraded":"2024-09-21T02:42:11.822522+0000","last_fullsized":"2024-09-21T02:42:11.822522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:54.654967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.815558+0000","last_change":"2024-09-21T02:39:46.848698+0000","last_active":"2024-09-21T02:42:11.815558+0000","last_peered":"2024-09-21T02:42:11.815558+0000","last_clean":"2024-09-21T02:42:11.815558+0000","last_became_active":"2024-09-21T02:39:46.848374+0000","last_became_peered":"2024-09-21T02:39:46.848374+0000","last_unstale":"2024-09-21T02:42:11.815558+0000","last_undegraded":"2024-09-21T02:42:11.815558+0000","last_fullsized":"2024-09-21T02:42:11.815558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:59.589062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830099+0000","last_change":"2024-09-21T02:39:46.851850+0000","last_active":"2024-09-21T02:42:11.830099+0000","last_peered":"2024-09-21T02:42:11.830099+0000","last_clean":"2024-09-21T02:42:11.830099+0000","last_became_active":"2024-09-21T02:39:46.851408+0000","last_became_peered":"2024-09-21T02:39:46.851408+0000","last_unstale":"2024-09-21T02:42:11.830099+0000","last_undegraded":"2024-09-21T02:42:11.830099+0000","last_fullsized":"2024-09-21T02:42:11.830099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:27.831504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72061,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":712,"num_read_kb":433,"num_write":176,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":216494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939701,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28700,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716452,"statfs":{"total":95995035648,"available":95965646848,"internally_reserved":0,"allocated":1716224,"data_stored":1169988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103226,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":510941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":514957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495686,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1626112,"data_stored":1107443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659212,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":506117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855442,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1098403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986262,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":511299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182493,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":506311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":575296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":573414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":507505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:42:41.429 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:42:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:41 smithi172 ceph-mon[35067]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:41.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:41 smithi172 ceph-mon[35067]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T02:42:41.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:41 smithi084 ceph-mon[30747]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:41.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:41 smithi084 ceph-mon[30747]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T02:42:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:41 smithi090 ceph-mon[34571]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:41.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:41 smithi090 ceph-mon[34571]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-21T02:42:41.845 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:42.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 -- 172.21.15.84:0/532018565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da0103990 msgr2=0x7f7da0103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:42.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 --2- 172.21.15.84:0/532018565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da0103990 0x7f7da0103da0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009900 tx=0x7f7d9002a410 comp rx=0 tx=0).stop 2024-09-21T02:42:42.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 -- 172.21.15.84:0/532018565 shutdown_connections 2024-09-21T02:42:42.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 --2- 172.21.15.84:0/532018565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da01092d0 0x7f7da01096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 --2- 172.21.15.84:0/532018565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7da0109c20 0x7f7da0110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 --2- 172.21.15.84:0/532018565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da0103990 0x7f7da0103da0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 -- 172.21.15.84:0/532018565 >> 172.21.15.84:0/532018565 conn(0x7f7da00ff3e0 msgr2=0x7f7da0101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:42.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 -- 172.21.15.84:0/532018565 shutdown_connections 2024-09-21T02:42:42.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.576+0000 7f7da4c00640 1 -- 172.21.15.84:0/532018565 wait complete. 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.578+0000 7f7da4c00640 1 Processor -- start 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.578+0000 7f7da4c00640 1 -- start start 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.578+0000 7f7da4c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da0103990 0x7f7da0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.578+0000 7f7da4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da01092d0 0x7f7da0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.578+0000 7f7da4c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7da0109c20 0x7f7da0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.578+0000 7f7da4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0113a00 con 0x7f7da01092d0 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.578+0000 7f7da4c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0113880 con 0x7f7da0109c20 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.578+0000 7f7da4c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0113b80 con 0x7f7da0103990 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da01092d0 0x7f7da0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:42.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d9f400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da0103990 0x7f7da0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da01092d0 0x7f7da0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34434/0 (socket says 172.21.15.84:34434) 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 -- 172.21.15.84:0/998491660 learned_addr learned my addr 172.21.15.84:0/998491660 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d9fe00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7da0109c20 0x7f7da0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 -- 172.21.15.84:0/998491660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da0103990 msgr2=0x7f7da0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da0103990 0x7f7da0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 -- 172.21.15.84:0/998491660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7da0109c20 msgr2=0x7f7da0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7da0109c20 0x7f7da0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 -- 172.21.15.84:0/998491660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da01a8670 con 0x7f7da01092d0 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d9fe00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7da0109c20 0x7f7da0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.579+0000 7f7d97e00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da01092d0 0x7f7da0075c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800d950 tx=0x7f7d8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.580+0000 7f7d9cc00640 1 -- 172.21.15.84:0/998491660 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88017070 con 0x7f7da01092d0 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.580+0000 7f7d9cc00640 1 -- 172.21.15.84:0/998491660 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d88009c30 con 0x7f7da01092d0 2024-09-21T02:42:42.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.580+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da01a8960 con 0x7f7da01092d0 2024-09-21T02:42:42.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.580+0000 7f7d9cc00640 1 -- 172.21.15.84:0/998491660 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d880047a0 con 0x7f7da01092d0 2024-09-21T02:42:42.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.580+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da01a8ea0 con 0x7f7da01092d0 2024-09-21T02:42:42.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.581+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da0103da0 con 0x7f7da01092d0 2024-09-21T02:42:42.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.583+0000 7f7d9cc00640 1 -- 172.21.15.84:0/998491660 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f7d88004020 con 0x7f7da01092d0 2024-09-21T02:42:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.586+0000 7f7d9cc00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7d840b65a0 0x7f7d840b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.586+0000 7f7d9f400640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7d840b65a0 0x7f7d840b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.586+0000 7f7d9cc00640 1 -- 172.21.15.84:0/998491660 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f7d880e75e0 con 0x7f7da01092d0 2024-09-21T02:42:42.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.587+0000 7f7d9f400640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7d840b65a0 0x7f7d840b8ab0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7da0077160 tx=0x7f7d900058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.590+0000 7f7d9cc00640 1 -- 172.21.15.84:0/998491660 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d88020020 con 0x7f7da01092d0 2024-09-21T02:42:42.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:42 smithi172 ceph-mon[35067]: pgmap v408: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:42:42.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:42 smithi084 ceph-mon[30747]: pgmap v408: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:42:42.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:42 smithi090 ceph-mon[34571]: pgmap v408: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:42:42.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.776+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7da0063800 con 0x7f7d840b65a0 2024-09-21T02:42:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.784+0000 7f7d9cc00640 1 -- 172.21.15.84:0/998491660 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340476 (secure 0 0 0) 0x7f7da0063800 con 0x7f7d840b65a0 2024-09-21T02:42:42.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:42.790 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T02:42:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7d840b65a0 msgr2=0x7f7d840b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7d840b65a0 0x7f7d840b8ab0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7da0077160 tx=0x7f7d900058d0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da01092d0 msgr2=0x7f7da0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da01092d0 0x7f7da0075c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7d8800d950 tx=0x7f7d8800de10 comp rx=0 tx=0).stop 2024-09-21T02:42:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 shutdown_connections 2024-09-21T02:42:42.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7da0109c20 0x7f7da0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7da01092d0 0x7f7da0075c50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7d840b65a0 0x7f7d840b8ab0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 --2- 172.21.15.84:0/998491660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7da0103990 0x7f7da0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 >> 172.21.15.84:0/998491660 conn(0x7f7da00ff3e0 msgr2=0x7f7da0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 shutdown_connections 2024-09-21T02:42:42.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:42.789+0000 7f7da4c00640 1 -- 172.21.15.84:0/998491660 wait complete. 2024-09-21T02:42:43.646 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-09-21T02:42:41.630250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671327,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":823,"num_read_kb":524,"num_write":314,"num_write_kb":2297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392388,"kb_used_data":14020,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549436,"statfs":{"total":1151940427776,"available":1151538622464,"internally_reserved":0,"allocated":14356480,"data_stored":8101434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":57,"num_write":13,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003712"},"pg_stats":[{"pgid":"2.1f","version":"84'9","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348659+0000","last_change":"2024-09-21T02:39:43.823658+0000","last_active":"2024-09-21T02:41:44.348659+0000","last_peered":"2024-09-21T02:41:44.348659+0000","last_clean":"2024-09-21T02:41:44.348659+0000","last_became_active":"2024-09-21T02:39:43.823211+0000","last_became_peered":"2024-09-21T02:39:43.823211+0000","last_unstale":"2024-09-21T02:41:44.348659+0000","last_undegraded":"2024-09-21T02:41:44.348659+0000","last_fullsized":"2024-09-21T02:41:44.348659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:00.505552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.806777+0000","last_change":"2024-09-21T02:39:46.850819+0000","last_active":"2024-09-21T02:42:11.806777+0000","last_peered":"2024-09-21T02:42:11.806777+0000","last_clean":"2024-09-21T02:42:11.806777+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:42:11.806777+0000","last_undegraded":"2024-09-21T02:42:11.806777+0000","last_fullsized":"2024-09-21T02:42:11.806777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:21.280788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.699306+0000","last_change":"2024-09-21T02:41:44.698816+0000","last_active":"2024-09-21T02:41:44.699306+0000","last_peered":"2024-09-21T02:41:44.699306+0000","last_clean":"2024-09-21T02:41:44.699306+0000","last_became_active":"2024-09-21T02:41:44.698135+0000","last_became_peered":"2024-09-21T02:41:44.698135+0000","last_unstale":"2024-09-21T02:41:44.699306+0000","last_undegraded":"2024-09-21T02:41:44.699306+0000","last_fullsized":"2024-09-21T02:41:44.699306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:09.002148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342951+0000","last_change":"2024-09-21T02:39:43.828030+0000","last_active":"2024-09-21T02:41:44.342951+0000","last_peered":"2024-09-21T02:41:44.342951+0000","last_clean":"2024-09-21T02:41:44.342951+0000","last_became_active":"2024-09-21T02:39:43.827692+0000","last_became_peered":"2024-09-21T02:39:43.827692+0000","last_unstale":"2024-09-21T02:41:44.342951+0000","last_undegraded":"2024-09-21T02:41:44.342951+0000","last_fullsized":"2024-09-21T02:41:44.342951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:32.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.828650+0000","last_change":"2024-09-21T02:39:46.854718+0000","last_active":"2024-09-21T02:42:11.828650+0000","last_peered":"2024-09-21T02:42:11.828650+0000","last_clean":"2024-09-21T02:42:11.828650+0000","last_became_active":"2024-09-21T02:39:46.854355+0000","last_became_peered":"2024-09-21T02:39:46.854355+0000","last_unstale":"2024-09-21T02:42:11.828650+0000","last_undegraded":"2024-09-21T02:42:11.828650+0000","last_fullsized":"2024-09-21T02:42:11.828650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:58.894397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486275+0000","last_change":"2024-09-21T02:39:56.930764+0000","last_active":"2024-09-21T02:41:44.486275+0000","last_peered":"2024-09-21T02:41:44.486275+0000","last_clean":"2024-09-21T02:41:44.486275+0000","last_became_active":"2024-09-21T02:39:56.930243+0000","last_became_peered":"2024-09-21T02:39:56.930243+0000","last_unstale":"2024-09-21T02:41:44.486275+0000","last_undegraded":"2024-09-21T02:41:44.486275+0000","last_fullsized":"2024-09-21T02:41:44.486275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:20.283102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697482+0000","last_change":"2024-09-21T02:39:43.824749+0000","last_active":"2024-09-21T02:41:44.697482+0000","last_peered":"2024-09-21T02:41:44.697482+0000","last_clean":"2024-09-21T02:41:44.697482+0000","last_became_active":"2024-09-21T02:39:43.824385+0000","last_became_peered":"2024-09-21T02:39:43.824385+0000","last_unstale":"2024-09-21T02:41:44.697482+0000","last_undegraded":"2024-09-21T02:41:44.697482+0000","last_fullsized":"2024-09-21T02:41:44.697482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833157+0000","last_change":"2024-09-21T02:39:46.856048+0000","last_active":"2024-09-21T02:42:11.833157+0000","last_peered":"2024-09-21T02:42:11.833157+0000","last_clean":"2024-09-21T02:42:11.833157+0000","last_became_active":"2024-09-21T02:39:46.855687+0000","last_became_peered":"2024-09-21T02:39:46.855687+0000","last_unstale":"2024-09-21T02:42:11.833157+0000","last_undegraded":"2024-09-21T02:42:11.833157+0000","last_fullsized":"2024-09-21T02:42:11.833157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:11.708028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487682+0000","last_change":"2024-09-21T02:39:56.931495+0000","last_active":"2024-09-21T02:41:44.487682+0000","last_peered":"2024-09-21T02:41:44.487682+0000","last_clean":"2024-09-21T02:41:44.487682+0000","last_became_active":"2024-09-21T02:39:56.930586+0000","last_became_peered":"2024-09-21T02:39:56.930586+0000","last_unstale":"2024-09-21T02:41:44.487682+0000","last_undegraded":"2024-09-21T02:41:44.487682+0000","last_fullsized":"2024-09-21T02:41:44.487682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:56.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343041+0000","last_change":"2024-09-21T02:40:43.408517+0000","last_active":"2024-09-21T02:41:44.343041+0000","last_peered":"2024-09-21T02:41:44.343041+0000","last_clean":"2024-09-21T02:41:44.343041+0000","last_became_active":"2024-09-21T02:40:43.402800+0000","last_became_peered":"2024-09-21T02:40:43.402800+0000","last_unstale":"2024-09-21T02:41:44.343041+0000","last_undegraded":"2024-09-21T02:41:44.343041+0000","last_fullsized":"2024-09-21T02:41:44.343041+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:46.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824825+0000","last_change":"2024-09-21T02:39:46.855990+0000","last_active":"2024-09-21T02:42:11.824825+0000","last_peered":"2024-09-21T02:42:11.824825+0000","last_clean":"2024-09-21T02:42:11.824825+0000","last_became_active":"2024-09-21T02:39:46.855602+0000","last_became_peered":"2024-09-21T02:39:46.855602+0000","last_unstale":"2024-09-21T02:42:11.824825+0000","last_undegraded":"2024-09-21T02:42:11.824825+0000","last_fullsized":"2024-09-21T02:42:11.824825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:43.207141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487155+0000","last_change":"2024-09-21T02:39:56.924868+0000","last_active":"2024-09-21T02:41:44.487155+0000","last_peered":"2024-09-21T02:41:44.487155+0000","last_clean":"2024-09-21T02:41:44.487155+0000","last_became_active":"2024-09-21T02:39:56.924353+0000","last_became_peered":"2024-09-21T02:39:56.924353+0000","last_unstale":"2024-09-21T02:41:44.487155+0000","last_undegraded":"2024-09-21T02:41:44.487155+0000","last_fullsized":"2024-09-21T02:41:44.487155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:48.095244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834867+0000","last_change":"2024-09-21T02:39:46.853077+0000","last_active":"2024-09-21T02:42:11.834867+0000","last_peered":"2024-09-21T02:42:11.834867+0000","last_clean":"2024-09-21T02:42:11.834867+0000","last_became_active":"2024-09-21T02:39:46.852691+0000","last_became_peered":"2024-09-21T02:39:46.852691+0000","last_unstale":"2024-09-21T02:42:11.834867+0000","last_undegraded":"2024-09-21T02:42:11.834867+0000","last_fullsized":"2024-09-21T02:42:11.834867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:12.427934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696864+0000","last_change":"2024-09-21T02:40:43.411229+0000","last_active":"2024-09-21T02:41:44.696864+0000","last_peered":"2024-09-21T02:41:44.696864+0000","last_clean":"2024-09-21T02:41:44.696864+0000","last_became_active":"2024-09-21T02:40:43.404833+0000","last_became_peered":"2024-09-21T02:40:43.404833+0000","last_unstale":"2024-09-21T02:41:44.696864+0000","last_undegraded":"2024-09-21T02:41:44.696864+0000","last_fullsized":"2024-09-21T02:41:44.696864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:22.812239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487302+0000","last_change":"2024-09-21T02:39:56.922205+0000","last_active":"2024-09-21T02:41:44.487302+0000","last_peered":"2024-09-21T02:41:44.487302+0000","last_clean":"2024-09-21T02:41:44.487302+0000","last_became_active":"2024-09-21T02:39:56.921702+0000","last_became_peered":"2024-09-21T02:39:56.921702+0000","last_unstale":"2024-09-21T02:41:44.487302+0000","last_undegraded":"2024-09-21T02:41:44.487302+0000","last_fullsized":"2024-09-21T02:41:44.487302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:07.622691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820298+0000","last_change":"2024-09-21T02:39:46.846380+0000","last_active":"2024-09-21T02:42:11.820298+0000","last_peered":"2024-09-21T02:42:11.820298+0000","last_clean":"2024-09-21T02:42:11.820298+0000","last_became_active":"2024-09-21T02:39:46.845972+0000","last_became_peered":"2024-09-21T02:39:46.845972+0000","last_unstale":"2024-09-21T02:42:11.820298+0000","last_undegraded":"2024-09-21T02:42:11.820298+0000","last_fullsized":"2024-09-21T02:42:11.820298+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:44.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344699+0000","last_change":"2024-09-21T02:39:43.824394+0000","last_active":"2024-09-21T02:41:44.344699+0000","last_peered":"2024-09-21T02:41:44.344699+0000","last_clean":"2024-09-21T02:41:44.344699+0000","last_became_active":"2024-09-21T02:39:43.823947+0000","last_became_peered":"2024-09-21T02:39:43.823947+0000","last_unstale":"2024-09-21T02:41:44.344699+0000","last_undegraded":"2024-09-21T02:41:44.344699+0000","last_fullsized":"2024-09-21T02:41:44.344699+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.083281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487442+0000","last_change":"2024-09-21T02:40:43.413833+0000","last_active":"2024-09-21T02:41:44.487442+0000","last_peered":"2024-09-21T02:41:44.487442+0000","last_clean":"2024-09-21T02:41:44.487442+0000","last_became_active":"2024-09-21T02:40:43.413319+0000","last_became_peered":"2024-09-21T02:40:43.413319+0000","last_unstale":"2024-09-21T02:41:44.487442+0000","last_undegraded":"2024-09-21T02:41:44.487442+0000","last_fullsized":"2024-09-21T02:41:44.487442+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:40.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823558+0000","last_change":"2024-09-21T02:39:46.845544+0000","last_active":"2024-09-21T02:42:11.823558+0000","last_peered":"2024-09-21T02:42:11.823558+0000","last_clean":"2024-09-21T02:42:11.823558+0000","last_became_active":"2024-09-21T02:39:46.845162+0000","last_became_peered":"2024-09-21T02:39:46.845162+0000","last_unstale":"2024-09-21T02:42:11.823558+0000","last_undegraded":"2024-09-21T02:42:11.823558+0000","last_fullsized":"2024-09-21T02:42:11.823558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:46.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342517+0000","last_change":"2024-09-21T02:39:43.825182+0000","last_active":"2024-09-21T02:41:44.342517+0000","last_peered":"2024-09-21T02:41:44.342517+0000","last_clean":"2024-09-21T02:41:44.342517+0000","last_became_active":"2024-09-21T02:39:43.824774+0000","last_became_peered":"2024-09-21T02:39:43.824774+0000","last_unstale":"2024-09-21T02:41:44.342517+0000","last_undegraded":"2024-09-21T02:41:44.342517+0000","last_fullsized":"2024-09-21T02:41:44.342517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:41.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348526+0000","last_change":"2024-09-21T02:39:56.935765+0000","last_active":"2024-09-21T02:41:44.348526+0000","last_peered":"2024-09-21T02:41:44.348526+0000","last_clean":"2024-09-21T02:41:44.348526+0000","last_became_active":"2024-09-21T02:39:56.933218+0000","last_became_peered":"2024-09-21T02:39:56.933218+0000","last_unstale":"2024-09-21T02:41:44.348526+0000","last_undegraded":"2024-09-21T02:41:44.348526+0000","last_fullsized":"2024-09-21T02:41:44.348526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:28.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.782193+0000","last_change":"2024-09-21T02:39:46.853769+0000","last_active":"2024-09-21T02:42:11.782193+0000","last_peered":"2024-09-21T02:42:11.782193+0000","last_clean":"2024-09-21T02:42:11.782193+0000","last_became_active":"2024-09-21T02:39:46.853347+0000","last_became_peered":"2024-09-21T02:39:46.853347+0000","last_unstale":"2024-09-21T02:42:11.782193+0000","last_undegraded":"2024-09-21T02:42:11.782193+0000","last_fullsized":"2024-09-21T02:42:11.782193+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:01.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486557+0000","last_change":"2024-09-21T02:40:43.408316+0000","last_active":"2024-09-21T02:41:44.486557+0000","last_peered":"2024-09-21T02:41:44.486557+0000","last_clean":"2024-09-21T02:41:44.486557+0000","last_became_active":"2024-09-21T02:40:43.402877+0000","last_became_peered":"2024-09-21T02:40:43.402877+0000","last_unstale":"2024-09-21T02:41:44.486557+0000","last_undegraded":"2024-09-21T02:41:44.486557+0000","last_fullsized":"2024-09-21T02:41:44.486557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.712477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487516+0000","last_change":"2024-09-21T02:39:56.928251+0000","last_active":"2024-09-21T02:41:44.487516+0000","last_peered":"2024-09-21T02:41:44.487516+0000","last_clean":"2024-09-21T02:41:44.487516+0000","last_became_active":"2024-09-21T02:39:56.927772+0000","last_became_peered":"2024-09-21T02:39:56.927772+0000","last_unstale":"2024-09-21T02:41:44.487516+0000","last_undegraded":"2024-09-21T02:41:44.487516+0000","last_fullsized":"2024-09-21T02:41:44.487516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:40.762245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.825403+0000","last_change":"2024-09-21T02:40:43.418238+0000","last_active":"2024-09-21T02:42:11.825403+0000","last_peered":"2024-09-21T02:42:11.825403+0000","last_clean":"2024-09-21T02:42:11.825403+0000","last_became_active":"2024-09-21T02:40:43.417728+0000","last_became_peered":"2024-09-21T02:40:43.417728+0000","last_unstale":"2024-09-21T02:42:11.825403+0000","last_undegraded":"2024-09-21T02:42:11.825403+0000","last_fullsized":"2024-09-21T02:42:11.825403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:35.244275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487639+0000","last_change":"2024-09-21T02:39:43.840567+0000","last_active":"2024-09-21T02:41:44.487639+0000","last_peered":"2024-09-21T02:41:44.487639+0000","last_clean":"2024-09-21T02:41:44.487639+0000","last_became_active":"2024-09-21T02:39:43.840279+0000","last_became_peered":"2024-09-21T02:39:43.840279+0000","last_unstale":"2024-09-21T02:41:44.487639+0000","last_undegraded":"2024-09-21T02:41:44.487639+0000","last_fullsized":"2024-09-21T02:41:44.487639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:42.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345589+0000","last_change":"2024-09-21T02:39:56.920425+0000","last_active":"2024-09-21T02:41:44.345589+0000","last_peered":"2024-09-21T02:41:44.345589+0000","last_clean":"2024-09-21T02:41:44.345589+0000","last_became_active":"2024-09-21T02:39:56.919610+0000","last_became_peered":"2024-09-21T02:39:56.919610+0000","last_unstale":"2024-09-21T02:41:44.345589+0000","last_undegraded":"2024-09-21T02:41:44.345589+0000","last_fullsized":"2024-09-21T02:41:44.345589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818198+0000","last_change":"2024-09-21T02:39:46.845188+0000","last_active":"2024-09-21T02:42:11.818198+0000","last_peered":"2024-09-21T02:42:11.818198+0000","last_clean":"2024-09-21T02:42:11.818198+0000","last_became_active":"2024-09-21T02:39:46.844818+0000","last_became_peered":"2024-09-21T02:39:46.844818+0000","last_unstale":"2024-09-21T02:42:11.818198+0000","last_undegraded":"2024-09-21T02:42:11.818198+0000","last_fullsized":"2024-09-21T02:42:11.818198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.853370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'14","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:37.877367+0000","last_change":"2024-09-21T02:39:43.822226+0000","last_active":"2024-09-21T02:42:37.877367+0000","last_peered":"2024-09-21T02:42:37.877367+0000","last_clean":"2024-09-21T02:42:37.877367+0000","last_became_active":"2024-09-21T02:39:43.821798+0000","last_became_peered":"2024-09-21T02:39:43.821798+0000","last_unstale":"2024-09-21T02:42:37.877367+0000","last_undegraded":"2024-09-21T02:42:37.877367+0000","last_fullsized":"2024-09-21T02:42:37.877367+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:38.822330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342201+0000","last_change":"2024-09-21T02:39:56.919521+0000","last_active":"2024-09-21T02:41:44.342201+0000","last_peered":"2024-09-21T02:41:44.342201+0000","last_clean":"2024-09-21T02:41:44.342201+0000","last_became_active":"2024-09-21T02:39:56.918042+0000","last_became_peered":"2024-09-21T02:39:56.918042+0000","last_unstale":"2024-09-21T02:41:44.342201+0000","last_undegraded":"2024-09-21T02:41:44.342201+0000","last_fullsized":"2024-09-21T02:41:44.342201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:21.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823167+0000","last_change":"2024-09-21T02:39:46.861856+0000","last_active":"2024-09-21T02:42:11.823167+0000","last_peered":"2024-09-21T02:42:11.823167+0000","last_clean":"2024-09-21T02:42:11.823167+0000","last_became_active":"2024-09-21T02:39:46.861416+0000","last_became_peered":"2024-09-21T02:39:46.861416+0000","last_unstale":"2024-09-21T02:42:11.823167+0000","last_undegraded":"2024-09-21T02:42:11.823167+0000","last_fullsized":"2024-09-21T02:42:11.823167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:46.547988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697505+0000","last_change":"2024-09-21T02:39:43.826232+0000","last_active":"2024-09-21T02:41:44.697505+0000","last_peered":"2024-09-21T02:41:44.697505+0000","last_clean":"2024-09-21T02:41:44.697505+0000","last_became_active":"2024-09-21T02:39:43.825789+0000","last_became_peered":"2024-09-21T02:39:43.825789+0000","last_unstale":"2024-09-21T02:41:44.697505+0000","last_undegraded":"2024-09-21T02:41:44.697505+0000","last_fullsized":"2024-09-21T02:41:44.697505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:19.465106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342950+0000","last_change":"2024-09-21T02:39:56.917802+0000","last_active":"2024-09-21T02:41:44.342950+0000","last_peered":"2024-09-21T02:41:44.342950+0000","last_clean":"2024-09-21T02:41:44.342950+0000","last_became_active":"2024-09-21T02:39:56.917286+0000","last_became_peered":"2024-09-21T02:39:56.917286+0000","last_unstale":"2024-09-21T02:41:44.342950+0000","last_undegraded":"2024-09-21T02:41:44.342950+0000","last_fullsized":"2024-09-21T02:41:44.342950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:19.055218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.814958+0000","last_change":"2024-09-21T02:39:46.858829+0000","last_active":"2024-09-21T02:42:11.814958+0000","last_peered":"2024-09-21T02:42:11.814958+0000","last_clean":"2024-09-21T02:42:11.814958+0000","last_became_active":"2024-09-21T02:39:46.858392+0000","last_became_peered":"2024-09-21T02:39:46.858392+0000","last_unstale":"2024-09-21T02:42:11.814958+0000","last_undegraded":"2024-09-21T02:42:11.814958+0000","last_fullsized":"2024-09-21T02:42:11.814958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:29.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348631+0000","last_change":"2024-09-21T02:39:43.825129+0000","last_active":"2024-09-21T02:41:44.348631+0000","last_peered":"2024-09-21T02:41:44.348631+0000","last_clean":"2024-09-21T02:41:44.348631+0000","last_became_active":"2024-09-21T02:39:43.824756+0000","last_became_peered":"2024-09-21T02:39:43.824756+0000","last_unstale":"2024-09-21T02:41:44.348631+0000","last_undegraded":"2024-09-21T02:41:44.348631+0000","last_fullsized":"2024-09-21T02:41:44.348631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:28.771033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696680+0000","last_change":"2024-09-21T02:39:56.929186+0000","last_active":"2024-09-21T02:41:44.696680+0000","last_peered":"2024-09-21T02:41:44.696680+0000","last_clean":"2024-09-21T02:41:44.696680+0000","last_became_active":"2024-09-21T02:39:56.928608+0000","last_became_peered":"2024-09-21T02:39:56.928608+0000","last_unstale":"2024-09-21T02:41:44.696680+0000","last_undegraded":"2024-09-21T02:41:44.696680+0000","last_fullsized":"2024-09-21T02:41:44.696680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:47.860230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819801+0000","last_change":"2024-09-21T02:39:46.860375+0000","last_active":"2024-09-21T02:42:11.819801+0000","last_peered":"2024-09-21T02:42:11.819801+0000","last_clean":"2024-09-21T02:42:11.819801+0000","last_became_active":"2024-09-21T02:39:46.860035+0000","last_became_peered":"2024-09-21T02:39:46.860035+0000","last_unstale":"2024-09-21T02:42:11.819801+0000","last_undegraded":"2024-09-21T02:42:11.819801+0000","last_fullsized":"2024-09-21T02:42:11.819801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:07.761203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346270+0000","last_change":"2024-09-21T02:39:43.827869+0000","last_active":"2024-09-21T02:41:44.346270+0000","last_peered":"2024-09-21T02:41:44.346270+0000","last_clean":"2024-09-21T02:41:44.346270+0000","last_became_active":"2024-09-21T02:39:43.827375+0000","last_became_peered":"2024-09-21T02:39:43.827375+0000","last_unstale":"2024-09-21T02:41:44.346270+0000","last_undegraded":"2024-09-21T02:41:44.346270+0000","last_fullsized":"2024-09-21T02:41:44.346270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:48.257387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346779+0000","last_change":"2024-09-21T02:39:56.917766+0000","last_active":"2024-09-21T02:41:44.346779+0000","last_peered":"2024-09-21T02:41:44.346779+0000","last_clean":"2024-09-21T02:41:44.346779+0000","last_became_active":"2024-09-21T02:39:56.917309+0000","last_became_peered":"2024-09-21T02:39:56.917309+0000","last_unstale":"2024-09-21T02:41:44.346779+0000","last_undegraded":"2024-09-21T02:41:44.346779+0000","last_fullsized":"2024-09-21T02:41:44.346779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:36.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.816648+0000","last_change":"2024-09-21T02:39:46.851416+0000","last_active":"2024-09-21T02:42:11.816648+0000","last_peered":"2024-09-21T02:42:11.816648+0000","last_clean":"2024-09-21T02:42:11.816648+0000","last_became_active":"2024-09-21T02:39:46.851055+0000","last_became_peered":"2024-09-21T02:39:46.851055+0000","last_unstale":"2024-09-21T02:42:11.816648+0000","last_undegraded":"2024-09-21T02:42:11.816648+0000","last_fullsized":"2024-09-21T02:42:11.816648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:50.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:39.599786+0000","last_change":"2024-09-21T02:39:43.825162+0000","last_active":"2024-09-21T02:42:39.599786+0000","last_peered":"2024-09-21T02:42:39.599786+0000","last_clean":"2024-09-21T02:42:39.599786+0000","last_became_active":"2024-09-21T02:39:43.824811+0000","last_became_peered":"2024-09-21T02:39:43.824811+0000","last_unstale":"2024-09-21T02:42:39.599786+0000","last_undegraded":"2024-09-21T02:42:39.599786+0000","last_fullsized":"2024-09-21T02:42:39.599786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:10.020902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346813+0000","last_change":"2024-09-21T02:39:56.920750+0000","last_active":"2024-09-21T02:41:44.346813+0000","last_peered":"2024-09-21T02:41:44.346813+0000","last_clean":"2024-09-21T02:41:44.346813+0000","last_became_active":"2024-09-21T02:39:56.920245+0000","last_became_peered":"2024-09-21T02:39:56.920245+0000","last_unstale":"2024-09-21T02:41:44.346813+0000","last_undegraded":"2024-09-21T02:41:44.346813+0000","last_fullsized":"2024-09-21T02:41:44.346813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:53.718596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.816452+0000","last_change":"2024-09-21T02:39:46.854202+0000","last_active":"2024-09-21T02:42:11.816452+0000","last_peered":"2024-09-21T02:42:11.816452+0000","last_clean":"2024-09-21T02:42:11.816452+0000","last_became_active":"2024-09-21T02:39:46.853076+0000","last_became_peered":"2024-09-21T02:39:46.853076+0000","last_unstale":"2024-09-21T02:42:11.816452+0000","last_undegraded":"2024-09-21T02:42:11.816452+0000","last_fullsized":"2024-09-21T02:42:11.816452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:59.729777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345691+0000","last_change":"2024-09-21T02:39:43.826351+0000","last_active":"2024-09-21T02:41:44.345691+0000","last_peered":"2024-09-21T02:41:44.345691+0000","last_clean":"2024-09-21T02:41:44.345691+0000","last_became_active":"2024-09-21T02:39:43.825683+0000","last_became_peered":"2024-09-21T02:39:43.825683+0000","last_unstale":"2024-09-21T02:41:44.345691+0000","last_undegraded":"2024-09-21T02:41:44.345691+0000","last_fullsized":"2024-09-21T02:41:44.345691+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:16.934280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348917+0000","last_change":"2024-09-21T02:39:56.937591+0000","last_active":"2024-09-21T02:41:44.348917+0000","last_peered":"2024-09-21T02:41:44.348917+0000","last_clean":"2024-09-21T02:41:44.348917+0000","last_became_active":"2024-09-21T02:39:56.937178+0000","last_became_peered":"2024-09-21T02:39:56.937178+0000","last_unstale":"2024-09-21T02:41:44.348917+0000","last_undegraded":"2024-09-21T02:41:44.348917+0000","last_fullsized":"2024-09-21T02:41:44.348917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:21.218393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830551+0000","last_change":"2024-09-21T02:39:46.858255+0000","last_active":"2024-09-21T02:42:11.830551+0000","last_peered":"2024-09-21T02:42:11.830551+0000","last_clean":"2024-09-21T02:42:11.830551+0000","last_became_active":"2024-09-21T02:39:46.856726+0000","last_became_peered":"2024-09-21T02:39:46.856726+0000","last_unstale":"2024-09-21T02:42:11.830551+0000","last_undegraded":"2024-09-21T02:42:11.830551+0000","last_fullsized":"2024-09-21T02:42:11.830551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:33.890538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487791+0000","last_change":"2024-09-21T02:39:43.823562+0000","last_active":"2024-09-21T02:41:44.487791+0000","last_peered":"2024-09-21T02:41:44.487791+0000","last_clean":"2024-09-21T02:41:44.487791+0000","last_became_active":"2024-09-21T02:39:43.823142+0000","last_became_peered":"2024-09-21T02:39:43.823142+0000","last_unstale":"2024-09-21T02:41:44.487791+0000","last_undegraded":"2024-09-21T02:41:44.487791+0000","last_fullsized":"2024-09-21T02:41:44.487791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:36.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345775+0000","last_change":"2024-09-21T02:38:27.972237+0000","last_active":"2024-09-21T02:41:44.345775+0000","last_peered":"2024-09-21T02:41:44.345775+0000","last_clean":"2024-09-21T02:41:44.345775+0000","last_became_active":"2024-09-21T02:38:27.966297+0000","last_became_peered":"2024-09-21T02:38:27.966297+0000","last_unstale":"2024-09-21T02:41:44.345775+0000","last_undegraded":"2024-09-21T02:41:44.345775+0000","last_fullsized":"2024-09-21T02:41:44.345775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_clean_scrub_stamp":"2024-09-21T02:34:42.292034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:24.592682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.702822+0000","last_change":"2024-09-21T02:41:44.702415+0000","last_active":"2024-09-21T02:41:44.702822+0000","last_peered":"2024-09-21T02:41:44.702822+0000","last_clean":"2024-09-21T02:41:44.702822+0000","last_became_active":"2024-09-21T02:41:44.698199+0000","last_became_peered":"2024-09-21T02:41:44.698199+0000","last_unstale":"2024-09-21T02:41:44.702822+0000","last_undegraded":"2024-09-21T02:41:44.702822+0000","last_fullsized":"2024-09-21T02:41:44.702822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:03.191052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.835131+0000","last_change":"2024-09-21T02:39:46.851466+0000","last_active":"2024-09-21T02:42:11.835131+0000","last_peered":"2024-09-21T02:42:11.835131+0000","last_clean":"2024-09-21T02:42:11.835131+0000","last_became_active":"2024-09-21T02:39:46.849945+0000","last_became_peered":"2024-09-21T02:39:46.849945+0000","last_unstale":"2024-09-21T02:42:11.835131+0000","last_undegraded":"2024-09-21T02:42:11.835131+0000","last_fullsized":"2024-09-21T02:42:11.835131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:07.424794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345165+0000","last_change":"2024-09-21T02:39:43.840894+0000","last_active":"2024-09-21T02:41:44.345165+0000","last_peered":"2024-09-21T02:41:44.345165+0000","last_clean":"2024-09-21T02:41:44.345165+0000","last_became_active":"2024-09-21T02:39:43.840437+0000","last_became_peered":"2024-09-21T02:39:43.840437+0000","last_unstale":"2024-09-21T02:41:44.345165+0000","last_undegraded":"2024-09-21T02:41:44.345165+0000","last_fullsized":"2024-09-21T02:41:44.345165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:31.741218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486908+0000","last_change":"2024-09-21T02:39:56.924563+0000","last_active":"2024-09-21T02:41:44.486908+0000","last_peered":"2024-09-21T02:41:44.486908+0000","last_clean":"2024-09-21T02:41:44.486908+0000","last_became_active":"2024-09-21T02:39:56.923791+0000","last_became_peered":"2024-09-21T02:39:56.923791+0000","last_unstale":"2024-09-21T02:41:44.486908+0000","last_undegraded":"2024-09-21T02:41:44.486908+0000","last_fullsized":"2024-09-21T02:41:44.486908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:03.409737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822963+0000","last_change":"2024-09-21T02:39:46.858712+0000","last_active":"2024-09-21T02:42:11.822963+0000","last_peered":"2024-09-21T02:42:11.822963+0000","last_clean":"2024-09-21T02:42:11.822963+0000","last_became_active":"2024-09-21T02:39:46.858339+0000","last_became_peered":"2024-09-21T02:39:46.858339+0000","last_unstale":"2024-09-21T02:42:11.822963+0000","last_undegraded":"2024-09-21T02:42:11.822963+0000","last_fullsized":"2024-09-21T02:42:11.822963+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.015904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.349194+0000","last_change":"2024-09-21T02:39:43.829127+0000","last_active":"2024-09-21T02:41:44.349194+0000","last_peered":"2024-09-21T02:41:44.349194+0000","last_clean":"2024-09-21T02:41:44.349194+0000","last_became_active":"2024-09-21T02:39:43.828136+0000","last_became_peered":"2024-09-21T02:39:43.828136+0000","last_unstale":"2024-09-21T02:41:44.349194+0000","last_undegraded":"2024-09-21T02:41:44.349194+0000","last_fullsized":"2024-09-21T02:41:44.349194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:39.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486621+0000","last_change":"2024-09-21T02:39:56.930823+0000","last_active":"2024-09-21T02:41:44.486621+0000","last_peered":"2024-09-21T02:41:44.486621+0000","last_clean":"2024-09-21T02:41:44.486621+0000","last_became_active":"2024-09-21T02:39:56.930379+0000","last_became_peered":"2024-09-21T02:39:56.930379+0000","last_unstale":"2024-09-21T02:41:44.486621+0000","last_undegraded":"2024-09-21T02:41:44.486621+0000","last_fullsized":"2024-09-21T02:41:44.486621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:01.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.832118+0000","last_change":"2024-09-21T02:39:46.846873+0000","last_active":"2024-09-21T02:42:11.832118+0000","last_peered":"2024-09-21T02:42:11.832118+0000","last_clean":"2024-09-21T02:42:11.832118+0000","last_became_active":"2024-09-21T02:39:46.846502+0000","last_became_peered":"2024-09-21T02:39:46.846502+0000","last_unstale":"2024-09-21T02:42:11.832118+0000","last_undegraded":"2024-09-21T02:42:11.832118+0000","last_fullsized":"2024-09-21T02:42:11.832118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:20.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346975+0000","last_change":"2024-09-21T02:39:43.832273+0000","last_active":"2024-09-21T02:41:44.346975+0000","last_peered":"2024-09-21T02:41:44.346975+0000","last_clean":"2024-09-21T02:41:44.346975+0000","last_became_active":"2024-09-21T02:39:43.831705+0000","last_became_peered":"2024-09-21T02:39:43.831705+0000","last_unstale":"2024-09-21T02:41:44.346975+0000","last_undegraded":"2024-09-21T02:41:44.346975+0000","last_fullsized":"2024-09-21T02:41:44.346975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:31.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348025+0000","last_change":"2024-09-21T02:39:56.920277+0000","last_active":"2024-09-21T02:41:44.348025+0000","last_peered":"2024-09-21T02:41:44.348025+0000","last_clean":"2024-09-21T02:41:44.348025+0000","last_became_active":"2024-09-21T02:39:56.919885+0000","last_became_peered":"2024-09-21T02:39:56.919885+0000","last_unstale":"2024-09-21T02:41:44.348025+0000","last_undegraded":"2024-09-21T02:41:44.348025+0000","last_fullsized":"2024-09-21T02:41:44.348025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:32.750878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819927+0000","last_change":"2024-09-21T02:40:43.413459+0000","last_active":"2024-09-21T02:42:11.819927+0000","last_peered":"2024-09-21T02:42:11.819927+0000","last_clean":"2024-09-21T02:42:11.819927+0000","last_became_active":"2024-09-21T02:40:43.413012+0000","last_became_peered":"2024-09-21T02:40:43.413012+0000","last_unstale":"2024-09-21T02:42:11.819927+0000","last_undegraded":"2024-09-21T02:42:11.819927+0000","last_fullsized":"2024-09-21T02:42:11.819927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:23.971450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697477+0000","last_change":"2024-09-21T02:39:43.821955+0000","last_active":"2024-09-21T02:41:44.697477+0000","last_peered":"2024-09-21T02:41:44.697477+0000","last_clean":"2024-09-21T02:41:44.697477+0000","last_became_active":"2024-09-21T02:39:43.820480+0000","last_became_peered":"2024-09-21T02:39:43.820480+0000","last_unstale":"2024-09-21T02:41:44.697477+0000","last_undegraded":"2024-09-21T02:41:44.697477+0000","last_fullsized":"2024-09-21T02:41:44.697477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:51.201528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348049+0000","last_change":"2024-09-21T02:39:56.922017+0000","last_active":"2024-09-21T02:41:44.348049+0000","last_peered":"2024-09-21T02:41:44.348049+0000","last_clean":"2024-09-21T02:41:44.348049+0000","last_became_active":"2024-09-21T02:39:56.921616+0000","last_became_peered":"2024-09-21T02:39:56.921616+0000","last_unstale":"2024-09-21T02:41:44.348049+0000","last_undegraded":"2024-09-21T02:41:44.348049+0000","last_fullsized":"2024-09-21T02:41:44.348049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:38.499302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818794+0000","last_change":"2024-09-21T02:39:46.855445+0000","last_active":"2024-09-21T02:42:11.818794+0000","last_peered":"2024-09-21T02:42:11.818794+0000","last_clean":"2024-09-21T02:42:11.818794+0000","last_became_active":"2024-09-21T02:39:46.855053+0000","last_became_peered":"2024-09-21T02:39:46.855053+0000","last_unstale":"2024-09-21T02:42:11.818794+0000","last_undegraded":"2024-09-21T02:42:11.818794+0000","last_fullsized":"2024-09-21T02:42:11.818794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:19.122862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696637+0000","last_change":"2024-09-21T02:39:43.822744+0000","last_active":"2024-09-21T02:41:44.696637+0000","last_peered":"2024-09-21T02:41:44.696637+0000","last_clean":"2024-09-21T02:41:44.696637+0000","last_became_active":"2024-09-21T02:39:43.822339+0000","last_became_peered":"2024-09-21T02:39:43.822339+0000","last_unstale":"2024-09-21T02:41:44.696637+0000","last_undegraded":"2024-09-21T02:41:44.696637+0000","last_fullsized":"2024-09-21T02:41:44.696637+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:21.370224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346987+0000","last_change":"2024-09-21T02:39:56.929280+0000","last_active":"2024-09-21T02:41:44.346987+0000","last_peered":"2024-09-21T02:41:44.346987+0000","last_clean":"2024-09-21T02:41:44.346987+0000","last_became_active":"2024-09-21T02:39:56.928826+0000","last_became_peered":"2024-09-21T02:39:56.928826+0000","last_unstale":"2024-09-21T02:41:44.346987+0000","last_undegraded":"2024-09-21T02:41:44.346987+0000","last_fullsized":"2024-09-21T02:41:44.346987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:01.597772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.829790+0000","last_change":"2024-09-21T02:39:46.852466+0000","last_active":"2024-09-21T02:42:11.829790+0000","last_peered":"2024-09-21T02:42:11.829790+0000","last_clean":"2024-09-21T02:42:11.829790+0000","last_became_active":"2024-09-21T02:39:46.852113+0000","last_became_peered":"2024-09-21T02:39:46.852113+0000","last_unstale":"2024-09-21T02:42:11.829790+0000","last_undegraded":"2024-09-21T02:42:11.829790+0000","last_fullsized":"2024-09-21T02:42:11.829790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:26.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:39.600642+0000","last_change":"2024-09-21T02:39:43.822241+0000","last_active":"2024-09-21T02:42:39.600642+0000","last_peered":"2024-09-21T02:42:39.600642+0000","last_clean":"2024-09-21T02:42:39.600642+0000","last_became_active":"2024-09-21T02:39:43.820813+0000","last_became_peered":"2024-09-21T02:39:43.820813+0000","last_unstale":"2024-09-21T02:42:39.600642+0000","last_undegraded":"2024-09-21T02:42:39.600642+0000","last_fullsized":"2024-09-21T02:42:39.600642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:09.749207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697239+0000","last_change":"2024-09-21T02:40:43.405942+0000","last_active":"2024-09-21T02:41:44.697239+0000","last_peered":"2024-09-21T02:41:44.697239+0000","last_clean":"2024-09-21T02:41:44.697239+0000","last_became_active":"2024-09-21T02:40:43.405455+0000","last_became_peered":"2024-09-21T02:40:43.405455+0000","last_unstale":"2024-09-21T02:41:44.697239+0000","last_undegraded":"2024-09-21T02:41:44.697239+0000","last_fullsized":"2024-09-21T02:41:44.697239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:28.594724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833646+0000","last_change":"2024-09-21T02:40:43.417498+0000","last_active":"2024-09-21T02:42:11.833646+0000","last_peered":"2024-09-21T02:42:11.833646+0000","last_clean":"2024-09-21T02:42:11.833646+0000","last_became_active":"2024-09-21T02:40:43.417203+0000","last_became_peered":"2024-09-21T02:40:43.417203+0000","last_unstale":"2024-09-21T02:42:11.833646+0000","last_undegraded":"2024-09-21T02:42:11.833646+0000","last_fullsized":"2024-09-21T02:42:11.833646+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:43.618931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348740+0000","last_change":"2024-09-21T02:39:43.827493+0000","last_active":"2024-09-21T02:41:44.348740+0000","last_peered":"2024-09-21T02:41:44.348740+0000","last_clean":"2024-09-21T02:41:44.348740+0000","last_became_active":"2024-09-21T02:39:43.826824+0000","last_became_peered":"2024-09-21T02:39:43.826824+0000","last_unstale":"2024-09-21T02:41:44.348740+0000","last_undegraded":"2024-09-21T02:41:44.348740+0000","last_fullsized":"2024-09-21T02:41:44.348740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:21.320101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343157+0000","last_change":"2024-09-21T02:39:56.929122+0000","last_active":"2024-09-21T02:41:44.343157+0000","last_peered":"2024-09-21T02:41:44.343157+0000","last_clean":"2024-09-21T02:41:44.343157+0000","last_became_active":"2024-09-21T02:39:56.928633+0000","last_became_peered":"2024-09-21T02:39:56.928633+0000","last_unstale":"2024-09-21T02:41:44.343157+0000","last_undegraded":"2024-09-21T02:41:44.343157+0000","last_fullsized":"2024-09-21T02:41:44.343157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:56.599982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.815820+0000","last_change":"2024-09-21T02:39:46.866922+0000","last_active":"2024-09-21T02:42:11.815820+0000","last_peered":"2024-09-21T02:42:11.815820+0000","last_clean":"2024-09-21T02:42:11.815820+0000","last_became_active":"2024-09-21T02:39:46.866061+0000","last_became_peered":"2024-09-21T02:39:46.866061+0000","last_unstale":"2024-09-21T02:42:11.815820+0000","last_undegraded":"2024-09-21T02:42:11.815820+0000","last_fullsized":"2024-09-21T02:42:11.815820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:02.707212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344889+0000","last_change":"2024-09-21T02:39:43.824188+0000","last_active":"2024-09-21T02:41:44.344889+0000","last_peered":"2024-09-21T02:41:44.344889+0000","last_clean":"2024-09-21T02:41:44.344889+0000","last_became_active":"2024-09-21T02:39:43.823760+0000","last_became_peered":"2024-09-21T02:39:43.823760+0000","last_unstale":"2024-09-21T02:41:44.344889+0000","last_undegraded":"2024-09-21T02:41:44.344889+0000","last_fullsized":"2024-09-21T02:41:44.344889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:56.770947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348930+0000","last_change":"2024-09-21T02:39:56.920213+0000","last_active":"2024-09-21T02:41:44.348930+0000","last_peered":"2024-09-21T02:41:44.348930+0000","last_clean":"2024-09-21T02:41:44.348930+0000","last_became_active":"2024-09-21T02:39:56.919796+0000","last_became_peered":"2024-09-21T02:39:56.919796+0000","last_unstale":"2024-09-21T02:41:44.348930+0000","last_undegraded":"2024-09-21T02:41:44.348930+0000","last_fullsized":"2024-09-21T02:41:44.348930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:32.162844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820668+0000","last_change":"2024-09-21T02:39:46.846759+0000","last_active":"2024-09-21T02:42:11.820668+0000","last_peered":"2024-09-21T02:42:11.820668+0000","last_clean":"2024-09-21T02:42:11.820668+0000","last_became_active":"2024-09-21T02:39:46.846315+0000","last_became_peered":"2024-09-21T02:39:46.846315+0000","last_unstale":"2024-09-21T02:42:11.820668+0000","last_undegraded":"2024-09-21T02:42:11.820668+0000","last_fullsized":"2024-09-21T02:42:11.820668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:41.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'39","reported_seq":332,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:40.603607+0000","last_change":"2024-09-21T02:39:43.824564+0000","last_active":"2024-09-21T02:42:40.603607+0000","last_peered":"2024-09-21T02:42:40.603607+0000","last_clean":"2024-09-21T02:42:40.603607+0000","last_became_active":"2024-09-21T02:39:43.824190+0000","last_became_peered":"2024-09-21T02:39:43.824190+0000","last_unstale":"2024-09-21T02:42:40.603607+0000","last_undegraded":"2024-09-21T02:42:40.603607+0000","last_fullsized":"2024-09-21T02:42:40.603607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:45.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74958,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":247,"num_read_kb":197,"num_write":40,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348367+0000","last_change":"2024-09-21T02:39:56.928936+0000","last_active":"2024-09-21T02:41:44.348367+0000","last_peered":"2024-09-21T02:41:44.348367+0000","last_clean":"2024-09-21T02:41:44.348367+0000","last_became_active":"2024-09-21T02:39:56.927999+0000","last_became_peered":"2024-09-21T02:39:56.927999+0000","last_unstale":"2024-09-21T02:41:44.348367+0000","last_undegraded":"2024-09-21T02:41:44.348367+0000","last_fullsized":"2024-09-21T02:41:44.348367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:33.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833671+0000","last_change":"2024-09-21T02:39:46.860572+0000","last_active":"2024-09-21T02:42:11.833671+0000","last_peered":"2024-09-21T02:42:11.833671+0000","last_clean":"2024-09-21T02:42:11.833671+0000","last_became_active":"2024-09-21T02:39:46.860073+0000","last_became_peered":"2024-09-21T02:39:46.860073+0000","last_unstale":"2024-09-21T02:42:11.833671+0000","last_undegraded":"2024-09-21T02:42:11.833671+0000","last_fullsized":"2024-09-21T02:42:11.833671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:48.355107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.349149+0000","last_change":"2024-09-21T02:39:43.828437+0000","last_active":"2024-09-21T02:41:44.349149+0000","last_peered":"2024-09-21T02:41:44.349149+0000","last_clean":"2024-09-21T02:41:44.349149+0000","last_became_active":"2024-09-21T02:39:43.828033+0000","last_became_peered":"2024-09-21T02:39:43.828033+0000","last_unstale":"2024-09-21T02:41:44.349149+0000","last_undegraded":"2024-09-21T02:41:44.349149+0000","last_fullsized":"2024-09-21T02:41:44.349149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:24.065773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487351+0000","last_change":"2024-09-21T02:39:56.937714+0000","last_active":"2024-09-21T02:41:44.487351+0000","last_peered":"2024-09-21T02:41:44.487351+0000","last_clean":"2024-09-21T02:41:44.487351+0000","last_became_active":"2024-09-21T02:39:56.937145+0000","last_became_peered":"2024-09-21T02:39:56.937145+0000","last_unstale":"2024-09-21T02:41:44.487351+0000","last_undegraded":"2024-09-21T02:41:44.487351+0000","last_fullsized":"2024-09-21T02:41:44.487351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:59.265795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.826005+0000","last_change":"2024-09-21T02:39:46.864600+0000","last_active":"2024-09-21T02:42:11.826005+0000","last_peered":"2024-09-21T02:42:11.826005+0000","last_clean":"2024-09-21T02:42:11.826005+0000","last_became_active":"2024-09-21T02:39:46.862043+0000","last_became_peered":"2024-09-21T02:39:46.862043+0000","last_unstale":"2024-09-21T02:42:11.826005+0000","last_undegraded":"2024-09-21T02:42:11.826005+0000","last_fullsized":"2024-09-21T02:42:11.826005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.119974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346236+0000","last_change":"2024-09-21T02:39:43.825910+0000","last_active":"2024-09-21T02:41:44.346236+0000","last_peered":"2024-09-21T02:41:44.346236+0000","last_clean":"2024-09-21T02:41:44.346236+0000","last_became_active":"2024-09-21T02:39:43.825370+0000","last_became_peered":"2024-09-21T02:39:43.825370+0000","last_unstale":"2024-09-21T02:41:44.346236+0000","last_undegraded":"2024-09-21T02:41:44.346236+0000","last_fullsized":"2024-09-21T02:41:44.346236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:05.410114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348035+0000","last_change":"2024-09-21T02:39:56.935321+0000","last_active":"2024-09-21T02:41:44.348035+0000","last_peered":"2024-09-21T02:41:44.348035+0000","last_clean":"2024-09-21T02:41:44.348035+0000","last_became_active":"2024-09-21T02:39:56.931669+0000","last_became_peered":"2024-09-21T02:39:56.931669+0000","last_unstale":"2024-09-21T02:41:44.348035+0000","last_undegraded":"2024-09-21T02:41:44.348035+0000","last_fullsized":"2024-09-21T02:41:44.348035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:20.323574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.832138+0000","last_change":"2024-09-21T02:39:46.853469+0000","last_active":"2024-09-21T02:42:11.832138+0000","last_peered":"2024-09-21T02:42:11.832138+0000","last_clean":"2024-09-21T02:42:11.832138+0000","last_became_active":"2024-09-21T02:39:46.853133+0000","last_became_peered":"2024-09-21T02:39:46.853133+0000","last_unstale":"2024-09-21T02:42:11.832138+0000","last_undegraded":"2024-09-21T02:42:11.832138+0000","last_fullsized":"2024-09-21T02:42:11.832138+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.055341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":170,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:39.600900+0000","last_change":"2024-09-21T02:39:43.828678+0000","last_active":"2024-09-21T02:42:39.600900+0000","last_peered":"2024-09-21T02:42:39.600900+0000","last_clean":"2024-09-21T02:42:39.600900+0000","last_became_active":"2024-09-21T02:39:43.828281+0000","last_became_peered":"2024-09-21T02:39:43.828281+0000","last_unstale":"2024-09-21T02:42:39.600900+0000","last_undegraded":"2024-09-21T02:42:39.600900+0000","last_fullsized":"2024-09-21T02:42:39.600900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:42.678028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342305+0000","last_change":"2024-09-21T02:39:56.920489+0000","last_active":"2024-09-21T02:41:44.342305+0000","last_peered":"2024-09-21T02:41:44.342305+0000","last_clean":"2024-09-21T02:41:44.342305+0000","last_became_active":"2024-09-21T02:39:56.920031+0000","last_became_peered":"2024-09-21T02:39:56.920031+0000","last_unstale":"2024-09-21T02:41:44.342305+0000","last_undegraded":"2024-09-21T02:41:44.342305+0000","last_fullsized":"2024-09-21T02:41:44.342305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:56.576113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486936+0000","last_change":"2024-09-21T02:39:56.922470+0000","last_active":"2024-09-21T02:41:44.486936+0000","last_peered":"2024-09-21T02:41:44.486936+0000","last_clean":"2024-09-21T02:41:44.486936+0000","last_became_active":"2024-09-21T02:39:56.922014+0000","last_became_peered":"2024-09-21T02:39:56.922014+0000","last_unstale":"2024-09-21T02:41:44.486936+0000","last_undegraded":"2024-09-21T02:41:44.486936+0000","last_fullsized":"2024-09-21T02:41:44.486936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:25.307835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812435+0000","last_change":"2024-09-21T02:39:46.852869+0000","last_active":"2024-09-21T02:42:11.812435+0000","last_peered":"2024-09-21T02:42:11.812435+0000","last_clean":"2024-09-21T02:42:11.812435+0000","last_became_active":"2024-09-21T02:39:46.852237+0000","last_became_peered":"2024-09-21T02:39:46.852237+0000","last_unstale":"2024-09-21T02:42:11.812435+0000","last_undegraded":"2024-09-21T02:42:11.812435+0000","last_fullsized":"2024-09-21T02:42:11.812435+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:10.729381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348373+0000","last_change":"2024-09-21T02:39:43.827358+0000","last_active":"2024-09-21T02:41:44.348373+0000","last_peered":"2024-09-21T02:41:44.348373+0000","last_clean":"2024-09-21T02:41:44.348373+0000","last_became_active":"2024-09-21T02:39:43.826910+0000","last_became_peered":"2024-09-21T02:39:43.826910+0000","last_unstale":"2024-09-21T02:41:44.348373+0000","last_undegraded":"2024-09-21T02:41:44.348373+0000","last_fullsized":"2024-09-21T02:41:44.348373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:48.528314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343598+0000","last_change":"2024-09-21T02:39:56.930809+0000","last_active":"2024-09-21T02:41:44.343598+0000","last_peered":"2024-09-21T02:41:44.343598+0000","last_clean":"2024-09-21T02:41:44.343598+0000","last_became_active":"2024-09-21T02:39:56.930355+0000","last_became_peered":"2024-09-21T02:39:56.930355+0000","last_unstale":"2024-09-21T02:41:44.343598+0000","last_undegraded":"2024-09-21T02:41:44.343598+0000","last_fullsized":"2024-09-21T02:41:44.343598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:41.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823944+0000","last_change":"2024-09-21T02:39:46.856046+0000","last_active":"2024-09-21T02:42:11.823944+0000","last_peered":"2024-09-21T02:42:11.823944+0000","last_clean":"2024-09-21T02:42:11.823944+0000","last_became_active":"2024-09-21T02:39:46.855675+0000","last_became_peered":"2024-09-21T02:39:46.855675+0000","last_unstale":"2024-09-21T02:42:11.823944+0000","last_undegraded":"2024-09-21T02:42:11.823944+0000","last_fullsized":"2024-09-21T02:42:11.823944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.547082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346460+0000","last_change":"2024-09-21T02:39:43.828888+0000","last_active":"2024-09-21T02:41:44.346460+0000","last_peered":"2024-09-21T02:41:44.346460+0000","last_clean":"2024-09-21T02:41:44.346460+0000","last_became_active":"2024-09-21T02:39:43.828340+0000","last_became_peered":"2024-09-21T02:39:43.828340+0000","last_unstale":"2024-09-21T02:41:44.346460+0000","last_undegraded":"2024-09-21T02:41:44.346460+0000","last_fullsized":"2024-09-21T02:41:44.346460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:09.017191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487223+0000","last_change":"2024-09-21T02:39:43.828957+0000","last_active":"2024-09-21T02:41:44.487223+0000","last_peered":"2024-09-21T02:41:44.487223+0000","last_clean":"2024-09-21T02:41:44.487223+0000","last_became_active":"2024-09-21T02:39:43.827899+0000","last_became_peered":"2024-09-21T02:39:43.827899+0000","last_unstale":"2024-09-21T02:41:44.487223+0000","last_undegraded":"2024-09-21T02:41:44.487223+0000","last_fullsized":"2024-09-21T02:41:44.487223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:36.727082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.827569+0000","last_change":"2024-09-21T02:39:46.855278+0000","last_active":"2024-09-21T02:42:11.827569+0000","last_peered":"2024-09-21T02:42:11.827569+0000","last_clean":"2024-09-21T02:42:11.827569+0000","last_became_active":"2024-09-21T02:39:46.854905+0000","last_became_peered":"2024-09-21T02:39:46.854905+0000","last_unstale":"2024-09-21T02:42:11.827569+0000","last_undegraded":"2024-09-21T02:42:11.827569+0000","last_fullsized":"2024-09-21T02:42:11.827569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.244912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344742+0000","last_change":"2024-09-21T02:39:56.931183+0000","last_active":"2024-09-21T02:41:44.344742+0000","last_peered":"2024-09-21T02:41:44.344742+0000","last_clean":"2024-09-21T02:41:44.344742+0000","last_became_active":"2024-09-21T02:39:56.930776+0000","last_became_peered":"2024-09-21T02:39:56.930776+0000","last_unstale":"2024-09-21T02:41:44.344742+0000","last_undegraded":"2024-09-21T02:41:44.344742+0000","last_fullsized":"2024-09-21T02:41:44.344742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:56.272272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'9","reported_seq":180,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:39.602350+0000","last_change":"2024-09-21T02:39:43.823668+0000","last_active":"2024-09-21T02:42:39.602350+0000","last_peered":"2024-09-21T02:42:39.602350+0000","last_clean":"2024-09-21T02:42:39.602350+0000","last_became_active":"2024-09-21T02:39:43.823132+0000","last_became_peered":"2024-09-21T02:39:43.823132+0000","last_unstale":"2024-09-21T02:42:39.602350+0000","last_undegraded":"2024-09-21T02:42:39.602350+0000","last_fullsized":"2024-09-21T02:42:39.602350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:33.187554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1856,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822148+0000","last_change":"2024-09-21T02:39:46.845740+0000","last_active":"2024-09-21T02:42:11.822148+0000","last_peered":"2024-09-21T02:42:11.822148+0000","last_clean":"2024-09-21T02:42:11.822148+0000","last_became_active":"2024-09-21T02:39:46.845361+0000","last_became_peered":"2024-09-21T02:39:46.845361+0000","last_unstale":"2024-09-21T02:42:11.822148+0000","last_undegraded":"2024-09-21T02:42:11.822148+0000","last_fullsized":"2024-09-21T02:42:11.822148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.546769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344941+0000","last_change":"2024-09-21T02:39:56.919760+0000","last_active":"2024-09-21T02:41:44.344941+0000","last_peered":"2024-09-21T02:41:44.344941+0000","last_clean":"2024-09-21T02:41:44.344941+0000","last_became_active":"2024-09-21T02:39:56.919315+0000","last_became_peered":"2024-09-21T02:39:56.919315+0000","last_unstale":"2024-09-21T02:41:44.344941+0000","last_undegraded":"2024-09-21T02:41:44.344941+0000","last_fullsized":"2024-09-21T02:41:44.344941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:52.889707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823082+0000","last_change":"2024-09-21T02:39:46.848040+0000","last_active":"2024-09-21T02:42:11.823082+0000","last_peered":"2024-09-21T02:42:11.823082+0000","last_clean":"2024-09-21T02:42:11.823082+0000","last_became_active":"2024-09-21T02:39:46.847627+0000","last_became_peered":"2024-09-21T02:39:46.847627+0000","last_unstale":"2024-09-21T02:42:11.823082+0000","last_undegraded":"2024-09-21T02:42:11.823082+0000","last_fullsized":"2024-09-21T02:42:11.823082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:14.139156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.814594+0000","last_change":"2024-09-21T02:39:46.853208+0000","last_active":"2024-09-21T02:42:11.814594+0000","last_peered":"2024-09-21T02:42:11.814594+0000","last_clean":"2024-09-21T02:42:11.814594+0000","last_became_active":"2024-09-21T02:39:46.852821+0000","last_became_peered":"2024-09-21T02:39:46.852821+0000","last_unstale":"2024-09-21T02:42:11.814594+0000","last_undegraded":"2024-09-21T02:42:11.814594+0000","last_fullsized":"2024-09-21T02:42:11.814594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:24.597702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.817363+0000","last_change":"2024-09-21T02:39:46.866239+0000","last_active":"2024-09-21T02:42:11.817363+0000","last_peered":"2024-09-21T02:42:11.817363+0000","last_clean":"2024-09-21T02:42:11.817363+0000","last_became_active":"2024-09-21T02:39:46.865935+0000","last_became_peered":"2024-09-21T02:39:46.865935+0000","last_unstale":"2024-09-21T02:42:11.817363+0000","last_undegraded":"2024-09-21T02:42:11.817363+0000","last_fullsized":"2024-09-21T02:42:11.817363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.420521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.827231+0000","last_change":"2024-09-21T02:39:46.861857+0000","last_active":"2024-09-21T02:42:11.827231+0000","last_peered":"2024-09-21T02:42:11.827231+0000","last_clean":"2024-09-21T02:42:11.827231+0000","last_became_active":"2024-09-21T02:39:46.861512+0000","last_became_peered":"2024-09-21T02:39:46.861512+0000","last_unstale":"2024-09-21T02:42:11.827231+0000","last_undegraded":"2024-09-21T02:42:11.827231+0000","last_fullsized":"2024-09-21T02:42:11.827231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.044159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824496+0000","last_change":"2024-09-21T02:39:46.858655+0000","last_active":"2024-09-21T02:42:11.824496+0000","last_peered":"2024-09-21T02:42:11.824496+0000","last_clean":"2024-09-21T02:42:11.824496+0000","last_became_active":"2024-09-21T02:39:46.858376+0000","last_became_peered":"2024-09-21T02:39:46.858376+0000","last_unstale":"2024-09-21T02:42:11.824496+0000","last_undegraded":"2024-09-21T02:42:11.824496+0000","last_fullsized":"2024-09-21T02:42:11.824496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:16.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822418+0000","last_change":"2024-09-21T02:39:46.847973+0000","last_active":"2024-09-21T02:42:11.822418+0000","last_peered":"2024-09-21T02:42:11.822418+0000","last_clean":"2024-09-21T02:42:11.822418+0000","last_became_active":"2024-09-21T02:39:46.846957+0000","last_became_peered":"2024-09-21T02:39:46.846957+0000","last_unstale":"2024-09-21T02:42:11.822418+0000","last_undegraded":"2024-09-21T02:42:11.822418+0000","last_fullsized":"2024-09-21T02:42:11.822418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:44.077854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812203+0000","last_change":"2024-09-21T02:39:46.851310+0000","last_active":"2024-09-21T02:42:11.812203+0000","last_peered":"2024-09-21T02:42:11.812203+0000","last_clean":"2024-09-21T02:42:11.812203+0000","last_became_active":"2024-09-21T02:39:46.850666+0000","last_became_peered":"2024-09-21T02:39:46.850666+0000","last_unstale":"2024-09-21T02:42:11.812203+0000","last_undegraded":"2024-09-21T02:42:11.812203+0000","last_fullsized":"2024-09-21T02:42:11.812203+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:48.354795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.801547+0000","last_change":"2024-09-21T02:39:46.857409+0000","last_active":"2024-09-21T02:42:11.801547+0000","last_peered":"2024-09-21T02:42:11.801547+0000","last_clean":"2024-09-21T02:42:11.801547+0000","last_became_active":"2024-09-21T02:39:46.856974+0000","last_became_peered":"2024-09-21T02:39:46.856974+0000","last_unstale":"2024-09-21T02:42:11.801547+0000","last_undegraded":"2024-09-21T02:42:11.801547+0000","last_fullsized":"2024-09-21T02:42:11.801547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.140154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818137+0000","last_change":"2024-09-21T02:39:46.844168+0000","last_active":"2024-09-21T02:42:11.818137+0000","last_peered":"2024-09-21T02:42:11.818137+0000","last_clean":"2024-09-21T02:42:11.818137+0000","last_became_active":"2024-09-21T02:39:46.843509+0000","last_became_peered":"2024-09-21T02:39:46.843509+0000","last_unstale":"2024-09-21T02:42:11.818137+0000","last_undegraded":"2024-09-21T02:42:11.818137+0000","last_fullsized":"2024-09-21T02:42:11.818137+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.899890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.817598+0000","last_change":"2024-09-21T02:39:46.854805+0000","last_active":"2024-09-21T02:42:11.817598+0000","last_peered":"2024-09-21T02:42:11.817598+0000","last_clean":"2024-09-21T02:42:11.817598+0000","last_became_active":"2024-09-21T02:39:46.850248+0000","last_became_peered":"2024-09-21T02:39:46.850248+0000","last_unstale":"2024-09-21T02:42:11.817598+0000","last_undegraded":"2024-09-21T02:42:11.817598+0000","last_fullsized":"2024-09-21T02:42:11.817598+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:45.628337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834880+0000","last_change":"2024-09-21T02:39:46.866278+0000","last_active":"2024-09-21T02:42:11.834880+0000","last_peered":"2024-09-21T02:42:11.834880+0000","last_clean":"2024-09-21T02:42:11.834880+0000","last_became_active":"2024-09-21T02:39:46.865810+0000","last_became_peered":"2024-09-21T02:39:46.865810+0000","last_unstale":"2024-09-21T02:42:11.834880+0000","last_undegraded":"2024-09-21T02:42:11.834880+0000","last_fullsized":"2024-09-21T02:42:11.834880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.754340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824217+0000","last_change":"2024-09-21T02:39:46.857721+0000","last_active":"2024-09-21T02:42:11.824217+0000","last_peered":"2024-09-21T02:42:11.824217+0000","last_clean":"2024-09-21T02:42:11.824217+0000","last_became_active":"2024-09-21T02:39:46.853640+0000","last_became_peered":"2024-09-21T02:39:46.853640+0000","last_unstale":"2024-09-21T02:42:11.824217+0000","last_undegraded":"2024-09-21T02:42:11.824217+0000","last_fullsized":"2024-09-21T02:42:11.824217+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:54.019607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819500+0000","last_change":"2024-09-21T02:40:43.413457+0000","last_active":"2024-09-21T02:42:11.819500+0000","last_peered":"2024-09-21T02:42:11.819500+0000","last_clean":"2024-09-21T02:42:11.819500+0000","last_became_active":"2024-09-21T02:40:43.413000+0000","last_became_peered":"2024-09-21T02:40:43.413000+0000","last_unstale":"2024-09-21T02:42:11.819500+0000","last_undegraded":"2024-09-21T02:42:11.819500+0000","last_fullsized":"2024-09-21T02:42:11.819500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:27.775410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818391+0000","last_change":"2024-09-21T02:39:46.857169+0000","last_active":"2024-09-21T02:42:11.818391+0000","last_peered":"2024-09-21T02:42:11.818391+0000","last_clean":"2024-09-21T02:42:11.818391+0000","last_became_active":"2024-09-21T02:39:46.856757+0000","last_became_peered":"2024-09-21T02:39:46.856757+0000","last_unstale":"2024-09-21T02:42:11.818391+0000","last_undegraded":"2024-09-21T02:42:11.818391+0000","last_fullsized":"2024-09-21T02:42:11.818391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:36.729746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812141+0000","last_change":"2024-09-21T02:39:46.854162+0000","last_active":"2024-09-21T02:42:11.812141+0000","last_peered":"2024-09-21T02:42:11.812141+0000","last_clean":"2024-09-21T02:42:11.812141+0000","last_became_active":"2024-09-21T02:39:46.853697+0000","last_became_peered":"2024-09-21T02:39:46.853697+0000","last_unstale":"2024-09-21T02:42:11.812141+0000","last_undegraded":"2024-09-21T02:42:11.812141+0000","last_fullsized":"2024-09-21T02:42:11.812141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.605606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830324+0000","last_change":"2024-09-21T02:39:46.853570+0000","last_active":"2024-09-21T02:42:11.830324+0000","last_peered":"2024-09-21T02:42:11.830324+0000","last_clean":"2024-09-21T02:42:11.830324+0000","last_became_active":"2024-09-21T02:39:46.853074+0000","last_became_peered":"2024-09-21T02:39:46.853074+0000","last_unstale":"2024-09-21T02:42:11.830324+0000","last_undegraded":"2024-09-21T02:42:11.830324+0000","last_fullsized":"2024-09-21T02:42:11.830324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:02.642887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834080+0000","last_change":"2024-09-21T02:39:46.850070+0000","last_active":"2024-09-21T02:42:11.834080+0000","last_peered":"2024-09-21T02:42:11.834080+0000","last_clean":"2024-09-21T02:42:11.834080+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:42:11.834080+0000","last_undegraded":"2024-09-21T02:42:11.834080+0000","last_fullsized":"2024-09-21T02:42:11.834080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:59.185574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822391+0000","last_change":"2024-09-21T02:40:43.403735+0000","last_active":"2024-09-21T02:42:11.822391+0000","last_peered":"2024-09-21T02:42:11.822391+0000","last_clean":"2024-09-21T02:42:11.822391+0000","last_became_active":"2024-09-21T02:40:43.403330+0000","last_became_peered":"2024-09-21T02:40:43.403330+0000","last_unstale":"2024-09-21T02:42:11.822391+0000","last_undegraded":"2024-09-21T02:42:11.822391+0000","last_fullsized":"2024-09-21T02:42:11.822391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:35.043475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.821969+0000","last_change":"2024-09-21T02:39:46.850811+0000","last_active":"2024-09-21T02:42:11.821969+0000","last_peered":"2024-09-21T02:42:11.821969+0000","last_clean":"2024-09-21T02:42:11.821969+0000","last_became_active":"2024-09-21T02:39:46.850423+0000","last_became_peered":"2024-09-21T02:39:46.850423+0000","last_unstale":"2024-09-21T02:42:11.821969+0000","last_undegraded":"2024-09-21T02:42:11.821969+0000","last_fullsized":"2024-09-21T02:42:11.821969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:47.343607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822683+0000","last_change":"2024-09-21T02:39:46.851169+0000","last_active":"2024-09-21T02:42:11.822683+0000","last_peered":"2024-09-21T02:42:11.822683+0000","last_clean":"2024-09-21T02:42:11.822683+0000","last_became_active":"2024-09-21T02:39:46.850258+0000","last_became_peered":"2024-09-21T02:39:46.850258+0000","last_unstale":"2024-09-21T02:42:11.822683+0000","last_undegraded":"2024-09-21T02:42:11.822683+0000","last_fullsized":"2024-09-21T02:42:11.822683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:02.588325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.808504+0000","last_change":"2024-09-21T02:39:46.854082+0000","last_active":"2024-09-21T02:42:11.808504+0000","last_peered":"2024-09-21T02:42:11.808504+0000","last_clean":"2024-09-21T02:42:11.808504+0000","last_became_active":"2024-09-21T02:39:46.852226+0000","last_became_peered":"2024-09-21T02:39:46.852226+0000","last_unstale":"2024-09-21T02:42:11.808504+0000","last_undegraded":"2024-09-21T02:42:11.808504+0000","last_fullsized":"2024-09-21T02:42:11.808504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:41.960472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.835143+0000","last_change":"2024-09-21T02:39:46.856222+0000","last_active":"2024-09-21T02:42:11.835143+0000","last_peered":"2024-09-21T02:42:11.835143+0000","last_clean":"2024-09-21T02:42:11.835143+0000","last_became_active":"2024-09-21T02:39:46.855868+0000","last_became_peered":"2024-09-21T02:39:46.855868+0000","last_unstale":"2024-09-21T02:42:11.835143+0000","last_undegraded":"2024-09-21T02:42:11.835143+0000","last_fullsized":"2024-09-21T02:42:11.835143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:31.396030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.811992+0000","last_change":"2024-09-21T02:39:46.862312+0000","last_active":"2024-09-21T02:42:11.811992+0000","last_peered":"2024-09-21T02:42:11.811992+0000","last_clean":"2024-09-21T02:42:11.811992+0000","last_became_active":"2024-09-21T02:39:46.861921+0000","last_became_peered":"2024-09-21T02:39:46.861921+0000","last_unstale":"2024-09-21T02:42:11.811992+0000","last_undegraded":"2024-09-21T02:42:11.811992+0000","last_fullsized":"2024-09-21T02:42:11.811992+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:33.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833822+0000","last_change":"2024-09-21T02:39:46.851155+0000","last_active":"2024-09-21T02:42:11.833822+0000","last_peered":"2024-09-21T02:42:11.833822+0000","last_clean":"2024-09-21T02:42:11.833822+0000","last_became_active":"2024-09-21T02:39:46.850809+0000","last_became_peered":"2024-09-21T02:39:46.850809+0000","last_unstale":"2024-09-21T02:42:11.833822+0000","last_undegraded":"2024-09-21T02:42:11.833822+0000","last_fullsized":"2024-09-21T02:42:11.833822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820047+0000","last_change":"2024-09-21T02:39:46.850585+0000","last_active":"2024-09-21T02:42:11.820047+0000","last_peered":"2024-09-21T02:42:11.820047+0000","last_clean":"2024-09-21T02:42:11.820047+0000","last_became_active":"2024-09-21T02:39:46.850114+0000","last_became_peered":"2024-09-21T02:39:46.850114+0000","last_unstale":"2024-09-21T02:42:11.820047+0000","last_undegraded":"2024-09-21T02:42:11.820047+0000","last_fullsized":"2024-09-21T02:42:11.820047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:04.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.829001+0000","last_change":"2024-09-21T02:39:46.850416+0000","last_active":"2024-09-21T02:42:11.829001+0000","last_peered":"2024-09-21T02:42:11.829001+0000","last_clean":"2024-09-21T02:42:11.829001+0000","last_became_active":"2024-09-21T02:39:46.850035+0000","last_became_peered":"2024-09-21T02:39:46.850035+0000","last_unstale":"2024-09-21T02:42:11.829001+0000","last_undegraded":"2024-09-21T02:42:11.829001+0000","last_fullsized":"2024-09-21T02:42:11.829001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:09.139331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.813518+0000","last_change":"2024-09-21T02:39:46.861376+0000","last_active":"2024-09-21T02:42:11.813518+0000","last_peered":"2024-09-21T02:42:11.813518+0000","last_clean":"2024-09-21T02:42:11.813518+0000","last_became_active":"2024-09-21T02:39:46.861011+0000","last_became_peered":"2024-09-21T02:39:46.861011+0000","last_unstale":"2024-09-21T02:42:11.813518+0000","last_undegraded":"2024-09-21T02:42:11.813518+0000","last_fullsized":"2024-09-21T02:42:11.813518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:45.123705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.821886+0000","last_change":"2024-09-21T02:39:46.846135+0000","last_active":"2024-09-21T02:42:11.821886+0000","last_peered":"2024-09-21T02:42:11.821886+0000","last_clean":"2024-09-21T02:42:11.821886+0000","last_became_active":"2024-09-21T02:39:46.845693+0000","last_became_peered":"2024-09-21T02:39:46.845693+0000","last_unstale":"2024-09-21T02:42:11.821886+0000","last_undegraded":"2024-09-21T02:42:11.821886+0000","last_fullsized":"2024-09-21T02:42:11.821886+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:55.830932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.808763+0000","last_change":"2024-09-21T02:39:46.853300+0000","last_active":"2024-09-21T02:42:11.808763+0000","last_peered":"2024-09-21T02:42:11.808763+0000","last_clean":"2024-09-21T02:42:11.808763+0000","last_became_active":"2024-09-21T02:39:46.852953+0000","last_became_peered":"2024-09-21T02:39:46.852953+0000","last_unstale":"2024-09-21T02:42:11.808763+0000","last_undegraded":"2024-09-21T02:42:11.808763+0000","last_fullsized":"2024-09-21T02:42:11.808763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:04.475743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822522+0000","last_change":"2024-09-21T02:39:46.854976+0000","last_active":"2024-09-21T02:42:11.822522+0000","last_peered":"2024-09-21T02:42:11.822522+0000","last_clean":"2024-09-21T02:42:11.822522+0000","last_became_active":"2024-09-21T02:39:46.852970+0000","last_became_peered":"2024-09-21T02:39:46.852970+0000","last_unstale":"2024-09-21T02:42:11.822522+0000","last_undegraded":"2024-09-21T02:42:11.822522+0000","last_fullsized":"2024-09-21T02:42:11.822522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:54.654967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.815558+0000","last_change":"2024-09-21T02:39:46.848698+0000","last_active":"2024-09-21T02:42:11.815558+0000","last_peered":"2024-09-21T02:42:11.815558+0000","last_clean":"2024-09-21T02:42:11.815558+0000","last_became_active":"2024-09-21T02:39:46.848374+0000","last_became_peered":"2024-09-21T02:39:46.848374+0000","last_unstale":"2024-09-21T02:42:11.815558+0000","last_undegraded":"2024-09-21T02:42:11.815558+0000","last_fullsized":"2024-09-21T02:42:11.815558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:59.589062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830099+0000","last_change":"2024-09-21T02:39:46.851850+0000","last_active":"2024-09-21T02:42:11.830099+0000","last_peered":"2024-09-21T02:42:11.830099+0000","last_clean":"2024-09-21T02:42:11.830099+0000","last_became_active":"2024-09-21T02:39:46.851408+0000","last_became_peered":"2024-09-21T02:39:46.851408+0000","last_unstale":"2024-09-21T02:42:11.830099+0000","last_undegraded":"2024-09-21T02:42:11.830099+0000","last_fullsized":"2024-09-21T02:42:11.830099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:27.831504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80725,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":747,"num_read_kb":460,"num_write":189,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":225549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743473,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939702,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1724416,"data_stored":1177950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103227,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":510941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":514957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495686,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1626112,"data_stored":1107443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659213,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":506117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855443,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1099105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986263,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":511690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182493,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":506311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":575296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":573414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":507505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":69269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":77459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:42:43.651 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T02:42:43.651 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T02:42:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:43 smithi172 ceph-mon[35067]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:43 smithi172 ceph-mon[35067]: pgmap v409: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-21T02:42:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:43 smithi084 ceph-mon[30747]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:43 smithi084 ceph-mon[30747]: pgmap v409: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-21T02:42:44.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:43 smithi090 ceph-mon[34571]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:43 smithi090 ceph-mon[34571]: pgmap v409: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-21T02:42:44.057 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 -- 172.21.15.84:0/985457018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10c020 msgr2=0x7f9ccc112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/985457018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10c020 0x7f9ccc112850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009ca0 tx=0x7f9cc402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 -- 172.21.15.84:0/985457018 shutdown_connections 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/985457018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ccc10b6d0 0x7f9ccc10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/985457018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10c020 0x7f9ccc112850 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/985457018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ccc105d90 0x7f9ccc1061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 -- 172.21.15.84:0/985457018 >> 172.21.15.84:0/985457018 conn(0x7f9ccc101860 msgr2=0x7f9ccc103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 -- 172.21.15.84:0/985457018 shutdown_connections 2024-09-21T02:42:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.727+0000 7f9cd1a00640 1 -- 172.21.15.84:0/985457018 wait complete. 2024-09-21T02:42:44.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.728+0000 7f9cd1a00640 1 Processor -- start 2024-09-21T02:42:44.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cd1a00640 1 -- start start 2024-09-21T02:42:44.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cd1a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ccc105d90 0x7f9ccc19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cd1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10b6d0 0x7f9ccc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cd1a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ccc10c020 0x7f9ccc1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cd1a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc115e70 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cd1a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc115cf0 con 0x7f9ccc105d90 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cd1a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc115ff0 con 0x7f9ccc10c020 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cca000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10b6d0 0x7f9ccc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cca000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10b6d0 0x7f9ccc19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34454/0 (socket says 172.21.15.84:34454) 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9cca000640 1 -- 172.21.15.84:0/2391422157 learned_addr learned my addr 172.21.15.84:0/2391422157 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9ccb400640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ccc10c020 0x7f9ccc1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.729+0000 7f9ccaa00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ccc105d90 0x7f9ccc19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:44.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cca000640 1 -- 172.21.15.84:0/2391422157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ccc10c020 msgr2=0x7f9ccc1a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:44.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cca000640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ccc10c020 0x7f9ccc1a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cca000640 1 -- 172.21.15.84:0/2391422157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ccc105d90 msgr2=0x7f9ccc19c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:44.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cca000640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ccc105d90 0x7f9ccc19c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cca000640 1 -- 172.21.15.84:0/2391422157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc1a26b0 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cca000640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10b6d0 0x7f9ccc19cce0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800e9c0 tx=0x7f9cb800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cc3400640 1 -- 172.21.15.84:0/2391422157 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800ccc0 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cc3400640 1 -- 172.21.15.84:0/2391422157 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9cb80054f0 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cc3400640 1 -- 172.21.15.84:0/2391422157 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8010430 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.730+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc1a29a0 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.731+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc1a9100 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.732+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ccc1061a0 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.735+0000 7f9cc3400640 1 -- 172.21.15.84:0/2391422157 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f9cb80046c0 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.736+0000 7f9cc3400640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9cb00b6620 0x7f9cb00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:44.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.736+0000 7f9cc3400640 1 -- 172.21.15.84:0/2391422157 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f9cb80e7ce0 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.737+0000 7f9ccaa00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9cb00b6620 0x7f9cb00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:44.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.737+0000 7f9ccaa00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9cb00b6620 0x7f9cb00b8b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc005d00 tx=0x7f9cbc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:44.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.737+0000 7f9cc3400640 1 -- 172.21.15.84:0/2391422157 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cb8056710 con 0x7f9ccc10b6d0 2024-09-21T02:42:44.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.923+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 --> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ccc063800 con 0x7f9cb00b6620 2024-09-21T02:42:44.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.930+0000 7f9cc3400640 1 -- 172.21.15.84:0/2391422157 <== mgr.14152 v2:172.21.15.84:6800/2416519122 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340476 (secure 0 0 0) 0x7f9ccc063800 con 0x7f9cb00b6620 2024-09-21T02:42:44.935 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:44.936 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9cb00b6620 msgr2=0x7f9cb00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9cb00b6620 0x7f9cb00b8b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc005d00 tx=0x7f9cbc00b410 comp rx=0 tx=0).stop 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10b6d0 msgr2=0x7f9ccc19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10b6d0 0x7f9ccc19cce0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800e9c0 tx=0x7f9cb800ee80 comp rx=0 tx=0).stop 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 shutdown_connections 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9cb00b6620 0x7f9cb00b8b30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ccc10c020 0x7f9ccc1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ccc10b6d0 0x7f9ccc19cce0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 --2- 172.21.15.84:0/2391422157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ccc105d90 0x7f9ccc19c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 >> 172.21.15.84:0/2391422157 conn(0x7f9ccc101860 msgr2=0x7f9ccc10ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:44.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.936+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 shutdown_connections 2024-09-21T02:42:44.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:44.937+0000 7f9cd1a00640 1 -- 172.21.15.84:0/2391422157 wait complete. 2024-09-21T02:42:45.855 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-21T02:42:43.630867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671327,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":823,"num_read_kb":524,"num_write":318,"num_write_kb":2299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2951957,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":392404,"kb_used_data":14036,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124549420,"statfs":{"total":1151940427776,"available":1151538606080,"internally_reserved":0,"allocated":14372864,"data_stored":8118371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":42,"num_write":17,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003807"},"pg_stats":[{"pgid":"2.1f","version":"84'9","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348659+0000","last_change":"2024-09-21T02:39:43.823658+0000","last_active":"2024-09-21T02:41:44.348659+0000","last_peered":"2024-09-21T02:41:44.348659+0000","last_clean":"2024-09-21T02:41:44.348659+0000","last_became_active":"2024-09-21T02:39:43.823211+0000","last_became_peered":"2024-09-21T02:39:43.823211+0000","last_unstale":"2024-09-21T02:41:44.348659+0000","last_undegraded":"2024-09-21T02:41:44.348659+0000","last_fullsized":"2024-09-21T02:41:44.348659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:00.505552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.806777+0000","last_change":"2024-09-21T02:39:46.850819+0000","last_active":"2024-09-21T02:42:11.806777+0000","last_peered":"2024-09-21T02:42:11.806777+0000","last_clean":"2024-09-21T02:42:11.806777+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:42:11.806777+0000","last_undegraded":"2024-09-21T02:42:11.806777+0000","last_fullsized":"2024-09-21T02:42:11.806777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:21.280788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.699306+0000","last_change":"2024-09-21T02:41:44.698816+0000","last_active":"2024-09-21T02:41:44.699306+0000","last_peered":"2024-09-21T02:41:44.699306+0000","last_clean":"2024-09-21T02:41:44.699306+0000","last_became_active":"2024-09-21T02:41:44.698135+0000","last_became_peered":"2024-09-21T02:41:44.698135+0000","last_unstale":"2024-09-21T02:41:44.699306+0000","last_undegraded":"2024-09-21T02:41:44.699306+0000","last_fullsized":"2024-09-21T02:41:44.699306+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:09.002148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342951+0000","last_change":"2024-09-21T02:39:43.828030+0000","last_active":"2024-09-21T02:41:44.342951+0000","last_peered":"2024-09-21T02:41:44.342951+0000","last_clean":"2024-09-21T02:41:44.342951+0000","last_became_active":"2024-09-21T02:39:43.827692+0000","last_became_peered":"2024-09-21T02:39:43.827692+0000","last_unstale":"2024-09-21T02:41:44.342951+0000","last_undegraded":"2024-09-21T02:41:44.342951+0000","last_fullsized":"2024-09-21T02:41:44.342951+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:06:32.791324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.828650+0000","last_change":"2024-09-21T02:39:46.854718+0000","last_active":"2024-09-21T02:42:11.828650+0000","last_peered":"2024-09-21T02:42:11.828650+0000","last_clean":"2024-09-21T02:42:11.828650+0000","last_became_active":"2024-09-21T02:39:46.854355+0000","last_became_peered":"2024-09-21T02:39:46.854355+0000","last_unstale":"2024-09-21T02:42:11.828650+0000","last_undegraded":"2024-09-21T02:42:11.828650+0000","last_fullsized":"2024-09-21T02:42:11.828650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:58.894397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486275+0000","last_change":"2024-09-21T02:39:56.930764+0000","last_active":"2024-09-21T02:41:44.486275+0000","last_peered":"2024-09-21T02:41:44.486275+0000","last_clean":"2024-09-21T02:41:44.486275+0000","last_became_active":"2024-09-21T02:39:56.930243+0000","last_became_peered":"2024-09-21T02:39:56.930243+0000","last_unstale":"2024-09-21T02:41:44.486275+0000","last_undegraded":"2024-09-21T02:41:44.486275+0000","last_fullsized":"2024-09-21T02:41:44.486275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:20.283102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697482+0000","last_change":"2024-09-21T02:39:43.824749+0000","last_active":"2024-09-21T02:41:44.697482+0000","last_peered":"2024-09-21T02:41:44.697482+0000","last_clean":"2024-09-21T02:41:44.697482+0000","last_became_active":"2024-09-21T02:39:43.824385+0000","last_became_peered":"2024-09-21T02:39:43.824385+0000","last_unstale":"2024-09-21T02:41:44.697482+0000","last_undegraded":"2024-09-21T02:41:44.697482+0000","last_fullsized":"2024-09-21T02:41:44.697482+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:37.952047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833157+0000","last_change":"2024-09-21T02:39:46.856048+0000","last_active":"2024-09-21T02:42:11.833157+0000","last_peered":"2024-09-21T02:42:11.833157+0000","last_clean":"2024-09-21T02:42:11.833157+0000","last_became_active":"2024-09-21T02:39:46.855687+0000","last_became_peered":"2024-09-21T02:39:46.855687+0000","last_unstale":"2024-09-21T02:42:11.833157+0000","last_undegraded":"2024-09-21T02:42:11.833157+0000","last_fullsized":"2024-09-21T02:42:11.833157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:11.708028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487682+0000","last_change":"2024-09-21T02:39:56.931495+0000","last_active":"2024-09-21T02:41:44.487682+0000","last_peered":"2024-09-21T02:41:44.487682+0000","last_clean":"2024-09-21T02:41:44.487682+0000","last_became_active":"2024-09-21T02:39:56.930586+0000","last_became_peered":"2024-09-21T02:39:56.930586+0000","last_unstale":"2024-09-21T02:41:44.487682+0000","last_undegraded":"2024-09-21T02:41:44.487682+0000","last_fullsized":"2024-09-21T02:41:44.487682+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:56.953058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343041+0000","last_change":"2024-09-21T02:40:43.408517+0000","last_active":"2024-09-21T02:41:44.343041+0000","last_peered":"2024-09-21T02:41:44.343041+0000","last_clean":"2024-09-21T02:41:44.343041+0000","last_became_active":"2024-09-21T02:40:43.402800+0000","last_became_peered":"2024-09-21T02:40:43.402800+0000","last_unstale":"2024-09-21T02:41:44.343041+0000","last_undegraded":"2024-09-21T02:41:44.343041+0000","last_fullsized":"2024-09-21T02:41:44.343041+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:46.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824825+0000","last_change":"2024-09-21T02:39:46.855990+0000","last_active":"2024-09-21T02:42:11.824825+0000","last_peered":"2024-09-21T02:42:11.824825+0000","last_clean":"2024-09-21T02:42:11.824825+0000","last_became_active":"2024-09-21T02:39:46.855602+0000","last_became_peered":"2024-09-21T02:39:46.855602+0000","last_unstale":"2024-09-21T02:42:11.824825+0000","last_undegraded":"2024-09-21T02:42:11.824825+0000","last_fullsized":"2024-09-21T02:42:11.824825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:43.207141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487155+0000","last_change":"2024-09-21T02:39:56.924868+0000","last_active":"2024-09-21T02:41:44.487155+0000","last_peered":"2024-09-21T02:41:44.487155+0000","last_clean":"2024-09-21T02:41:44.487155+0000","last_became_active":"2024-09-21T02:39:56.924353+0000","last_became_peered":"2024-09-21T02:39:56.924353+0000","last_unstale":"2024-09-21T02:41:44.487155+0000","last_undegraded":"2024-09-21T02:41:44.487155+0000","last_fullsized":"2024-09-21T02:41:44.487155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:48.095244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834867+0000","last_change":"2024-09-21T02:39:46.853077+0000","last_active":"2024-09-21T02:42:11.834867+0000","last_peered":"2024-09-21T02:42:11.834867+0000","last_clean":"2024-09-21T02:42:11.834867+0000","last_became_active":"2024-09-21T02:39:46.852691+0000","last_became_peered":"2024-09-21T02:39:46.852691+0000","last_unstale":"2024-09-21T02:42:11.834867+0000","last_undegraded":"2024-09-21T02:42:11.834867+0000","last_fullsized":"2024-09-21T02:42:11.834867+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:12.427934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696864+0000","last_change":"2024-09-21T02:40:43.411229+0000","last_active":"2024-09-21T02:41:44.696864+0000","last_peered":"2024-09-21T02:41:44.696864+0000","last_clean":"2024-09-21T02:41:44.696864+0000","last_became_active":"2024-09-21T02:40:43.404833+0000","last_became_peered":"2024-09-21T02:40:43.404833+0000","last_unstale":"2024-09-21T02:41:44.696864+0000","last_undegraded":"2024-09-21T02:41:44.696864+0000","last_fullsized":"2024-09-21T02:41:44.696864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:22.812239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487302+0000","last_change":"2024-09-21T02:39:56.922205+0000","last_active":"2024-09-21T02:41:44.487302+0000","last_peered":"2024-09-21T02:41:44.487302+0000","last_clean":"2024-09-21T02:41:44.487302+0000","last_became_active":"2024-09-21T02:39:56.921702+0000","last_became_peered":"2024-09-21T02:39:56.921702+0000","last_unstale":"2024-09-21T02:41:44.487302+0000","last_undegraded":"2024-09-21T02:41:44.487302+0000","last_fullsized":"2024-09-21T02:41:44.487302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:07.622691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820298+0000","last_change":"2024-09-21T02:39:46.846380+0000","last_active":"2024-09-21T02:42:11.820298+0000","last_peered":"2024-09-21T02:42:11.820298+0000","last_clean":"2024-09-21T02:42:11.820298+0000","last_became_active":"2024-09-21T02:39:46.845972+0000","last_became_peered":"2024-09-21T02:39:46.845972+0000","last_unstale":"2024-09-21T02:42:11.820298+0000","last_undegraded":"2024-09-21T02:42:11.820298+0000","last_fullsized":"2024-09-21T02:42:11.820298+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:44.074161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"88'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:37.385722+0000","last_change":"2024-09-21T02:39:43.824394+0000","last_active":"2024-09-21T02:42:37.385722+0000","last_peered":"2024-09-21T02:42:37.385722+0000","last_clean":"2024-09-21T02:42:37.385722+0000","last_became_active":"2024-09-21T02:39:43.823947+0000","last_became_peered":"2024-09-21T02:39:43.823947+0000","last_unstale":"2024-09-21T02:42:37.385722+0000","last_undegraded":"2024-09-21T02:42:37.385722+0000","last_fullsized":"2024-09-21T02:42:37.385722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:32:24.083281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487442+0000","last_change":"2024-09-21T02:40:43.413833+0000","last_active":"2024-09-21T02:41:44.487442+0000","last_peered":"2024-09-21T02:41:44.487442+0000","last_clean":"2024-09-21T02:41:44.487442+0000","last_became_active":"2024-09-21T02:40:43.413319+0000","last_became_peered":"2024-09-21T02:40:43.413319+0000","last_unstale":"2024-09-21T02:41:44.487442+0000","last_undegraded":"2024-09-21T02:41:44.487442+0000","last_fullsized":"2024-09-21T02:41:44.487442+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:40.853459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823558+0000","last_change":"2024-09-21T02:39:46.845544+0000","last_active":"2024-09-21T02:42:11.823558+0000","last_peered":"2024-09-21T02:42:11.823558+0000","last_clean":"2024-09-21T02:42:11.823558+0000","last_became_active":"2024-09-21T02:39:46.845162+0000","last_became_peered":"2024-09-21T02:39:46.845162+0000","last_unstale":"2024-09-21T02:42:11.823558+0000","last_undegraded":"2024-09-21T02:42:11.823558+0000","last_fullsized":"2024-09-21T02:42:11.823558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:46.914339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342517+0000","last_change":"2024-09-21T02:39:43.825182+0000","last_active":"2024-09-21T02:41:44.342517+0000","last_peered":"2024-09-21T02:41:44.342517+0000","last_clean":"2024-09-21T02:41:44.342517+0000","last_became_active":"2024-09-21T02:39:43.824774+0000","last_became_peered":"2024-09-21T02:39:43.824774+0000","last_unstale":"2024-09-21T02:41:44.342517+0000","last_undegraded":"2024-09-21T02:41:44.342517+0000","last_fullsized":"2024-09-21T02:41:44.342517+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:41.159438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348526+0000","last_change":"2024-09-21T02:39:56.935765+0000","last_active":"2024-09-21T02:41:44.348526+0000","last_peered":"2024-09-21T02:41:44.348526+0000","last_clean":"2024-09-21T02:41:44.348526+0000","last_became_active":"2024-09-21T02:39:56.933218+0000","last_became_peered":"2024-09-21T02:39:56.933218+0000","last_unstale":"2024-09-21T02:41:44.348526+0000","last_undegraded":"2024-09-21T02:41:44.348526+0000","last_fullsized":"2024-09-21T02:41:44.348526+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:28.256318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.782193+0000","last_change":"2024-09-21T02:39:46.853769+0000","last_active":"2024-09-21T02:42:11.782193+0000","last_peered":"2024-09-21T02:42:11.782193+0000","last_clean":"2024-09-21T02:42:11.782193+0000","last_became_active":"2024-09-21T02:39:46.853347+0000","last_became_peered":"2024-09-21T02:39:46.853347+0000","last_unstale":"2024-09-21T02:42:11.782193+0000","last_undegraded":"2024-09-21T02:42:11.782193+0000","last_fullsized":"2024-09-21T02:42:11.782193+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:01.025721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486557+0000","last_change":"2024-09-21T02:40:43.408316+0000","last_active":"2024-09-21T02:41:44.486557+0000","last_peered":"2024-09-21T02:41:44.486557+0000","last_clean":"2024-09-21T02:41:44.486557+0000","last_became_active":"2024-09-21T02:40:43.402877+0000","last_became_peered":"2024-09-21T02:40:43.402877+0000","last_unstale":"2024-09-21T02:41:44.486557+0000","last_undegraded":"2024-09-21T02:41:44.486557+0000","last_fullsized":"2024-09-21T02:41:44.486557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:41.712477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487516+0000","last_change":"2024-09-21T02:39:56.928251+0000","last_active":"2024-09-21T02:41:44.487516+0000","last_peered":"2024-09-21T02:41:44.487516+0000","last_clean":"2024-09-21T02:41:44.487516+0000","last_became_active":"2024-09-21T02:39:56.927772+0000","last_became_peered":"2024-09-21T02:39:56.927772+0000","last_unstale":"2024-09-21T02:41:44.487516+0000","last_undegraded":"2024-09-21T02:41:44.487516+0000","last_fullsized":"2024-09-21T02:41:44.487516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:40.762245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.825403+0000","last_change":"2024-09-21T02:40:43.418238+0000","last_active":"2024-09-21T02:42:11.825403+0000","last_peered":"2024-09-21T02:42:11.825403+0000","last_clean":"2024-09-21T02:42:11.825403+0000","last_became_active":"2024-09-21T02:40:43.417728+0000","last_became_peered":"2024-09-21T02:40:43.417728+0000","last_unstale":"2024-09-21T02:42:11.825403+0000","last_undegraded":"2024-09-21T02:42:11.825403+0000","last_fullsized":"2024-09-21T02:42:11.825403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:35.244275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487639+0000","last_change":"2024-09-21T02:39:43.840567+0000","last_active":"2024-09-21T02:41:44.487639+0000","last_peered":"2024-09-21T02:41:44.487639+0000","last_clean":"2024-09-21T02:41:44.487639+0000","last_became_active":"2024-09-21T02:39:43.840279+0000","last_became_peered":"2024-09-21T02:39:43.840279+0000","last_unstale":"2024-09-21T02:41:44.487639+0000","last_undegraded":"2024-09-21T02:41:44.487639+0000","last_fullsized":"2024-09-21T02:41:44.487639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:42.498272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345589+0000","last_change":"2024-09-21T02:39:56.920425+0000","last_active":"2024-09-21T02:41:44.345589+0000","last_peered":"2024-09-21T02:41:44.345589+0000","last_clean":"2024-09-21T02:41:44.345589+0000","last_became_active":"2024-09-21T02:39:56.919610+0000","last_became_peered":"2024-09-21T02:39:56.919610+0000","last_unstale":"2024-09-21T02:41:44.345589+0000","last_undegraded":"2024-09-21T02:41:44.345589+0000","last_fullsized":"2024-09-21T02:41:44.345589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:13:09.579282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818198+0000","last_change":"2024-09-21T02:39:46.845188+0000","last_active":"2024-09-21T02:42:11.818198+0000","last_peered":"2024-09-21T02:42:11.818198+0000","last_clean":"2024-09-21T02:42:11.818198+0000","last_became_active":"2024-09-21T02:39:46.844818+0000","last_became_peered":"2024-09-21T02:39:46.844818+0000","last_unstale":"2024-09-21T02:42:11.818198+0000","last_undegraded":"2024-09-21T02:42:11.818198+0000","last_fullsized":"2024-09-21T02:42:11.818198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:47.853370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'14","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:37.877367+0000","last_change":"2024-09-21T02:39:43.822226+0000","last_active":"2024-09-21T02:42:37.877367+0000","last_peered":"2024-09-21T02:42:37.877367+0000","last_clean":"2024-09-21T02:42:37.877367+0000","last_became_active":"2024-09-21T02:39:43.821798+0000","last_became_peered":"2024-09-21T02:39:43.821798+0000","last_unstale":"2024-09-21T02:42:37.877367+0000","last_undegraded":"2024-09-21T02:42:37.877367+0000","last_fullsized":"2024-09-21T02:42:37.877367+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:38.822330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342201+0000","last_change":"2024-09-21T02:39:56.919521+0000","last_active":"2024-09-21T02:41:44.342201+0000","last_peered":"2024-09-21T02:41:44.342201+0000","last_clean":"2024-09-21T02:41:44.342201+0000","last_became_active":"2024-09-21T02:39:56.918042+0000","last_became_peered":"2024-09-21T02:39:56.918042+0000","last_unstale":"2024-09-21T02:41:44.342201+0000","last_undegraded":"2024-09-21T02:41:44.342201+0000","last_fullsized":"2024-09-21T02:41:44.342201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:21.818462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823167+0000","last_change":"2024-09-21T02:39:46.861856+0000","last_active":"2024-09-21T02:42:11.823167+0000","last_peered":"2024-09-21T02:42:11.823167+0000","last_clean":"2024-09-21T02:42:11.823167+0000","last_became_active":"2024-09-21T02:39:46.861416+0000","last_became_peered":"2024-09-21T02:39:46.861416+0000","last_unstale":"2024-09-21T02:42:11.823167+0000","last_undegraded":"2024-09-21T02:42:11.823167+0000","last_fullsized":"2024-09-21T02:42:11.823167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:46.547988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697505+0000","last_change":"2024-09-21T02:39:43.826232+0000","last_active":"2024-09-21T02:41:44.697505+0000","last_peered":"2024-09-21T02:41:44.697505+0000","last_clean":"2024-09-21T02:41:44.697505+0000","last_became_active":"2024-09-21T02:39:43.825789+0000","last_became_peered":"2024-09-21T02:39:43.825789+0000","last_unstale":"2024-09-21T02:41:44.697505+0000","last_undegraded":"2024-09-21T02:41:44.697505+0000","last_fullsized":"2024-09-21T02:41:44.697505+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:43:19.465106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342950+0000","last_change":"2024-09-21T02:39:56.917802+0000","last_active":"2024-09-21T02:41:44.342950+0000","last_peered":"2024-09-21T02:41:44.342950+0000","last_clean":"2024-09-21T02:41:44.342950+0000","last_became_active":"2024-09-21T02:39:56.917286+0000","last_became_peered":"2024-09-21T02:39:56.917286+0000","last_unstale":"2024-09-21T02:41:44.342950+0000","last_undegraded":"2024-09-21T02:41:44.342950+0000","last_fullsized":"2024-09-21T02:41:44.342950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:19.055218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.814958+0000","last_change":"2024-09-21T02:39:46.858829+0000","last_active":"2024-09-21T02:42:11.814958+0000","last_peered":"2024-09-21T02:42:11.814958+0000","last_clean":"2024-09-21T02:42:11.814958+0000","last_became_active":"2024-09-21T02:39:46.858392+0000","last_became_peered":"2024-09-21T02:39:46.858392+0000","last_unstale":"2024-09-21T02:42:11.814958+0000","last_undegraded":"2024-09-21T02:42:11.814958+0000","last_fullsized":"2024-09-21T02:42:11.814958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:29.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348631+0000","last_change":"2024-09-21T02:39:43.825129+0000","last_active":"2024-09-21T02:41:44.348631+0000","last_peered":"2024-09-21T02:41:44.348631+0000","last_clean":"2024-09-21T02:41:44.348631+0000","last_became_active":"2024-09-21T02:39:43.824756+0000","last_became_peered":"2024-09-21T02:39:43.824756+0000","last_unstale":"2024-09-21T02:41:44.348631+0000","last_undegraded":"2024-09-21T02:41:44.348631+0000","last_fullsized":"2024-09-21T02:41:44.348631+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:28.771033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696680+0000","last_change":"2024-09-21T02:39:56.929186+0000","last_active":"2024-09-21T02:41:44.696680+0000","last_peered":"2024-09-21T02:41:44.696680+0000","last_clean":"2024-09-21T02:41:44.696680+0000","last_became_active":"2024-09-21T02:39:56.928608+0000","last_became_peered":"2024-09-21T02:39:56.928608+0000","last_unstale":"2024-09-21T02:41:44.696680+0000","last_undegraded":"2024-09-21T02:41:44.696680+0000","last_fullsized":"2024-09-21T02:41:44.696680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:47.860230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819801+0000","last_change":"2024-09-21T02:39:46.860375+0000","last_active":"2024-09-21T02:42:11.819801+0000","last_peered":"2024-09-21T02:42:11.819801+0000","last_clean":"2024-09-21T02:42:11.819801+0000","last_became_active":"2024-09-21T02:39:46.860035+0000","last_became_peered":"2024-09-21T02:39:46.860035+0000","last_unstale":"2024-09-21T02:42:11.819801+0000","last_undegraded":"2024-09-21T02:42:11.819801+0000","last_fullsized":"2024-09-21T02:42:11.819801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:07.761203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346270+0000","last_change":"2024-09-21T02:39:43.827869+0000","last_active":"2024-09-21T02:41:44.346270+0000","last_peered":"2024-09-21T02:41:44.346270+0000","last_clean":"2024-09-21T02:41:44.346270+0000","last_became_active":"2024-09-21T02:39:43.827375+0000","last_became_peered":"2024-09-21T02:39:43.827375+0000","last_unstale":"2024-09-21T02:41:44.346270+0000","last_undegraded":"2024-09-21T02:41:44.346270+0000","last_fullsized":"2024-09-21T02:41:44.346270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:48.257387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346779+0000","last_change":"2024-09-21T02:39:56.917766+0000","last_active":"2024-09-21T02:41:44.346779+0000","last_peered":"2024-09-21T02:41:44.346779+0000","last_clean":"2024-09-21T02:41:44.346779+0000","last_became_active":"2024-09-21T02:39:56.917309+0000","last_became_peered":"2024-09-21T02:39:56.917309+0000","last_unstale":"2024-09-21T02:41:44.346779+0000","last_undegraded":"2024-09-21T02:41:44.346779+0000","last_fullsized":"2024-09-21T02:41:44.346779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:36.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.816648+0000","last_change":"2024-09-21T02:39:46.851416+0000","last_active":"2024-09-21T02:42:11.816648+0000","last_peered":"2024-09-21T02:42:11.816648+0000","last_clean":"2024-09-21T02:42:11.816648+0000","last_became_active":"2024-09-21T02:39:46.851055+0000","last_became_peered":"2024-09-21T02:39:46.851055+0000","last_unstale":"2024-09-21T02:42:11.816648+0000","last_undegraded":"2024-09-21T02:42:11.816648+0000","last_fullsized":"2024-09-21T02:42:11.816648+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:50.156733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":171,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:39.599786+0000","last_change":"2024-09-21T02:39:43.825162+0000","last_active":"2024-09-21T02:42:39.599786+0000","last_peered":"2024-09-21T02:42:39.599786+0000","last_clean":"2024-09-21T02:42:39.599786+0000","last_became_active":"2024-09-21T02:39:43.824811+0000","last_became_peered":"2024-09-21T02:39:43.824811+0000","last_unstale":"2024-09-21T02:42:39.599786+0000","last_undegraded":"2024-09-21T02:42:39.599786+0000","last_fullsized":"2024-09-21T02:42:39.599786+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:48:10.020902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346813+0000","last_change":"2024-09-21T02:39:56.920750+0000","last_active":"2024-09-21T02:41:44.346813+0000","last_peered":"2024-09-21T02:41:44.346813+0000","last_clean":"2024-09-21T02:41:44.346813+0000","last_became_active":"2024-09-21T02:39:56.920245+0000","last_became_peered":"2024-09-21T02:39:56.920245+0000","last_unstale":"2024-09-21T02:41:44.346813+0000","last_undegraded":"2024-09-21T02:41:44.346813+0000","last_fullsized":"2024-09-21T02:41:44.346813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:53.718596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.816452+0000","last_change":"2024-09-21T02:39:46.854202+0000","last_active":"2024-09-21T02:42:11.816452+0000","last_peered":"2024-09-21T02:42:11.816452+0000","last_clean":"2024-09-21T02:42:11.816452+0000","last_became_active":"2024-09-21T02:39:46.853076+0000","last_became_peered":"2024-09-21T02:39:46.853076+0000","last_unstale":"2024-09-21T02:42:11.816452+0000","last_undegraded":"2024-09-21T02:42:11.816452+0000","last_fullsized":"2024-09-21T02:42:11.816452+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:59.729777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345691+0000","last_change":"2024-09-21T02:39:43.826351+0000","last_active":"2024-09-21T02:41:44.345691+0000","last_peered":"2024-09-21T02:41:44.345691+0000","last_clean":"2024-09-21T02:41:44.345691+0000","last_became_active":"2024-09-21T02:39:43.825683+0000","last_became_peered":"2024-09-21T02:39:43.825683+0000","last_unstale":"2024-09-21T02:41:44.345691+0000","last_undegraded":"2024-09-21T02:41:44.345691+0000","last_fullsized":"2024-09-21T02:41:44.345691+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:16.934280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348917+0000","last_change":"2024-09-21T02:39:56.937591+0000","last_active":"2024-09-21T02:41:44.348917+0000","last_peered":"2024-09-21T02:41:44.348917+0000","last_clean":"2024-09-21T02:41:44.348917+0000","last_became_active":"2024-09-21T02:39:56.937178+0000","last_became_peered":"2024-09-21T02:39:56.937178+0000","last_unstale":"2024-09-21T02:41:44.348917+0000","last_undegraded":"2024-09-21T02:41:44.348917+0000","last_fullsized":"2024-09-21T02:41:44.348917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:20:21.218393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830551+0000","last_change":"2024-09-21T02:39:46.858255+0000","last_active":"2024-09-21T02:42:11.830551+0000","last_peered":"2024-09-21T02:42:11.830551+0000","last_clean":"2024-09-21T02:42:11.830551+0000","last_became_active":"2024-09-21T02:39:46.856726+0000","last_became_peered":"2024-09-21T02:39:46.856726+0000","last_unstale":"2024-09-21T02:42:11.830551+0000","last_undegraded":"2024-09-21T02:42:11.830551+0000","last_fullsized":"2024-09-21T02:42:11.830551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:33.890538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487791+0000","last_change":"2024-09-21T02:39:43.823562+0000","last_active":"2024-09-21T02:41:44.487791+0000","last_peered":"2024-09-21T02:41:44.487791+0000","last_clean":"2024-09-21T02:41:44.487791+0000","last_became_active":"2024-09-21T02:39:43.823142+0000","last_became_peered":"2024-09-21T02:39:43.823142+0000","last_unstale":"2024-09-21T02:41:44.487791+0000","last_undegraded":"2024-09-21T02:41:44.487791+0000","last_fullsized":"2024-09-21T02:41:44.487791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:36.459903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345775+0000","last_change":"2024-09-21T02:38:27.972237+0000","last_active":"2024-09-21T02:41:44.345775+0000","last_peered":"2024-09-21T02:41:44.345775+0000","last_clean":"2024-09-21T02:41:44.345775+0000","last_became_active":"2024-09-21T02:38:27.966297+0000","last_became_peered":"2024-09-21T02:38:27.966297+0000","last_unstale":"2024-09-21T02:41:44.345775+0000","last_undegraded":"2024-09-21T02:41:44.345775+0000","last_fullsized":"2024-09-21T02:41:44.345775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:34:42.292034+0000","last_clean_scrub_stamp":"2024-09-21T02:34:42.292034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:24.592682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.702822+0000","last_change":"2024-09-21T02:41:44.702415+0000","last_active":"2024-09-21T02:41:44.702822+0000","last_peered":"2024-09-21T02:41:44.702822+0000","last_clean":"2024-09-21T02:41:44.702822+0000","last_became_active":"2024-09-21T02:41:44.698199+0000","last_became_peered":"2024-09-21T02:41:44.698199+0000","last_unstale":"2024-09-21T02:41:44.702822+0000","last_undegraded":"2024-09-21T02:41:44.702822+0000","last_fullsized":"2024-09-21T02:41:44.702822+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:03.191052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,11,9],"acting":[7,8,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.835131+0000","last_change":"2024-09-21T02:39:46.851466+0000","last_active":"2024-09-21T02:42:11.835131+0000","last_peered":"2024-09-21T02:42:11.835131+0000","last_clean":"2024-09-21T02:42:11.835131+0000","last_became_active":"2024-09-21T02:39:46.849945+0000","last_became_peered":"2024-09-21T02:39:46.849945+0000","last_unstale":"2024-09-21T02:42:11.835131+0000","last_undegraded":"2024-09-21T02:42:11.835131+0000","last_fullsized":"2024-09-21T02:42:11.835131+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:07.424794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.345165+0000","last_change":"2024-09-21T02:39:43.840894+0000","last_active":"2024-09-21T02:41:44.345165+0000","last_peered":"2024-09-21T02:41:44.345165+0000","last_clean":"2024-09-21T02:41:44.345165+0000","last_became_active":"2024-09-21T02:39:43.840437+0000","last_became_peered":"2024-09-21T02:39:43.840437+0000","last_unstale":"2024-09-21T02:41:44.345165+0000","last_undegraded":"2024-09-21T02:41:44.345165+0000","last_fullsized":"2024-09-21T02:41:44.345165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:31.741218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486908+0000","last_change":"2024-09-21T02:39:56.924563+0000","last_active":"2024-09-21T02:41:44.486908+0000","last_peered":"2024-09-21T02:41:44.486908+0000","last_clean":"2024-09-21T02:41:44.486908+0000","last_became_active":"2024-09-21T02:39:56.923791+0000","last_became_peered":"2024-09-21T02:39:56.923791+0000","last_unstale":"2024-09-21T02:41:44.486908+0000","last_undegraded":"2024-09-21T02:41:44.486908+0000","last_fullsized":"2024-09-21T02:41:44.486908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:03.409737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822963+0000","last_change":"2024-09-21T02:39:46.858712+0000","last_active":"2024-09-21T02:42:11.822963+0000","last_peered":"2024-09-21T02:42:11.822963+0000","last_clean":"2024-09-21T02:42:11.822963+0000","last_became_active":"2024-09-21T02:39:46.858339+0000","last_became_peered":"2024-09-21T02:39:46.858339+0000","last_unstale":"2024-09-21T02:42:11.822963+0000","last_undegraded":"2024-09-21T02:42:11.822963+0000","last_fullsized":"2024-09-21T02:42:11.822963+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.015904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.349194+0000","last_change":"2024-09-21T02:39:43.829127+0000","last_active":"2024-09-21T02:41:44.349194+0000","last_peered":"2024-09-21T02:41:44.349194+0000","last_clean":"2024-09-21T02:41:44.349194+0000","last_became_active":"2024-09-21T02:39:43.828136+0000","last_became_peered":"2024-09-21T02:39:43.828136+0000","last_unstale":"2024-09-21T02:41:44.349194+0000","last_undegraded":"2024-09-21T02:41:44.349194+0000","last_fullsized":"2024-09-21T02:41:44.349194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:39.232930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486621+0000","last_change":"2024-09-21T02:39:56.930823+0000","last_active":"2024-09-21T02:41:44.486621+0000","last_peered":"2024-09-21T02:41:44.486621+0000","last_clean":"2024-09-21T02:41:44.486621+0000","last_became_active":"2024-09-21T02:39:56.930379+0000","last_became_peered":"2024-09-21T02:39:56.930379+0000","last_unstale":"2024-09-21T02:41:44.486621+0000","last_undegraded":"2024-09-21T02:41:44.486621+0000","last_fullsized":"2024-09-21T02:41:44.486621+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:01.260484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.832118+0000","last_change":"2024-09-21T02:39:46.846873+0000","last_active":"2024-09-21T02:42:11.832118+0000","last_peered":"2024-09-21T02:42:11.832118+0000","last_clean":"2024-09-21T02:42:11.832118+0000","last_became_active":"2024-09-21T02:39:46.846502+0000","last_became_peered":"2024-09-21T02:39:46.846502+0000","last_unstale":"2024-09-21T02:42:11.832118+0000","last_undegraded":"2024-09-21T02:42:11.832118+0000","last_fullsized":"2024-09-21T02:42:11.832118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:20.956683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346975+0000","last_change":"2024-09-21T02:39:43.832273+0000","last_active":"2024-09-21T02:41:44.346975+0000","last_peered":"2024-09-21T02:41:44.346975+0000","last_clean":"2024-09-21T02:41:44.346975+0000","last_became_active":"2024-09-21T02:39:43.831705+0000","last_became_peered":"2024-09-21T02:39:43.831705+0000","last_unstale":"2024-09-21T02:41:44.346975+0000","last_undegraded":"2024-09-21T02:41:44.346975+0000","last_fullsized":"2024-09-21T02:41:44.346975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:31.498975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348025+0000","last_change":"2024-09-21T02:39:56.920277+0000","last_active":"2024-09-21T02:41:44.348025+0000","last_peered":"2024-09-21T02:41:44.348025+0000","last_clean":"2024-09-21T02:41:44.348025+0000","last_became_active":"2024-09-21T02:39:56.919885+0000","last_became_peered":"2024-09-21T02:39:56.919885+0000","last_unstale":"2024-09-21T02:41:44.348025+0000","last_undegraded":"2024-09-21T02:41:44.348025+0000","last_fullsized":"2024-09-21T02:41:44.348025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:32.750878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819927+0000","last_change":"2024-09-21T02:40:43.413459+0000","last_active":"2024-09-21T02:42:11.819927+0000","last_peered":"2024-09-21T02:42:11.819927+0000","last_clean":"2024-09-21T02:42:11.819927+0000","last_became_active":"2024-09-21T02:40:43.413012+0000","last_became_peered":"2024-09-21T02:40:43.413012+0000","last_unstale":"2024-09-21T02:42:11.819927+0000","last_undegraded":"2024-09-21T02:42:11.819927+0000","last_fullsized":"2024-09-21T02:42:11.819927+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:23.971450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697477+0000","last_change":"2024-09-21T02:39:43.821955+0000","last_active":"2024-09-21T02:41:44.697477+0000","last_peered":"2024-09-21T02:41:44.697477+0000","last_clean":"2024-09-21T02:41:44.697477+0000","last_became_active":"2024-09-21T02:39:43.820480+0000","last_became_peered":"2024-09-21T02:39:43.820480+0000","last_unstale":"2024-09-21T02:41:44.697477+0000","last_undegraded":"2024-09-21T02:41:44.697477+0000","last_fullsized":"2024-09-21T02:41:44.697477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:51.201528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348049+0000","last_change":"2024-09-21T02:39:56.922017+0000","last_active":"2024-09-21T02:41:44.348049+0000","last_peered":"2024-09-21T02:41:44.348049+0000","last_clean":"2024-09-21T02:41:44.348049+0000","last_became_active":"2024-09-21T02:39:56.921616+0000","last_became_peered":"2024-09-21T02:39:56.921616+0000","last_unstale":"2024-09-21T02:41:44.348049+0000","last_undegraded":"2024-09-21T02:41:44.348049+0000","last_fullsized":"2024-09-21T02:41:44.348049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:38.499302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818794+0000","last_change":"2024-09-21T02:39:46.855445+0000","last_active":"2024-09-21T02:42:11.818794+0000","last_peered":"2024-09-21T02:42:11.818794+0000","last_clean":"2024-09-21T02:42:11.818794+0000","last_became_active":"2024-09-21T02:39:46.855053+0000","last_became_peered":"2024-09-21T02:39:46.855053+0000","last_unstale":"2024-09-21T02:42:11.818794+0000","last_undegraded":"2024-09-21T02:42:11.818794+0000","last_fullsized":"2024-09-21T02:42:11.818794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:19.122862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.696637+0000","last_change":"2024-09-21T02:39:43.822744+0000","last_active":"2024-09-21T02:41:44.696637+0000","last_peered":"2024-09-21T02:41:44.696637+0000","last_clean":"2024-09-21T02:41:44.696637+0000","last_became_active":"2024-09-21T02:39:43.822339+0000","last_became_peered":"2024-09-21T02:39:43.822339+0000","last_unstale":"2024-09-21T02:41:44.696637+0000","last_undegraded":"2024-09-21T02:41:44.696637+0000","last_fullsized":"2024-09-21T02:41:44.696637+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:44:21.370224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346987+0000","last_change":"2024-09-21T02:39:56.929280+0000","last_active":"2024-09-21T02:41:44.346987+0000","last_peered":"2024-09-21T02:41:44.346987+0000","last_clean":"2024-09-21T02:41:44.346987+0000","last_became_active":"2024-09-21T02:39:56.928826+0000","last_became_peered":"2024-09-21T02:39:56.928826+0000","last_unstale":"2024-09-21T02:41:44.346987+0000","last_undegraded":"2024-09-21T02:41:44.346987+0000","last_fullsized":"2024-09-21T02:41:44.346987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:01.597772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.829790+0000","last_change":"2024-09-21T02:39:46.852466+0000","last_active":"2024-09-21T02:42:11.829790+0000","last_peered":"2024-09-21T02:42:11.829790+0000","last_clean":"2024-09-21T02:42:11.829790+0000","last_became_active":"2024-09-21T02:39:46.852113+0000","last_became_peered":"2024-09-21T02:39:46.852113+0000","last_unstale":"2024-09-21T02:42:11.829790+0000","last_undegraded":"2024-09-21T02:42:11.829790+0000","last_fullsized":"2024-09-21T02:42:11.829790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:26.524693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'6","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:39.600642+0000","last_change":"2024-09-21T02:39:43.822241+0000","last_active":"2024-09-21T02:42:39.600642+0000","last_peered":"2024-09-21T02:42:39.600642+0000","last_clean":"2024-09-21T02:42:39.600642+0000","last_became_active":"2024-09-21T02:39:43.820813+0000","last_became_peered":"2024-09-21T02:39:43.820813+0000","last_unstale":"2024-09-21T02:42:39.600642+0000","last_undegraded":"2024-09-21T02:42:39.600642+0000","last_fullsized":"2024-09-21T02:42:39.600642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:09.749207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.697239+0000","last_change":"2024-09-21T02:40:43.405942+0000","last_active":"2024-09-21T02:41:44.697239+0000","last_peered":"2024-09-21T02:41:44.697239+0000","last_clean":"2024-09-21T02:41:44.697239+0000","last_became_active":"2024-09-21T02:40:43.405455+0000","last_became_peered":"2024-09-21T02:40:43.405455+0000","last_unstale":"2024-09-21T02:41:44.697239+0000","last_undegraded":"2024-09-21T02:41:44.697239+0000","last_fullsized":"2024-09-21T02:41:44.697239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:28.594724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833646+0000","last_change":"2024-09-21T02:40:43.417498+0000","last_active":"2024-09-21T02:42:11.833646+0000","last_peered":"2024-09-21T02:42:11.833646+0000","last_clean":"2024-09-21T02:42:11.833646+0000","last_became_active":"2024-09-21T02:40:43.417203+0000","last_became_peered":"2024-09-21T02:40:43.417203+0000","last_unstale":"2024-09-21T02:42:11.833646+0000","last_undegraded":"2024-09-21T02:42:11.833646+0000","last_fullsized":"2024-09-21T02:42:11.833646+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:43.618931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348740+0000","last_change":"2024-09-21T02:39:43.827493+0000","last_active":"2024-09-21T02:41:44.348740+0000","last_peered":"2024-09-21T02:41:44.348740+0000","last_clean":"2024-09-21T02:41:44.348740+0000","last_became_active":"2024-09-21T02:39:43.826824+0000","last_became_peered":"2024-09-21T02:39:43.826824+0000","last_unstale":"2024-09-21T02:41:44.348740+0000","last_undegraded":"2024-09-21T02:41:44.348740+0000","last_fullsized":"2024-09-21T02:41:44.348740+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:41:21.320101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343157+0000","last_change":"2024-09-21T02:39:56.929122+0000","last_active":"2024-09-21T02:41:44.343157+0000","last_peered":"2024-09-21T02:41:44.343157+0000","last_clean":"2024-09-21T02:41:44.343157+0000","last_became_active":"2024-09-21T02:39:56.928633+0000","last_became_peered":"2024-09-21T02:39:56.928633+0000","last_unstale":"2024-09-21T02:41:44.343157+0000","last_undegraded":"2024-09-21T02:41:44.343157+0000","last_fullsized":"2024-09-21T02:41:44.343157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:56.599982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.815820+0000","last_change":"2024-09-21T02:39:46.866922+0000","last_active":"2024-09-21T02:42:11.815820+0000","last_peered":"2024-09-21T02:42:11.815820+0000","last_clean":"2024-09-21T02:42:11.815820+0000","last_became_active":"2024-09-21T02:39:46.866061+0000","last_became_peered":"2024-09-21T02:39:46.866061+0000","last_unstale":"2024-09-21T02:42:11.815820+0000","last_undegraded":"2024-09-21T02:42:11.815820+0000","last_fullsized":"2024-09-21T02:42:11.815820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:02.707212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344889+0000","last_change":"2024-09-21T02:39:43.824188+0000","last_active":"2024-09-21T02:41:44.344889+0000","last_peered":"2024-09-21T02:41:44.344889+0000","last_clean":"2024-09-21T02:41:44.344889+0000","last_became_active":"2024-09-21T02:39:43.823760+0000","last_became_peered":"2024-09-21T02:39:43.823760+0000","last_unstale":"2024-09-21T02:41:44.344889+0000","last_undegraded":"2024-09-21T02:41:44.344889+0000","last_fullsized":"2024-09-21T02:41:44.344889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:56.770947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348930+0000","last_change":"2024-09-21T02:39:56.920213+0000","last_active":"2024-09-21T02:41:44.348930+0000","last_peered":"2024-09-21T02:41:44.348930+0000","last_clean":"2024-09-21T02:41:44.348930+0000","last_became_active":"2024-09-21T02:39:56.919796+0000","last_became_peered":"2024-09-21T02:39:56.919796+0000","last_unstale":"2024-09-21T02:41:44.348930+0000","last_undegraded":"2024-09-21T02:41:44.348930+0000","last_fullsized":"2024-09-21T02:41:44.348930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:44:32.162844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820668+0000","last_change":"2024-09-21T02:39:46.846759+0000","last_active":"2024-09-21T02:42:11.820668+0000","last_peered":"2024-09-21T02:42:11.820668+0000","last_clean":"2024-09-21T02:42:11.820668+0000","last_became_active":"2024-09-21T02:39:46.846315+0000","last_became_peered":"2024-09-21T02:39:46.846315+0000","last_unstale":"2024-09-21T02:42:11.820668+0000","last_undegraded":"2024-09-21T02:42:11.820668+0000","last_fullsized":"2024-09-21T02:42:11.820668+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:41.144576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'39","reported_seq":332,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:40.603607+0000","last_change":"2024-09-21T02:39:43.824564+0000","last_active":"2024-09-21T02:42:40.603607+0000","last_peered":"2024-09-21T02:42:40.603607+0000","last_clean":"2024-09-21T02:42:40.603607+0000","last_became_active":"2024-09-21T02:39:43.824190+0000","last_became_peered":"2024-09-21T02:39:43.824190+0000","last_unstale":"2024-09-21T02:42:40.603607+0000","last_undegraded":"2024-09-21T02:42:40.603607+0000","last_fullsized":"2024-09-21T02:42:40.603607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:45.847144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74958,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":247,"num_read_kb":197,"num_write":40,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348367+0000","last_change":"2024-09-21T02:39:56.928936+0000","last_active":"2024-09-21T02:41:44.348367+0000","last_peered":"2024-09-21T02:41:44.348367+0000","last_clean":"2024-09-21T02:41:44.348367+0000","last_became_active":"2024-09-21T02:39:56.927999+0000","last_became_peered":"2024-09-21T02:39:56.927999+0000","last_unstale":"2024-09-21T02:41:44.348367+0000","last_undegraded":"2024-09-21T02:41:44.348367+0000","last_fullsized":"2024-09-21T02:41:44.348367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:33.988594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833671+0000","last_change":"2024-09-21T02:39:46.860572+0000","last_active":"2024-09-21T02:42:11.833671+0000","last_peered":"2024-09-21T02:42:11.833671+0000","last_clean":"2024-09-21T02:42:11.833671+0000","last_became_active":"2024-09-21T02:39:46.860073+0000","last_became_peered":"2024-09-21T02:39:46.860073+0000","last_unstale":"2024-09-21T02:42:11.833671+0000","last_undegraded":"2024-09-21T02:42:11.833671+0000","last_fullsized":"2024-09-21T02:42:11.833671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:48.355107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.349149+0000","last_change":"2024-09-21T02:39:43.828437+0000","last_active":"2024-09-21T02:41:44.349149+0000","last_peered":"2024-09-21T02:41:44.349149+0000","last_clean":"2024-09-21T02:41:44.349149+0000","last_became_active":"2024-09-21T02:39:43.828033+0000","last_became_peered":"2024-09-21T02:39:43.828033+0000","last_unstale":"2024-09-21T02:41:44.349149+0000","last_undegraded":"2024-09-21T02:41:44.349149+0000","last_fullsized":"2024-09-21T02:41:44.349149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:24.065773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487351+0000","last_change":"2024-09-21T02:39:56.937714+0000","last_active":"2024-09-21T02:41:44.487351+0000","last_peered":"2024-09-21T02:41:44.487351+0000","last_clean":"2024-09-21T02:41:44.487351+0000","last_became_active":"2024-09-21T02:39:56.937145+0000","last_became_peered":"2024-09-21T02:39:56.937145+0000","last_unstale":"2024-09-21T02:41:44.487351+0000","last_undegraded":"2024-09-21T02:41:44.487351+0000","last_fullsized":"2024-09-21T02:41:44.487351+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:59.265795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.826005+0000","last_change":"2024-09-21T02:39:46.864600+0000","last_active":"2024-09-21T02:42:11.826005+0000","last_peered":"2024-09-21T02:42:11.826005+0000","last_clean":"2024-09-21T02:42:11.826005+0000","last_became_active":"2024-09-21T02:39:46.862043+0000","last_became_peered":"2024-09-21T02:39:46.862043+0000","last_unstale":"2024-09-21T02:42:11.826005+0000","last_undegraded":"2024-09-21T02:42:11.826005+0000","last_fullsized":"2024-09-21T02:42:11.826005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:28.119974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346236+0000","last_change":"2024-09-21T02:39:43.825910+0000","last_active":"2024-09-21T02:41:44.346236+0000","last_peered":"2024-09-21T02:41:44.346236+0000","last_clean":"2024-09-21T02:41:44.346236+0000","last_became_active":"2024-09-21T02:39:43.825370+0000","last_became_peered":"2024-09-21T02:39:43.825370+0000","last_unstale":"2024-09-21T02:41:44.346236+0000","last_undegraded":"2024-09-21T02:41:44.346236+0000","last_fullsized":"2024-09-21T02:41:44.346236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:05.410114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348035+0000","last_change":"2024-09-21T02:39:56.935321+0000","last_active":"2024-09-21T02:41:44.348035+0000","last_peered":"2024-09-21T02:41:44.348035+0000","last_clean":"2024-09-21T02:41:44.348035+0000","last_became_active":"2024-09-21T02:39:56.931669+0000","last_became_peered":"2024-09-21T02:39:56.931669+0000","last_unstale":"2024-09-21T02:41:44.348035+0000","last_undegraded":"2024-09-21T02:41:44.348035+0000","last_fullsized":"2024-09-21T02:41:44.348035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:20.323574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.832138+0000","last_change":"2024-09-21T02:39:46.853469+0000","last_active":"2024-09-21T02:42:11.832138+0000","last_peered":"2024-09-21T02:42:11.832138+0000","last_clean":"2024-09-21T02:42:11.832138+0000","last_became_active":"2024-09-21T02:39:46.853133+0000","last_became_peered":"2024-09-21T02:39:46.853133+0000","last_unstale":"2024-09-21T02:42:11.832138+0000","last_undegraded":"2024-09-21T02:42:11.832138+0000","last_fullsized":"2024-09-21T02:42:11.832138+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:38.055341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":170,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:39.600900+0000","last_change":"2024-09-21T02:39:43.828678+0000","last_active":"2024-09-21T02:42:39.600900+0000","last_peered":"2024-09-21T02:42:39.600900+0000","last_clean":"2024-09-21T02:42:39.600900+0000","last_became_active":"2024-09-21T02:39:43.828281+0000","last_became_peered":"2024-09-21T02:39:43.828281+0000","last_unstale":"2024-09-21T02:42:39.600900+0000","last_undegraded":"2024-09-21T02:42:39.600900+0000","last_fullsized":"2024-09-21T02:42:39.600900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:42.678028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.342305+0000","last_change":"2024-09-21T02:39:56.920489+0000","last_active":"2024-09-21T02:41:44.342305+0000","last_peered":"2024-09-21T02:41:44.342305+0000","last_clean":"2024-09-21T02:41:44.342305+0000","last_became_active":"2024-09-21T02:39:56.920031+0000","last_became_peered":"2024-09-21T02:39:56.920031+0000","last_unstale":"2024-09-21T02:41:44.342305+0000","last_undegraded":"2024-09-21T02:41:44.342305+0000","last_fullsized":"2024-09-21T02:41:44.342305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:34:56.576113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.486936+0000","last_change":"2024-09-21T02:39:56.922470+0000","last_active":"2024-09-21T02:41:44.486936+0000","last_peered":"2024-09-21T02:41:44.486936+0000","last_clean":"2024-09-21T02:41:44.486936+0000","last_became_active":"2024-09-21T02:39:56.922014+0000","last_became_peered":"2024-09-21T02:39:56.922014+0000","last_unstale":"2024-09-21T02:41:44.486936+0000","last_undegraded":"2024-09-21T02:41:44.486936+0000","last_fullsized":"2024-09-21T02:41:44.486936+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:25.307835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812435+0000","last_change":"2024-09-21T02:39:46.852869+0000","last_active":"2024-09-21T02:42:11.812435+0000","last_peered":"2024-09-21T02:42:11.812435+0000","last_clean":"2024-09-21T02:42:11.812435+0000","last_became_active":"2024-09-21T02:39:46.852237+0000","last_became_peered":"2024-09-21T02:39:46.852237+0000","last_unstale":"2024-09-21T02:42:11.812435+0000","last_undegraded":"2024-09-21T02:42:11.812435+0000","last_fullsized":"2024-09-21T02:42:11.812435+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:00:10.729381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.348373+0000","last_change":"2024-09-21T02:39:43.827358+0000","last_active":"2024-09-21T02:41:44.348373+0000","last_peered":"2024-09-21T02:41:44.348373+0000","last_clean":"2024-09-21T02:41:44.348373+0000","last_became_active":"2024-09-21T02:39:43.826910+0000","last_became_peered":"2024-09-21T02:39:43.826910+0000","last_unstale":"2024-09-21T02:41:44.348373+0000","last_undegraded":"2024-09-21T02:41:44.348373+0000","last_fullsized":"2024-09-21T02:41:44.348373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:48.528314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.343598+0000","last_change":"2024-09-21T02:39:56.930809+0000","last_active":"2024-09-21T02:41:44.343598+0000","last_peered":"2024-09-21T02:41:44.343598+0000","last_clean":"2024-09-21T02:41:44.343598+0000","last_became_active":"2024-09-21T02:39:56.930355+0000","last_became_peered":"2024-09-21T02:39:56.930355+0000","last_unstale":"2024-09-21T02:41:44.343598+0000","last_undegraded":"2024-09-21T02:41:44.343598+0000","last_fullsized":"2024-09-21T02:41:44.343598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:39:41.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823944+0000","last_change":"2024-09-21T02:39:46.856046+0000","last_active":"2024-09-21T02:42:11.823944+0000","last_peered":"2024-09-21T02:42:11.823944+0000","last_clean":"2024-09-21T02:42:11.823944+0000","last_became_active":"2024-09-21T02:39:46.855675+0000","last_became_peered":"2024-09-21T02:39:46.855675+0000","last_unstale":"2024-09-21T02:42:11.823944+0000","last_undegraded":"2024-09-21T02:42:11.823944+0000","last_fullsized":"2024-09-21T02:42:11.823944+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:03.547082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.346460+0000","last_change":"2024-09-21T02:39:43.828888+0000","last_active":"2024-09-21T02:41:44.346460+0000","last_peered":"2024-09-21T02:41:44.346460+0000","last_clean":"2024-09-21T02:41:44.346460+0000","last_became_active":"2024-09-21T02:39:43.828340+0000","last_became_peered":"2024-09-21T02:39:43.828340+0000","last_unstale":"2024-09-21T02:41:44.346460+0000","last_undegraded":"2024-09-21T02:41:44.346460+0000","last_fullsized":"2024-09-21T02:41:44.346460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:09.017191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.487223+0000","last_change":"2024-09-21T02:39:43.828957+0000","last_active":"2024-09-21T02:41:44.487223+0000","last_peered":"2024-09-21T02:41:44.487223+0000","last_clean":"2024-09-21T02:41:44.487223+0000","last_became_active":"2024-09-21T02:39:43.827899+0000","last_became_peered":"2024-09-21T02:39:43.827899+0000","last_unstale":"2024-09-21T02:41:44.487223+0000","last_undegraded":"2024-09-21T02:41:44.487223+0000","last_fullsized":"2024-09-21T02:41:44.487223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:36.727082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.827569+0000","last_change":"2024-09-21T02:39:46.855278+0000","last_active":"2024-09-21T02:42:11.827569+0000","last_peered":"2024-09-21T02:42:11.827569+0000","last_clean":"2024-09-21T02:42:11.827569+0000","last_became_active":"2024-09-21T02:39:46.854905+0000","last_became_peered":"2024-09-21T02:39:46.854905+0000","last_unstale":"2024-09-21T02:42:11.827569+0000","last_undegraded":"2024-09-21T02:42:11.827569+0000","last_fullsized":"2024-09-21T02:42:11.827569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:29.244912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344742+0000","last_change":"2024-09-21T02:39:56.931183+0000","last_active":"2024-09-21T02:41:44.344742+0000","last_peered":"2024-09-21T02:41:44.344742+0000","last_clean":"2024-09-21T02:41:44.344742+0000","last_became_active":"2024-09-21T02:39:56.930776+0000","last_became_peered":"2024-09-21T02:39:56.930776+0000","last_unstale":"2024-09-21T02:41:44.344742+0000","last_undegraded":"2024-09-21T02:41:44.344742+0000","last_fullsized":"2024-09-21T02:41:44.344742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:56.272272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"88'9","reported_seq":180,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:39.602350+0000","last_change":"2024-09-21T02:39:43.823668+0000","last_active":"2024-09-21T02:42:39.602350+0000","last_peered":"2024-09-21T02:42:39.602350+0000","last_clean":"2024-09-21T02:42:39.602350+0000","last_became_active":"2024-09-21T02:39:43.823132+0000","last_became_peered":"2024-09-21T02:39:43.823132+0000","last_unstale":"2024-09-21T02:42:39.602350+0000","last_undegraded":"2024-09-21T02:42:39.602350+0000","last_fullsized":"2024-09-21T02:42:39.602350+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:42.789716+0000","last_clean_scrub_stamp":"2024-09-21T02:39:42.789716+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:33.187554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1856,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822148+0000","last_change":"2024-09-21T02:39:46.845740+0000","last_active":"2024-09-21T02:42:11.822148+0000","last_peered":"2024-09-21T02:42:11.822148+0000","last_clean":"2024-09-21T02:42:11.822148+0000","last_became_active":"2024-09-21T02:39:46.845361+0000","last_became_peered":"2024-09-21T02:39:46.845361+0000","last_unstale":"2024-09-21T02:42:11.822148+0000","last_undegraded":"2024-09-21T02:42:11.822148+0000","last_fullsized":"2024-09-21T02:42:11.822148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:15.546769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:41:44.344941+0000","last_change":"2024-09-21T02:39:56.919760+0000","last_active":"2024-09-21T02:41:44.344941+0000","last_peered":"2024-09-21T02:41:44.344941+0000","last_clean":"2024-09-21T02:41:44.344941+0000","last_became_active":"2024-09-21T02:39:56.919315+0000","last_became_peered":"2024-09-21T02:39:56.919315+0000","last_unstale":"2024-09-21T02:41:44.344941+0000","last_undegraded":"2024-09-21T02:41:44.344941+0000","last_fullsized":"2024-09-21T02:41:44.344941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:55.890268+0000","last_clean_scrub_stamp":"2024-09-21T02:39:55.890268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:52.889707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.823082+0000","last_change":"2024-09-21T02:39:46.848040+0000","last_active":"2024-09-21T02:42:11.823082+0000","last_peered":"2024-09-21T02:42:11.823082+0000","last_clean":"2024-09-21T02:42:11.823082+0000","last_became_active":"2024-09-21T02:39:46.847627+0000","last_became_peered":"2024-09-21T02:39:46.847627+0000","last_unstale":"2024-09-21T02:42:11.823082+0000","last_undegraded":"2024-09-21T02:42:11.823082+0000","last_fullsized":"2024-09-21T02:42:11.823082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:14.139156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.814594+0000","last_change":"2024-09-21T02:39:46.853208+0000","last_active":"2024-09-21T02:42:11.814594+0000","last_peered":"2024-09-21T02:42:11.814594+0000","last_clean":"2024-09-21T02:42:11.814594+0000","last_became_active":"2024-09-21T02:39:46.852821+0000","last_became_peered":"2024-09-21T02:39:46.852821+0000","last_unstale":"2024-09-21T02:42:11.814594+0000","last_undegraded":"2024-09-21T02:42:11.814594+0000","last_fullsized":"2024-09-21T02:42:11.814594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:37:24.597702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.817363+0000","last_change":"2024-09-21T02:39:46.866239+0000","last_active":"2024-09-21T02:42:11.817363+0000","last_peered":"2024-09-21T02:42:11.817363+0000","last_clean":"2024-09-21T02:42:11.817363+0000","last_became_active":"2024-09-21T02:39:46.865935+0000","last_became_peered":"2024-09-21T02:39:46.865935+0000","last_unstale":"2024-09-21T02:42:11.817363+0000","last_undegraded":"2024-09-21T02:42:11.817363+0000","last_fullsized":"2024-09-21T02:42:11.817363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:45.420521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.827231+0000","last_change":"2024-09-21T02:39:46.861857+0000","last_active":"2024-09-21T02:42:11.827231+0000","last_peered":"2024-09-21T02:42:11.827231+0000","last_clean":"2024-09-21T02:42:11.827231+0000","last_became_active":"2024-09-21T02:39:46.861512+0000","last_became_peered":"2024-09-21T02:39:46.861512+0000","last_unstale":"2024-09-21T02:42:11.827231+0000","last_undegraded":"2024-09-21T02:42:11.827231+0000","last_fullsized":"2024-09-21T02:42:11.827231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:16.044159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824496+0000","last_change":"2024-09-21T02:39:46.858655+0000","last_active":"2024-09-21T02:42:11.824496+0000","last_peered":"2024-09-21T02:42:11.824496+0000","last_clean":"2024-09-21T02:42:11.824496+0000","last_became_active":"2024-09-21T02:39:46.858376+0000","last_became_peered":"2024-09-21T02:39:46.858376+0000","last_unstale":"2024-09-21T02:42:11.824496+0000","last_undegraded":"2024-09-21T02:42:11.824496+0000","last_fullsized":"2024-09-21T02:42:11.824496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:26:16.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822418+0000","last_change":"2024-09-21T02:39:46.847973+0000","last_active":"2024-09-21T02:42:11.822418+0000","last_peered":"2024-09-21T02:42:11.822418+0000","last_clean":"2024-09-21T02:42:11.822418+0000","last_became_active":"2024-09-21T02:39:46.846957+0000","last_became_peered":"2024-09-21T02:39:46.846957+0000","last_unstale":"2024-09-21T02:42:11.822418+0000","last_undegraded":"2024-09-21T02:42:11.822418+0000","last_fullsized":"2024-09-21T02:42:11.822418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:44.077854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812203+0000","last_change":"2024-09-21T02:39:46.851310+0000","last_active":"2024-09-21T02:42:11.812203+0000","last_peered":"2024-09-21T02:42:11.812203+0000","last_clean":"2024-09-21T02:42:11.812203+0000","last_became_active":"2024-09-21T02:39:46.850666+0000","last_became_peered":"2024-09-21T02:39:46.850666+0000","last_unstale":"2024-09-21T02:42:11.812203+0000","last_undegraded":"2024-09-21T02:42:11.812203+0000","last_fullsized":"2024-09-21T02:42:11.812203+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:48.354795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.801547+0000","last_change":"2024-09-21T02:39:46.857409+0000","last_active":"2024-09-21T02:42:11.801547+0000","last_peered":"2024-09-21T02:42:11.801547+0000","last_clean":"2024-09-21T02:42:11.801547+0000","last_became_active":"2024-09-21T02:39:46.856974+0000","last_became_peered":"2024-09-21T02:39:46.856974+0000","last_unstale":"2024-09-21T02:42:11.801547+0000","last_undegraded":"2024-09-21T02:42:11.801547+0000","last_fullsized":"2024-09-21T02:42:11.801547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:58.140154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818137+0000","last_change":"2024-09-21T02:39:46.844168+0000","last_active":"2024-09-21T02:42:11.818137+0000","last_peered":"2024-09-21T02:42:11.818137+0000","last_clean":"2024-09-21T02:42:11.818137+0000","last_became_active":"2024-09-21T02:39:46.843509+0000","last_became_peered":"2024-09-21T02:39:46.843509+0000","last_unstale":"2024-09-21T02:42:11.818137+0000","last_undegraded":"2024-09-21T02:42:11.818137+0000","last_fullsized":"2024-09-21T02:42:11.818137+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:00.899890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.817598+0000","last_change":"2024-09-21T02:39:46.854805+0000","last_active":"2024-09-21T02:42:11.817598+0000","last_peered":"2024-09-21T02:42:11.817598+0000","last_clean":"2024-09-21T02:42:11.817598+0000","last_became_active":"2024-09-21T02:39:46.850248+0000","last_became_peered":"2024-09-21T02:39:46.850248+0000","last_unstale":"2024-09-21T02:42:11.817598+0000","last_undegraded":"2024-09-21T02:42:11.817598+0000","last_fullsized":"2024-09-21T02:42:11.817598+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:45.628337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834880+0000","last_change":"2024-09-21T02:39:46.866278+0000","last_active":"2024-09-21T02:42:11.834880+0000","last_peered":"2024-09-21T02:42:11.834880+0000","last_clean":"2024-09-21T02:42:11.834880+0000","last_became_active":"2024-09-21T02:39:46.865810+0000","last_became_peered":"2024-09-21T02:39:46.865810+0000","last_unstale":"2024-09-21T02:42:11.834880+0000","last_undegraded":"2024-09-21T02:42:11.834880+0000","last_fullsized":"2024-09-21T02:42:11.834880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:02.754340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.824217+0000","last_change":"2024-09-21T02:39:46.857721+0000","last_active":"2024-09-21T02:42:11.824217+0000","last_peered":"2024-09-21T02:42:11.824217+0000","last_clean":"2024-09-21T02:42:11.824217+0000","last_became_active":"2024-09-21T02:39:46.853640+0000","last_became_peered":"2024-09-21T02:39:46.853640+0000","last_unstale":"2024-09-21T02:42:11.824217+0000","last_undegraded":"2024-09-21T02:42:11.824217+0000","last_fullsized":"2024-09-21T02:42:11.824217+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:54.019607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.819500+0000","last_change":"2024-09-21T02:40:43.413457+0000","last_active":"2024-09-21T02:42:11.819500+0000","last_peered":"2024-09-21T02:42:11.819500+0000","last_clean":"2024-09-21T02:42:11.819500+0000","last_became_active":"2024-09-21T02:40:43.413000+0000","last_became_peered":"2024-09-21T02:40:43.413000+0000","last_unstale":"2024-09-21T02:42:11.819500+0000","last_undegraded":"2024-09-21T02:42:11.819500+0000","last_fullsized":"2024-09-21T02:42:11.819500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:27.775410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.818391+0000","last_change":"2024-09-21T02:39:46.857169+0000","last_active":"2024-09-21T02:42:11.818391+0000","last_peered":"2024-09-21T02:42:11.818391+0000","last_clean":"2024-09-21T02:42:11.818391+0000","last_became_active":"2024-09-21T02:39:46.856757+0000","last_became_peered":"2024-09-21T02:39:46.856757+0000","last_unstale":"2024-09-21T02:42:11.818391+0000","last_undegraded":"2024-09-21T02:42:11.818391+0000","last_fullsized":"2024-09-21T02:42:11.818391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:36.729746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.812141+0000","last_change":"2024-09-21T02:39:46.854162+0000","last_active":"2024-09-21T02:42:11.812141+0000","last_peered":"2024-09-21T02:42:11.812141+0000","last_clean":"2024-09-21T02:42:11.812141+0000","last_became_active":"2024-09-21T02:39:46.853697+0000","last_became_peered":"2024-09-21T02:39:46.853697+0000","last_unstale":"2024-09-21T02:42:11.812141+0000","last_undegraded":"2024-09-21T02:42:11.812141+0000","last_fullsized":"2024-09-21T02:42:11.812141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:40.605606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830324+0000","last_change":"2024-09-21T02:39:46.853570+0000","last_active":"2024-09-21T02:42:11.830324+0000","last_peered":"2024-09-21T02:42:11.830324+0000","last_clean":"2024-09-21T02:42:11.830324+0000","last_became_active":"2024-09-21T02:39:46.853074+0000","last_became_peered":"2024-09-21T02:39:46.853074+0000","last_unstale":"2024-09-21T02:42:11.830324+0000","last_undegraded":"2024-09-21T02:42:11.830324+0000","last_fullsized":"2024-09-21T02:42:11.830324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:31:02.642887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.834080+0000","last_change":"2024-09-21T02:39:46.850070+0000","last_active":"2024-09-21T02:42:11.834080+0000","last_peered":"2024-09-21T02:42:11.834080+0000","last_clean":"2024-09-21T02:42:11.834080+0000","last_became_active":"2024-09-21T02:39:46.849668+0000","last_became_peered":"2024-09-21T02:39:46.849668+0000","last_unstale":"2024-09-21T02:42:11.834080+0000","last_undegraded":"2024-09-21T02:42:11.834080+0000","last_fullsized":"2024-09-21T02:42:11.834080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:59.185574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822391+0000","last_change":"2024-09-21T02:40:43.403735+0000","last_active":"2024-09-21T02:42:11.822391+0000","last_peered":"2024-09-21T02:42:11.822391+0000","last_clean":"2024-09-21T02:42:11.822391+0000","last_became_active":"2024-09-21T02:40:43.403330+0000","last_became_peered":"2024-09-21T02:40:43.403330+0000","last_unstale":"2024-09-21T02:42:11.822391+0000","last_undegraded":"2024-09-21T02:42:11.822391+0000","last_fullsized":"2024-09-21T02:42:11.822391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:51:35.043475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.821969+0000","last_change":"2024-09-21T02:39:46.850811+0000","last_active":"2024-09-21T02:42:11.821969+0000","last_peered":"2024-09-21T02:42:11.821969+0000","last_clean":"2024-09-21T02:42:11.821969+0000","last_became_active":"2024-09-21T02:39:46.850423+0000","last_became_peered":"2024-09-21T02:39:46.850423+0000","last_unstale":"2024-09-21T02:42:11.821969+0000","last_undegraded":"2024-09-21T02:42:11.821969+0000","last_fullsized":"2024-09-21T02:42:11.821969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:47.343607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822683+0000","last_change":"2024-09-21T02:39:46.851169+0000","last_active":"2024-09-21T02:42:11.822683+0000","last_peered":"2024-09-21T02:42:11.822683+0000","last_clean":"2024-09-21T02:42:11.822683+0000","last_became_active":"2024-09-21T02:39:46.850258+0000","last_became_peered":"2024-09-21T02:39:46.850258+0000","last_unstale":"2024-09-21T02:42:11.822683+0000","last_undegraded":"2024-09-21T02:42:11.822683+0000","last_fullsized":"2024-09-21T02:42:11.822683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:02.588325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.808504+0000","last_change":"2024-09-21T02:39:46.854082+0000","last_active":"2024-09-21T02:42:11.808504+0000","last_peered":"2024-09-21T02:42:11.808504+0000","last_clean":"2024-09-21T02:42:11.808504+0000","last_became_active":"2024-09-21T02:39:46.852226+0000","last_became_peered":"2024-09-21T02:39:46.852226+0000","last_unstale":"2024-09-21T02:42:11.808504+0000","last_undegraded":"2024-09-21T02:42:11.808504+0000","last_fullsized":"2024-09-21T02:42:11.808504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:41.960472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.835143+0000","last_change":"2024-09-21T02:39:46.856222+0000","last_active":"2024-09-21T02:42:11.835143+0000","last_peered":"2024-09-21T02:42:11.835143+0000","last_clean":"2024-09-21T02:42:11.835143+0000","last_became_active":"2024-09-21T02:39:46.855868+0000","last_became_peered":"2024-09-21T02:39:46.855868+0000","last_unstale":"2024-09-21T02:42:11.835143+0000","last_undegraded":"2024-09-21T02:42:11.835143+0000","last_fullsized":"2024-09-21T02:42:11.835143+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:31.396030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":56,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.811992+0000","last_change":"2024-09-21T02:39:46.862312+0000","last_active":"2024-09-21T02:42:11.811992+0000","last_peered":"2024-09-21T02:42:11.811992+0000","last_clean":"2024-09-21T02:42:11.811992+0000","last_became_active":"2024-09-21T02:39:46.861921+0000","last_became_peered":"2024-09-21T02:39:46.861921+0000","last_unstale":"2024-09-21T02:42:11.811992+0000","last_undegraded":"2024-09-21T02:42:11.811992+0000","last_fullsized":"2024-09-21T02:42:11.811992+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:33.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.833822+0000","last_change":"2024-09-21T02:39:46.851155+0000","last_active":"2024-09-21T02:42:11.833822+0000","last_peered":"2024-09-21T02:42:11.833822+0000","last_clean":"2024-09-21T02:42:11.833822+0000","last_became_active":"2024-09-21T02:39:46.850809+0000","last_became_peered":"2024-09-21T02:39:46.850809+0000","last_unstale":"2024-09-21T02:42:11.833822+0000","last_undegraded":"2024-09-21T02:42:11.833822+0000","last_fullsized":"2024-09-21T02:42:11.833822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.716138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.820047+0000","last_change":"2024-09-21T02:39:46.850585+0000","last_active":"2024-09-21T02:42:11.820047+0000","last_peered":"2024-09-21T02:42:11.820047+0000","last_clean":"2024-09-21T02:42:11.820047+0000","last_became_active":"2024-09-21T02:39:46.850114+0000","last_became_peered":"2024-09-21T02:39:46.850114+0000","last_unstale":"2024-09-21T02:42:11.820047+0000","last_undegraded":"2024-09-21T02:42:11.820047+0000","last_fullsized":"2024-09-21T02:42:11.820047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:04.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.829001+0000","last_change":"2024-09-21T02:39:46.850416+0000","last_active":"2024-09-21T02:42:11.829001+0000","last_peered":"2024-09-21T02:42:11.829001+0000","last_clean":"2024-09-21T02:42:11.829001+0000","last_became_active":"2024-09-21T02:39:46.850035+0000","last_became_peered":"2024-09-21T02:39:46.850035+0000","last_unstale":"2024-09-21T02:42:11.829001+0000","last_undegraded":"2024-09-21T02:42:11.829001+0000","last_fullsized":"2024-09-21T02:42:11.829001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:09.139331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.813518+0000","last_change":"2024-09-21T02:39:46.861376+0000","last_active":"2024-09-21T02:42:11.813518+0000","last_peered":"2024-09-21T02:42:11.813518+0000","last_clean":"2024-09-21T02:42:11.813518+0000","last_became_active":"2024-09-21T02:39:46.861011+0000","last_became_peered":"2024-09-21T02:39:46.861011+0000","last_unstale":"2024-09-21T02:42:11.813518+0000","last_undegraded":"2024-09-21T02:42:11.813518+0000","last_fullsized":"2024-09-21T02:42:11.813518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:45.123705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.821886+0000","last_change":"2024-09-21T02:39:46.846135+0000","last_active":"2024-09-21T02:42:11.821886+0000","last_peered":"2024-09-21T02:42:11.821886+0000","last_clean":"2024-09-21T02:42:11.821886+0000","last_became_active":"2024-09-21T02:39:46.845693+0000","last_became_peered":"2024-09-21T02:39:46.845693+0000","last_unstale":"2024-09-21T02:42:11.821886+0000","last_undegraded":"2024-09-21T02:42:11.821886+0000","last_fullsized":"2024-09-21T02:42:11.821886+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:58:55.830932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.808763+0000","last_change":"2024-09-21T02:39:46.853300+0000","last_active":"2024-09-21T02:42:11.808763+0000","last_peered":"2024-09-21T02:42:11.808763+0000","last_clean":"2024-09-21T02:42:11.808763+0000","last_became_active":"2024-09-21T02:39:46.852953+0000","last_became_peered":"2024-09-21T02:39:46.852953+0000","last_unstale":"2024-09-21T02:42:11.808763+0000","last_undegraded":"2024-09-21T02:42:11.808763+0000","last_fullsized":"2024-09-21T02:42:11.808763+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:04.475743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.822522+0000","last_change":"2024-09-21T02:39:46.854976+0000","last_active":"2024-09-21T02:42:11.822522+0000","last_peered":"2024-09-21T02:42:11.822522+0000","last_clean":"2024-09-21T02:42:11.822522+0000","last_became_active":"2024-09-21T02:39:46.852970+0000","last_became_peered":"2024-09-21T02:39:46.852970+0000","last_unstale":"2024-09-21T02:42:11.822522+0000","last_undegraded":"2024-09-21T02:42:11.822522+0000","last_fullsized":"2024-09-21T02:42:11.822522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:54.654967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.815558+0000","last_change":"2024-09-21T02:39:46.848698+0000","last_active":"2024-09-21T02:42:11.815558+0000","last_peered":"2024-09-21T02:42:11.815558+0000","last_clean":"2024-09-21T02:42:11.815558+0000","last_became_active":"2024-09-21T02:39:46.848374+0000","last_became_peered":"2024-09-21T02:39:46.848374+0000","last_unstale":"2024-09-21T02:42:11.815558+0000","last_undegraded":"2024-09-21T02:42:11.815558+0000","last_fullsized":"2024-09-21T02:42:11.815558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:59.589062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-21T02:42:11.830099+0000","last_change":"2024-09-21T02:39:46.851850+0000","last_active":"2024-09-21T02:42:11.830099+0000","last_peered":"2024-09-21T02:42:11.830099+0000","last_clean":"2024-09-21T02:42:11.830099+0000","last_became_active":"2024-09-21T02:39:46.851408+0000","last_became_peered":"2024-09-21T02:39:46.851408+0000","last_unstale":"2024-09-21T02:42:11.830099+0000","last_undegraded":"2024-09-21T02:42:11.830099+0000","last_fullsized":"2024-09-21T02:42:11.830099+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T02:39:45.817708+0000","last_clean_scrub_stamp":"2024-09-21T02:39:45.817708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:27.831504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80725,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":747,"num_read_kb":460,"num_write":193,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":242175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939702,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1724416,"data_stored":1177950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103227,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":510941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":514957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495687,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1626112,"data_stored":1108536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659213,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":506117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855443,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1099105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986263,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":511690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182494,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":506311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36436,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708716,"statfs":{"total":95995035648,"available":95957725184,"internally_reserved":0,"allocated":1118208,"data_stored":583569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":580985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":507505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":77542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":77459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T02:42:45.860 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:42:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:45 smithi172 ceph-mon[35067]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:45 smithi172 ceph-mon[35067]: pgmap v410: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T02:42:46.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:45 smithi084 ceph-mon[30747]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:46.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:45 smithi084 ceph-mon[30747]: pgmap v410: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T02:42:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:45 smithi090 ceph-mon[34571]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T02:42:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:45 smithi090 ceph-mon[34571]: pgmap v410: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T02:42:46.268 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 -- 172.21.15.84:0/283301724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 msgr2=0x7f455c1085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 --2- 172.21.15.84:0/283301724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 0x7f455c1085c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4544009900 tx=0x7f454402a410 comp rx=0 tx=0).stop 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 -- 172.21.15.84:0/283301724 shutdown_connections 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 --2- 172.21.15.84:0/283301724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 0x7f455c1085c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 --2- 172.21.15.84:0/283301724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f455c108b00 0x7f455c10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 --2- 172.21.15.84:0/283301724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f455c102870 0x7f455c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 -- 172.21.15.84:0/283301724 >> 172.21.15.84:0/283301724 conn(0x7f455c0fe2c0 msgr2=0x7f455c100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 -- 172.21.15.84:0/283301724 shutdown_connections 2024-09-21T02:42:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.908+0000 7f4560a00640 1 -- 172.21.15.84:0/283301724 wait complete. 2024-09-21T02:42:46.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.910+0000 7f4560a00640 1 Processor -- start 2024-09-21T02:42:46.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.910+0000 7f4560a00640 1 -- start start 2024-09-21T02:42:46.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.910+0000 7f4560a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f455c102870 0x7f455c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:46.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.910+0000 7f4560a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 0x7f455c19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:46.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.910+0000 7f4560a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f455c108b00 0x7f455c19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:46.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.910+0000 7f4560a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1128a0 con 0x7f455c108b00 2024-09-21T02:42:46.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.910+0000 7f4560a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f455c112720 con 0x7f455c102870 2024-09-21T02:42:46.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.910+0000 7f4560a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f455c112a20 con 0x7f455c1081b0 2024-09-21T02:42:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f455b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f455c102870 0x7f455c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f4553e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 0x7f455c19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f455be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f455c108b00 0x7f455c19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f4553e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 0x7f455c19a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:39996/0 (socket says 172.21.15.84:39996) 2024-09-21T02:42:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f455b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f455c102870 0x7f455c19a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:57132/0 (socket says 172.21.15.84:57132) 2024-09-21T02:42:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f4553e00640 1 -- 172.21.15.84:0/1402266911 learned_addr learned my addr 172.21.15.84:0/1402266911 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f455b400640 1 -- 172.21.15.84:0/1402266911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 msgr2=0x7f455c19a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f455b400640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 0x7f455c19a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f455b400640 1 -- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f455c108b00 msgr2=0x7f455c19fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f455b400640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f455c108b00 0x7f455c19fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.911+0000 7f455b400640 1 -- 172.21.15.84:0/1402266911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c1a02d0 con 0x7f455c102870 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.912+0000 7f455b400640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f455c102870 0x7f455c19a360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f454c00e9f0 tx=0x7f454c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.912+0000 7f4558c00640 1 -- 172.21.15.84:0/1402266911 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c00cd80 con 0x7f455c102870 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.912+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c1a05c0 con 0x7f455c102870 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.912+0000 7f4558c00640 1 -- 172.21.15.84:0/1402266911 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f454c0035f0 con 0x7f455c102870 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.912+0000 7f4558c00640 1 -- 172.21.15.84:0/1402266911 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c010670 con 0x7f455c102870 2024-09-21T02:42:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.912+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c1a6d20 con 0x7f455c102870 2024-09-21T02:42:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.913+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c102c80 con 0x7f455c102870 2024-09-21T02:42:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.916+0000 7f4558c00640 1 -- 172.21.15.84:0/1402266911 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f454c0037a0 con 0x7f455c102870 2024-09-21T02:42:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.917+0000 7f4558c00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45400b65a0 0x7f45400b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.917+0000 7f4558c00640 1 -- 172.21.15.84:0/1402266911 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f454c0e7c90 con 0x7f455c102870 2024-09-21T02:42:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.917+0000 7f4553e00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45400b65a0 0x7f45400b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.918+0000 7f4553e00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45400b65a0 0x7f45400b8ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f455c105bb0 tx=0x7f45440058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:46.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:46.919+0000 7f4558c00640 1 -- 172.21.15.84:0/1402266911 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f454c0ae060 con 0x7f455c102870 2024-09-21T02:42:47.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.144+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f455c19b490 con 0x7f455c102870 2024-09-21T02:42:47.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.145+0000 7f4558c00640 1 -- 172.21.15.84:0/1402266911 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7f454c0b2440 con 0x7f455c102870 2024-09-21T02:42:47.146 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:47.146 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"btime":"2024-09-21T02:42:38:701523+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:42:38.113687+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24679,24703,24704]},"id":1}]} 2024-09-21T02:42:47.147 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-09-21T02:42:47.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45400b65a0 msgr2=0x7f45400b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:47.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45400b65a0 0x7f45400b8ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f455c105bb0 tx=0x7f45440058d0 comp rx=0 tx=0).stop 2024-09-21T02:42:47.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f455c102870 msgr2=0x7f455c19a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:47.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f455c102870 0x7f455c19a360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f454c00e9f0 tx=0x7f454c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 shutdown_connections 2024-09-21T02:42:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f45400b65a0 0x7f45400b8ab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f455c1081b0 0x7f455c19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f455c108b00 0x7f455c19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 --2- 172.21.15.84:0/1402266911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f455c102870 0x7f455c19a360 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.147+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 >> 172.21.15.84:0/1402266911 conn(0x7f455c0fe2c0 msgr2=0x7f455c06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.148+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 shutdown_connections 2024-09-21T02:42:47.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:47.148+0000 7f4560a00640 1 -- 172.21.15.84:0/1402266911 wait complete. 2024-09-21T02:42:47.499 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:47 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1402266911' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:47.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:47 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1402266911' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:47.516 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:47 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1402266911' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:47.911 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:42:48.282 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:48.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:48 smithi084 ceph-mon[30747]: pgmap v411: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T02:42:48.507 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:48 smithi172 ceph-mon[35067]: pgmap v411: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T02:42:48.529 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:48 smithi090 ceph-mon[34571]: pgmap v411: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-21T02:42:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 -- 172.21.15.84:0/3707888470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 msgr2=0x7feec010ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 --2- 172.21.15.84:0/3707888470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 0x7feec010ff00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feeac009900 tx=0x7feeac02a410 comp rx=0 tx=0).stop 2024-09-21T02:42:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 -- 172.21.15.84:0/3707888470 shutdown_connections 2024-09-21T02:42:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 --2- 172.21.15.84:0/3707888470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec0110440 0x7feec0116c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 --2- 172.21.15.84:0/3707888470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 0x7feec010ff00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 --2- 172.21.15.84:0/3707888470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feec010a1b0 0x7feec010a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 -- 172.21.15.84:0/3707888470 >> 172.21.15.84:0/3707888470 conn(0x7feec00780e0 msgr2=0x7feec01081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 -- 172.21.15.84:0/3707888470 shutdown_connections 2024-09-21T02:42:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.874+0000 7feec5400640 1 -- 172.21.15.84:0/3707888470 wait complete. 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.875+0000 7feec5400640 1 Processor -- start 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.875+0000 7feec5400640 1 -- start start 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feec5400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec010a1b0 0x7feec01a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feec5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 0x7feec01a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feec5400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feec0110440 0x7feec01a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feec5400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feec011a270 con 0x7feec010faf0 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feec5400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feec011a0f0 con 0x7feec010a1b0 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feec5400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feec011a3f0 con 0x7feec0110440 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feebde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 0x7feec01a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feebde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 0x7feec01a1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34488/0 (socket says 172.21.15.84:34488) 2024-09-21T02:42:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feebde00640 1 -- 172.21.15.84:0/1607094169 learned_addr learned my addr 172.21.15.84:0/1607094169 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feebe800640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec010a1b0 0x7feec01a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.876+0000 7feebf200640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feec0110440 0x7feec01a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feebe800640 1 -- 172.21.15.84:0/1607094169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feec0110440 msgr2=0x7feec01a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feebe800640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feec0110440 0x7feec01a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feebe800640 1 -- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 msgr2=0x7feec01a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feebe800640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 0x7feec01a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feebe800640 1 -- 172.21.15.84:0/1607094169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec01a6c10 con 0x7feec010a1b0 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feebe800640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec010a1b0 0x7feec01a0ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e9f0 tx=0x7feeb000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feeb7400640 1 -- 172.21.15.84:0/1607094169 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb000ccc0 con 0x7feec010a1b0 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec01a6f00 con 0x7feec010a1b0 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feeb7400640 1 -- 172.21.15.84:0/1607094169 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feeb0005020 con 0x7feec010a1b0 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feeb7400640 1 -- 172.21.15.84:0/1607094169 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb00049c0 con 0x7feec010a1b0 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.877+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec01ad660 con 0x7feec010a1b0 2024-09-21T02:42:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.878+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec010a5c0 con 0x7feec010a1b0 2024-09-21T02:42:48.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.881+0000 7feeb7400640 1 -- 172.21.15.84:0/1607094169 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7feeb00051d0 con 0x7feec010a1b0 2024-09-21T02:42:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.882+0000 7feeb7400640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feea40b65a0 0x7feea40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.883+0000 7feeb7400640 1 -- 172.21.15.84:0/1607094169 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7feeb00e78b0 con 0x7feec010a1b0 2024-09-21T02:42:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.883+0000 7feebde00640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feea40b65a0 0x7feea40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.883+0000 7feebde00640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feea40b65a0 0x7feea40b8ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feec007a350 tx=0x7feeac009660 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:48.884+0000 7feeb7400640 1 -- 172.21.15.84:0/1607094169 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feeb00adc80 con 0x7feec010a1b0 2024-09-21T02:42:49.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.107+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feec01a1dd0 con 0x7feec010a1b0 2024-09-21T02:42:49.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.108+0000 7feeb7400640 1 -- 172.21.15.84:0/1607094169 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7feeb00b2060 con 0x7feec010a1b0 2024-09-21T02:42:49.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:49.109 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"btime":"2024-09-21T02:42:38:701523+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:42:38.113687+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24679,24703,24704]},"id":1}]} 2024-09-21T02:42:49.110 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feea40b65a0 msgr2=0x7feea40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feea40b65a0 0x7feea40b8ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feec007a350 tx=0x7feeac009660 comp rx=0 tx=0).stop 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec010a1b0 msgr2=0x7feec01a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec010a1b0 0x7feec01a0ca0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e9f0 tx=0x7feeb000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 shutdown_connections 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7feea40b65a0 0x7feea40b8ab0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feec0110440 0x7feec01a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feec010faf0 0x7feec01a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 --2- 172.21.15.84:0/1607094169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feec010a1b0 0x7feec01a0ca0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.110+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 >> 172.21.15.84:0/1607094169 conn(0x7feec00780e0 msgr2=0x7feec0108510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.111+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 shutdown_connections 2024-09-21T02:42:49.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:49.111+0000 7feec5400640 1 -- 172.21.15.84:0/1607094169 wait complete. 2024-09-21T02:42:49.466 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:49 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1607094169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:49.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:49 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1607094169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:49.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:49 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1607094169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:49.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:42:50.343 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:50.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:50 smithi084 ceph-mon[30747]: pgmap v412: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-21T02:42:50.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:42:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:50 smithi172 ceph-mon[35067]: pgmap v412: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-21T02:42:50.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:42:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:50 smithi090 ceph-mon[34571]: pgmap v412: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-09-21T02:42:50.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:42:51.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 -- 172.21.15.84:0/1968130815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410b6d0 msgr2=0x7f975410bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:51.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 --2- 172.21.15.84:0/1968130815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410b6d0 0x7f975410bae0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f973c009900 tx=0x7f973c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 -- 172.21.15.84:0/1968130815 shutdown_connections 2024-09-21T02:42:51.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 --2- 172.21.15.84:0/1968130815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975410c020 0x7f9754112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 --2- 172.21.15.84:0/1968130815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410b6d0 0x7f975410bae0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 --2- 172.21.15.84:0/1968130815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9754105d90 0x7f97541061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 -- 172.21.15.84:0/1968130815 >> 172.21.15.84:0/1968130815 conn(0x7f9754101860 msgr2=0x7f9754103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:51.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 -- 172.21.15.84:0/1968130815 shutdown_connections 2024-09-21T02:42:51.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.020+0000 7f9759400640 1 -- 172.21.15.84:0/1968130815 wait complete. 2024-09-21T02:42:51.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.021+0000 7f9759400640 1 Processor -- start 2024-09-21T02:42:51.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.021+0000 7f9759400640 1 -- start start 2024-09-21T02:42:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9759400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9754105d90 0x7f975419c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9759400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975410b6d0 0x7f975419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9759400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410c020 0x7f97541a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9759400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9754115e50 con 0x7f9754105d90 2024-09-21T02:42:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9759400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9754115cd0 con 0x7f975410c020 2024-09-21T02:42:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9759400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9754115fd0 con 0x7f975410b6d0 2024-09-21T02:42:51.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9749e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975410b6d0 0x7f975419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9753200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410c020 0x7f97541a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9752800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9754105d90 0x7f975419c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9749e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975410b6d0 0x7f975419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49106/0 (socket says 172.21.15.84:49106) 2024-09-21T02:42:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9749e00640 1 -- 172.21.15.84:0/2172338250 learned_addr learned my addr 172.21.15.84:0/2172338250 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:51.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9753200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410c020 0x7f97541a1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51716/0 (socket says 172.21.15.84:51716) 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9749e00640 1 -- 172.21.15.84:0/2172338250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410c020 msgr2=0x7f97541a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9749e00640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410c020 0x7f97541a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9749e00640 1 -- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9754105d90 msgr2=0x7f975419c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9749e00640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9754105d90 0x7f975419c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.022+0000 7f9749e00640 1 -- 172.21.15.84:0/2172338250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97541a26f0 con 0x7f975410b6d0 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.023+0000 7f9749e00640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975410b6d0 0x7f975419cd20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f973c02a9e0 tx=0x7f973c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.023+0000 7f974be00640 1 -- 172.21.15.84:0/2172338250 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c03f070 con 0x7f975410b6d0 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.023+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97541a2980 con 0x7f975410b6d0 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.023+0000 7f974be00640 1 -- 172.21.15.84:0/2172338250 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f973c031be0 con 0x7f975410b6d0 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.023+0000 7f974be00640 1 -- 172.21.15.84:0/2172338250 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c035030 con 0x7f975410b6d0 2024-09-21T02:42:51.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.023+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97541a9140 con 0x7f975410b6d0 2024-09-21T02:42:51.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.024+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9754107010 con 0x7f975410b6d0 2024-09-21T02:42:51.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.026+0000 7f974be00640 1 -- 172.21.15.84:0/2172338250 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f973c042070 con 0x7f975410b6d0 2024-09-21T02:42:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.028+0000 7f974be00640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97380b65a0 0x7f97380b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.028+0000 7f974be00640 1 -- 172.21.15.84:0/2172338250 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f973c108220 con 0x7f975410b6d0 2024-09-21T02:42:51.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.028+0000 7f9752800640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97380b65a0 0x7f97380b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:51.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.029+0000 7f9752800640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97380b65a0 0x7f97380b8ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f97440095f0 tx=0x7f9744005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:51.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.030+0000 7f974be00640 1 -- 172.21.15.84:0/2172338250 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f973c0d2940 con 0x7f975410b6d0 2024-09-21T02:42:51.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.215+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f975410de10 con 0x7f975410b6d0 2024-09-21T02:42:51.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.217+0000 7f974be00640 1 -- 172.21.15.84:0/2172338250 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24819 (secure 0 0 0) 0x7f973c0d7880 con 0x7f975410b6d0 2024-09-21T02:42:51.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:51.219 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:41:44.334281+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.219+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97380b65a0 msgr2=0x7f97380b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.219+0000 7f9759400640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97380b65a0 0x7f97380b8ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f97440095f0 tx=0x7f9744005f90 comp rx=0 tx=0).stop 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.219+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975410b6d0 msgr2=0x7f975419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.219+0000 7f9759400640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975410b6d0 0x7f975419cd20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f973c02a9e0 tx=0x7f973c003b90 comp rx=0 tx=0).stop 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.220+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 shutdown_connections 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.220+0000 7f9759400640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f97380b65a0 0x7f97380b8ab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.220+0000 7f9759400640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f975410b6d0 0x7f975419cd20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.220+0000 7f9759400640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f975410c020 0x7f97541a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.220+0000 7f9759400640 1 --2- 172.21.15.84:0/2172338250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9754105d90 0x7f975419c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:51.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.220+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 >> 172.21.15.84:0/2172338250 conn(0x7f9754101860 msgr2=0x7f975410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:51.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.220+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 shutdown_connections 2024-09-21T02:42:51.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:51.220+0000 7f9759400640 1 -- 172.21.15.84:0/2172338250 wait complete. 2024-09-21T02:42:51.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:42:51.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:42:51.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:51 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2172338250' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:42:51.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:42:51.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:42:51.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.757 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:51 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2172338250' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:42:51.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:42:51.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:42:51.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:42:51.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:51 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2172338250' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:42:52.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T02:42:52.472 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:52.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:52 smithi084 ceph-mon[30747]: pgmap v413: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T02:42:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 -- 172.21.15.84:0/3526012709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc104f00 msgr2=0x7f0dcc10b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/3526012709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc104f00 0x7f0dcc10b8a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009ca0 tx=0x7f0dc402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 -- 172.21.15.84:0/3526012709 shutdown_connections 2024-09-21T02:42:52.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/3526012709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dcc104560 0x7f0dcc104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/3526012709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc104f00 0x7f0dcc10b8a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/3526012709 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dcc1034e0 0x7f0dcc103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 -- 172.21.15.84:0/3526012709 >> 172.21.15.84:0/3526012709 conn(0x7f0dcc0fee20 msgr2=0x7f0dcc1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 -- 172.21.15.84:0/3526012709 shutdown_connections 2024-09-21T02:42:52.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.568+0000 7f0dd1a00640 1 -- 172.21.15.84:0/3526012709 wait complete. 2024-09-21T02:42:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.569+0000 7f0dd1a00640 1 Processor -- start 2024-09-21T02:42:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.569+0000 7f0dd1a00640 1 -- start start 2024-09-21T02:42:52.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dd1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc1034e0 0x7f0dcc076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dd1a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dcc104560 0x7f0dcc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dd1a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dcc104f00 0x7f0dcc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dd1a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc10f2d0 con 0x7f0dcc1034e0 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dd1a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc10f150 con 0x7f0dcc104f00 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dd1a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc10f450 con 0x7f0dcc104560 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc1034e0 0x7f0dcc076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc1034e0 0x7f0dcc076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49790/0 (socket says 172.21.15.84:49790) 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2201827120 learned_addr learned my addr 172.21.15.84:0/2201827120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dd1000640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dcc104f00 0x7f0dcc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcb400640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dcc104560 0x7f0dcc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2201827120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dcc104560 msgr2=0x7f0dcc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dcc104560 0x7f0dcc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2201827120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dcc104f00 msgr2=0x7f0dcc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dcc104f00 0x7f0dcc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.570+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2201827120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc076380 con 0x7f0dcc1034e0 2024-09-21T02:42:52.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.571+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc1034e0 0x7f0dcc076e50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00ea60 tx=0x7f0dbc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.571+0000 7f0dc8c00640 1 -- 172.21.15.84:0/2201827120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00cde0 con 0x7f0dcc1034e0 2024-09-21T02:42:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.571+0000 7f0dc8c00640 1 -- 172.21.15.84:0/2201827120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0dbc0035f0 con 0x7f0dcc1034e0 2024-09-21T02:42:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.571+0000 7f0dd1a00640 1 -- 172.21.15.84:0/2201827120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc1a3e50 con 0x7f0dcc1034e0 2024-09-21T02:42:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.571+0000 7f0dc8c00640 1 -- 172.21.15.84:0/2201827120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc010690 con 0x7f0dcc1034e0 2024-09-21T02:42:52.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.571+0000 7f0dd1a00640 1 -- 172.21.15.84:0/2201827120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc1a4260 con 0x7f0dcc1034e0 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.574+0000 7f0dda071740 1 Processor -- start 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.574+0000 7f0dda071740 1 -- start start 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.574+0000 7f0dc8c00640 1 -- 172.21.15.84:0/2201827120 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f0dbc0037a0 con 0x7f0dcc1034e0 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dda071740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e77d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dda071740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e77d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dda071740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e77e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dda071740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56496e6f06b0 con 0x56496e3d61b0 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dda071740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56496e6dfae0 con 0x56496e3b54d0 2024-09-21T02:42:52.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dda071740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56496e6e38f0 con 0x56496e3ad2f0 2024-09-21T02:42:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dd1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e77d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dcb400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e77e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dd1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e77d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49806/0 (socket says 172.21.15.84:49806) 2024-09-21T02:42:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dd1000640 1 -- 172.21.15.84:0/779724904 learned_addr learned my addr 172.21.15.84:0/779724904 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/779724904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e77d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dcb400640 1 -- 172.21.15.84:0/779724904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 msgr2=0x56496e77d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dcb400640 1 --2- 172.21.15.84:0/779724904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e77d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dcb400640 1 -- 172.21.15.84:0/779724904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 msgr2=0x56496e77d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.575+0000 7f0dcb400640 1 --2- 172.21.15.84:0/779724904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e77d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.576+0000 7f0dcb400640 1 -- 172.21.15.84:0/779724904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56496e6ac780 con 0x56496e3b54d0 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.576+0000 7f0dcb400640 1 --2- 172.21.15.84:0/779724904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e77e470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009b70 tx=0x7f0db80117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5679281efecad70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.576+0000 7f0dc1600640 1 -- 172.21.15.84:0/779724904 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8009e60 con 0x56496e3b54d0 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.576+0000 7f0dc1600640 1 -- 172.21.15.84:0/779724904 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0db8012920 con 0x56496e3b54d0 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.576+0000 7f0dc1600640 1 -- 172.21.15.84:0/779724904 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db800fb30 con 0x56496e3b54d0 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dc8c00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0db00b65a0 0x7f0db00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dd1000640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0db00b65a0 0x7f0db00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dc8c00640 1 -- 172.21.15.84:0/2201827120 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f0dbc0e7c20 con 0x7f0dcc1034e0 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dda071740 1 -- 172.21.15.84:0/779724904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 msgr2=0x56496e77e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dda071740 1 --2- 172.21.15.84:0/779724904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e77e470 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009b70 tx=0x7f0db80117b0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dda071740 1 -- 172.21.15.84:0/779724904 shutdown_connections 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dda071740 1 --2- 172.21.15.84:0/779724904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e77d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dda071740 1 --2- 172.21.15.84:0/779724904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e77e470 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dda071740 1 --2- 172.21.15.84:0/779724904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e77d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.577+0000 7f0dda071740 1 -- 172.21.15.84:0/779724904 >> 172.21.15.84:0/779724904 conn(0x56496e3ca300 msgr2=0x56496e778d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.578+0000 7f0dda071740 1 -- 172.21.15.84:0/779724904 shutdown_connections 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.578+0000 7f0dda071740 1 -- 172.21.15.84:0/779724904 wait complete. 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.578+0000 7f0dd1000640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0db00b65a0 0x7f0db00b8ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009ca0 tx=0x7f0dc4031b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.578+0000 7f0dda071740 1 -- start start 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.578+0000 7f0dda071740 1 Processor -- start 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dda071740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e7868e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dda071740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e786fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dda071740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e787b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dda071740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56496e617ab0 con 0x56496e3d61b0 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dda071740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56496e686570 con 0x56496e3b54d0 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dda071740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56496e77ef90 con 0x56496e3ad2f0 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dda071740 10 client.0 _ll_register_callbacks cb 0x56496e695100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcb400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e786fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e7868e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dd1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e787b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcb400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e786fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51756/0 (socket says 172.21.15.84:51756) 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcb400640 1 -- 172.21.15.84:0/3815604751 learned_addr learned my addr 172.21.15.84:0/3815604751 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e7868e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49142/0 (socket says 172.21.15.84:49142) 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcb400640 1 -- 172.21.15.84:0/3815604751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 msgr2=0x56496e7868e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcb400640 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e7868e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcb400640 1 -- 172.21.15.84:0/3815604751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 msgr2=0x56496e787b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcb400640 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e787b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.579+0000 7f0dcb400640 1 -- 172.21.15.84:0/3815604751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56496e441790 con 0x56496e3b54d0 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.580+0000 7f0dcb400640 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e786fa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0db80126e0 tx=0x7f0db8012710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb85ad681c7afef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.580+0000 7f0db6000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.580+0000 7f0db6000640 1 -- 172.21.15.84:0/3815604751 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8028070 con 0x56496e3b54d0 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.580+0000 7f0dda071740 1 -- 172.21.15.84:0/3815604751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0db8012920 con 0x56496e3b54d0 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.580+0000 7f0db6000640 1 -- 172.21.15.84:0/3815604751 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f0db800f870 con 0x56496e3b54d0 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0db6000640 1 -- 172.21.15.84:0/3815604751 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0db8034050 con 0x56496e3b54d0 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0dda071740 10 client.25379 fetch_fsmap learned FSMap version 27 2024-09-21T02:42:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0dda071740 1 -- 172.21.15.84:0/3815604751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56496e4ba620 con 0x56496e3b54d0 2024-09-21T02:42:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0db6000640 1 -- 172.21.15.84:0/3815604751 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0db8012920 con 0x56496e3b54d0 2024-09-21T02:42:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0db6000640 1 -- 172.21.15.84:0/3815604751 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0db80046c0 con 0x56496e3b54d0 2024-09-21T02:42:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0dda071740 10 client.25379 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0dda071740 10 client.25379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0dda071740 20 client.25379 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0dda071740 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56496e394d80 0x56496e793d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0dda071740 4 client.25379 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.581+0000 7f0dda071740 1 -- 172.21.15.84:0/3815604751 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56496e6f2600 con 0x56496e394d80 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.582+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56496e394d80 0x56496e793d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.582+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56496e394d80 0x56496e793d10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8991aa5b4e8771f server_cookie=d28d2f689c15962b in_seq=0 out_seq=0 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.582+0000 7f0db6000640 10 client.25379 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0db6000640 1 -- 172.21.15.84:0/3815604751 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56496e6f2600 con 0x56496e394d80 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0db6000640 10 client.25379 handle_command_reply: tid=0 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 client.25379 shutdown 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 -- 172.21.15.84:0/3815604751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 msgr2=0x56496e786fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e786fa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0db80126e0 tx=0x7f0db8012710 comp rx=0 tx=0).stop 2024-09-21T02:42:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 -- 172.21.15.84:0/3815604751 shutdown_connections 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56496e394d80 0x56496e793d10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3d61b0 0x56496e787b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0db6000640 0 client.25379 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3b54d0 0x56496e786fa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 --2- 172.21.15.84:0/3815604751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3ad2f0 0x56496e7868e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 -- 172.21.15.84:0/3815604751 >> 172.21.15.84:0/3815604751 conn(0x56496e3ca300 msgr2=0x56496e777360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 -- 172.21.15.84:0/3815604751 shutdown_connections 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 1 -- 172.21.15.84:0/3815604751 wait complete. 2024-09-21T02:42:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.583+0000 7f0dda071740 20 client.25379 trim_cache size 0 max 16384 2024-09-21T02:42:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.598+0000 7f0dda071740 1 Processor -- start 2024-09-21T02:42:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dda071740 1 -- start start 2024-09-21T02:42:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dda071740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e786f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dda071740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 0x56496e781ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dda071740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 0x56496e785420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dda071740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1b10a0 con 0x56496e3ad2f0 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dda071740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1ae970 con 0x56496e3d61b0 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dda071740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1ac7c0 con 0x56496e3b54d0 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e786f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e786f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49830/0 (socket says 172.21.15.84:49830) 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2396481968 learned_addr learned my addr 172.21.15.84:0/2396481968 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dd1000640 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 0x56496e785420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dcb400640 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 0x56496e781ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2396481968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 msgr2=0x56496e781ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 0x56496e781ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2396481968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 msgr2=0x56496e785420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.599+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 0x56496e785420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.600+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2396481968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56496e77ee70 con 0x56496e3ad2f0 2024-09-21T02:42:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.600+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e786f50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0e5210 tx=0x7f0dbc0eb6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c6aee2c4ef7923 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.600+0000 7f0dc0c00640 1 -- 172.21.15.84:0/2396481968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0a9700 con 0x56496e3ad2f0 2024-09-21T02:42:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.600+0000 7f0dc0c00640 1 -- 172.21.15.84:0/2396481968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0dbc0ad370 con 0x56496e3ad2f0 2024-09-21T02:42:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.600+0000 7f0dc0c00640 1 -- 172.21.15.84:0/2396481968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0acfd0 con 0x56496e3ad2f0 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 -- 172.21.15.84:0/2396481968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 msgr2=0x56496e786f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e786f50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0e5210 tx=0x7f0dbc0eb6d0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 -- 172.21.15.84:0/2396481968 shutdown_connections 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 0x56496e781ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 0x56496e785420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 --2- 172.21.15.84:0/2396481968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e786f50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 -- 172.21.15.84:0/2396481968 >> 172.21.15.84:0/2396481968 conn(0x56496e3ca300 msgr2=0x56496e7813a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 -- 172.21.15.84:0/2396481968 shutdown_connections 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 -- 172.21.15.84:0/2396481968 wait complete. 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 -- start start 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.601+0000 7f0dda071740 1 Processor -- start 2024-09-21T02:42:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dda071740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e78e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dda071740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 0x56496e78d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dda071740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 0x56496e78d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dda071740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1ace30 con 0x56496e3ad2f0 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dda071740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1ae2a0 con 0x56496e3d61b0 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dda071740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1ad500 con 0x56496e3b54d0 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dda071740 10 client.0 _ll_register_callbacks cb 0x7f0db8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e78e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e78e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49842/0 (socket says 172.21.15.84:49842) 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2692018435 learned_addr learned my addr 172.21.15.84:0/2692018435 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dd1000640 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 0x56496e78d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.602+0000 7f0dcb400640 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 0x56496e78d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2692018435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 msgr2=0x56496e78d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 0x56496e78d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2692018435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 msgr2=0x56496e78d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 0x56496e78d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dcbe00640 1 -- 172.21.15.84:0/2692018435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56496e78bbe0 con 0x56496e3ad2f0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dcbe00640 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e78e310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc004610 tx=0x7f0dbc0eb740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1048483131d64384 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0db6000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0db6000640 1 -- 172.21.15.84:0/2692018435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0ad1b0 con 0x56496e3ad2f0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0db6000640 1 -- 172.21.15.84:0/2692018435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f0dbc0e5430 con 0x56496e3ad2f0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dda071740 1 -- 172.21.15.84:0/2692018435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dbc0ad370 con 0x56496e3ad2f0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0db6000640 1 -- 172.21.15.84:0/2692018435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0dbc0ad630 con 0x56496e3ad2f0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dda071740 10 client.15381 fetch_fsmap learned FSMap version 27 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.603+0000 7f0dda071740 1 -- 172.21.15.84:0/2692018435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56496e7fe800 con 0x56496e3ad2f0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0db6000640 1 -- 172.21.15.84:0/2692018435 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0dbc0ad370 con 0x56496e3ad2f0 2024-09-21T02:42:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0db6000640 1 -- 172.21.15.84:0/2692018435 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0dbc0a91b0 con 0x56496e3ad2f0 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0dda071740 10 client.15381 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0dda071740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0dda071740 20 client.15381 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0dda071740 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56496e36a1c0 0x56496e801210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0dda071740 4 client.15381 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0dda071740 1 -- 172.21.15.84:0/2692018435 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56496e6ee0b0 con 0x56496e36a1c0 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.604+0000 7f0dcb400640 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56496e36a1c0 0x56496e801210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.605+0000 7f0dcb400640 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56496e36a1c0 0x56496e801210 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b76f37a1efa0c42d server_cookie=6be94b8e131b37fb in_seq=0 out_seq=0 2024-09-21T02:42:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.605+0000 7f0db6000640 10 client.15381 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0db6000640 1 -- 172.21.15.84:0/2692018435 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56496e6ee0b0 con 0x56496e36a1c0 2024-09-21T02:42:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0db6000640 10 client.15381 handle_command_reply: tid=0 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 client.15381 shutdown 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 -- 172.21.15.84:0/2692018435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 msgr2=0x56496e78e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e78e310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc004610 tx=0x7f0dbc0eb740 comp rx=0 tx=0).stop 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 -- 172.21.15.84:0/2692018435 shutdown_connections 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56496e3b54d0 0x56496e78d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56496e36a1c0 0x56496e801210 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56496e3d61b0 0x56496e78d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0db6000640 0 client.15381 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 --2- 172.21.15.84:0/2692018435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56496e3ad2f0 0x56496e78e310 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 -- 172.21.15.84:0/2692018435 >> 172.21.15.84:0/2692018435 conn(0x56496e3ca300 msgr2=0x56496e77a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 -- 172.21.15.84:0/2692018435 shutdown_connections 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 1 -- 172.21.15.84:0/2692018435 wait complete. 2024-09-21T02:42:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.618+0000 7f0dda071740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T02:42:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:42:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:42:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:42:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:42:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 -- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0db00b65a0 msgr2=0x7f0db00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0db00b65a0 0x7f0db00b8ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009ca0 tx=0x7f0dc4031b40 comp rx=0 tx=0).stop 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 -- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc1034e0 msgr2=0x7f0dcc076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc1034e0 0x7f0dcc076e50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00ea60 tx=0x7f0dbc00ef20 comp rx=0 tx=0).stop 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 -- 172.21.15.84:0/2201827120 shutdown_connections 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f0db00b65a0 0x7f0db00b8ab0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0dcc104560 0x7f0dcc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0dcc104f00 0x7f0dcc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 --2- 172.21.15.84:0/2201827120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0dcc1034e0 0x7f0dcc076e50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 -- 172.21.15.84:0/2201827120 >> 172.21.15.84:0/2201827120 conn(0x7f0dcc0fee20 msgr2=0x7f0dcc107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 -- 172.21.15.84:0/2201827120 shutdown_connections 2024-09-21T02:42:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:42:52.619+0000 7f0dd1a00640 1 -- 172.21.15.84:0/2201827120 wait complete. 2024-09-21T02:42:52.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:52 smithi172 ceph-mon[35067]: pgmap v413: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T02:42:52.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:52 smithi090 ceph-mon[34571]: pgmap v413: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T02:42:53.875 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:53 smithi084 ceph-mon[30747]: pgmap v414: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:42:53.912 INFO:teuthology.orchestra.run.smithi084.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T02:42:53.913 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T02:42:53.913 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T02:42:53.913 DEBUG:tasks.quiescer:Yielding 2024-09-21T02:42:53.913 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T02:42:53.927 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:42:53.927 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T02:42:53.927 INFO:tasks.workunit:timeout=3h 2024-09-21T02:42:53.928 INFO:tasks.workunit:cleanup=True 2024-09-21T02:42:53.928 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T02:42:53.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:42:53.965 INFO:teuthology.orchestra.run.smithi084.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T02:42:53.966 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T02:42:53.966 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T02:42:53.966 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T02:42:53.966 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T02:42:53.966 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 02:40:53.446089008 +0000 2024-09-21T02:42:53.966 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 02:40:53.446089008 +0000 2024-09-21T02:42:53.966 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 02:42:37.173963652 +0000 2024-09-21T02:42:53.966 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 02:40:53.446089008 +0000 2024-09-21T02:42:53.966 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T02:42:53.966 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T02:42:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:53 smithi172 ceph-mon[35067]: pgmap v414: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:42:54.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:53 smithi090 ceph-mon[34571]: pgmap v414: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T02:42:54.072 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T02:42:54.110 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T02:42:54.326 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.995+0000 7f5404800640 1 -- 172.21.15.84:0/3201098986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc109df0 msgr2=0x7f53fc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.995+0000 7f5404800640 1 --2- 172.21.15.84:0/3201098986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc109df0 0x7f53fc110620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009ca0 tx=0x7f53f802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:42:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.995+0000 7f5404800640 1 -- 172.21.15.84:0/3201098986 shutdown_connections 2024-09-21T02:42:54.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.995+0000 7f5404800640 1 --2- 172.21.15.84:0/3201098986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc109df0 0x7f53fc110620 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.995+0000 7f5404800640 1 --2- 172.21.15.84:0/3201098986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc1094a0 0x7f53fc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.995+0000 7f5404800640 1 --2- 172.21.15.84:0/3201098986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc103b60 0x7f53fc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.995+0000 7f5404800640 1 -- 172.21.15.84:0/3201098986 >> 172.21.15.84:0/3201098986 conn(0x7f53fc07b850 msgr2=0x7f53fc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.996+0000 7f5404800640 1 -- 172.21.15.84:0/3201098986 shutdown_connections 2024-09-21T02:42:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.996+0000 7f5404800640 1 -- 172.21.15.84:0/3201098986 wait complete. 2024-09-21T02:42:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.997+0000 7f5404800640 1 Processor -- start 2024-09-21T02:42:54.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.997+0000 7f5404800640 1 -- start start 2024-09-21T02:42:54.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5404800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc103b60 0x7f53fc19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:54.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5404800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc1094a0 0x7f53fc19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:54.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5404800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc109df0 0x7f53fc19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:54.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5404800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc113c40 con 0x7f53fc103b60 2024-09-21T02:42:55.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5404800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc113ac0 con 0x7f53fc109df0 2024-09-21T02:42:55.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5404800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc113dc0 con 0x7f53fc1094a0 2024-09-21T02:42:55.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5401e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc103b60 0x7f53fc19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:55.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5401e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc103b60 0x7f53fc19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49868/0 (socket says 172.21.15.84:49868) 2024-09-21T02:42:55.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5401e00640 1 -- 172.21.15.84:0/2445277228 learned_addr learned my addr 172.21.15.84:0/2445277228 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:55.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5402800640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc109df0 0x7f53fc19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:55.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5401400640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc1094a0 0x7f53fc19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5401e00640 1 -- 172.21.15.84:0/2445277228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc1094a0 msgr2=0x7f53fc19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5401e00640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc1094a0 0x7f53fc19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5401e00640 1 -- 172.21.15.84:0/2445277228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc109df0 msgr2=0x7f53fc19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.998+0000 7f5401e00640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc109df0 0x7f53fc19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.999+0000 7f5401e00640 1 -- 172.21.15.84:0/2445277228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc1a0460 con 0x7f53fc103b60 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.999+0000 7f5401e00640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc103b60 0x7f53fc19a4f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f53f000e9f0 tx=0x7f53f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.999+0000 7f53f6a00640 1 -- 172.21.15.84:0/2445277228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f000cd80 con 0x7f53fc103b60 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.999+0000 7f53f6a00640 1 -- 172.21.15.84:0/2445277228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f53f00054f0 con 0x7f53fc103b60 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.999+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc1a0750 con 0x7f53fc103b60 2024-09-21T02:42:55.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.999+0000 7f53f6a00640 1 -- 172.21.15.84:0/2445277228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0010690 con 0x7f53fc103b60 2024-09-21T02:42:55.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:54.999+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc1a6eb0 con 0x7f53fc103b60 2024-09-21T02:42:55.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.000+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53fc103f70 con 0x7f53fc103b60 2024-09-21T02:42:55.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.003+0000 7f53f6a00640 1 -- 172.21.15.84:0/2445277228 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f53f00046c0 con 0x7f53fc103b60 2024-09-21T02:42:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.004+0000 7f53f6a00640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53e40b65a0 0x7f53e40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.004+0000 7f53f6a00640 1 -- 172.21.15.84:0/2445277228 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f53f00e7c60 con 0x7f53fc103b60 2024-09-21T02:42:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.004+0000 7f5401400640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53e40b65a0 0x7f53e40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.005+0000 7f5401400640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53e40b65a0 0x7f53e40b8ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f53fc107090 tx=0x7f53ec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.008+0000 7f53f6a00640 1 -- 172.21.15.84:0/2445277228 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53f00adfa0 con 0x7f53fc103b60 2024-09-21T02:42:55.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.234+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53fc1a7220 con 0x7f53fc103b60 2024-09-21T02:42:55.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.235+0000 7f53f6a00640 1 -- 172.21.15.84:0/2445277228 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7f53f00b2380 con 0x7f53fc103b60 2024-09-21T02:42:55.236 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:42:55.236 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"btime":"2024-09-21T02:42:38:701523+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:42:38.113687+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24679,24703,24704]},"id":1}]} 2024-09-21T02:42:55.237 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-09-21T02:42:55.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53e40b65a0 msgr2=0x7f53e40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:55.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53e40b65a0 0x7f53e40b8ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f53fc107090 tx=0x7f53ec005f90 comp rx=0 tx=0).stop 2024-09-21T02:42:55.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc103b60 msgr2=0x7f53fc19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:55.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc103b60 0x7f53fc19a4f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f53f000e9f0 tx=0x7f53f000edf0 comp rx=0 tx=0).stop 2024-09-21T02:42:55.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 shutdown_connections 2024-09-21T02:42:55.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f53e40b65a0 0x7f53e40b8ab0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:55.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53fc1094a0 0x7f53fc19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:55.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc109df0 0x7f53fc19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:55.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 --2- 172.21.15.84:0/2445277228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f53fc103b60 0x7f53fc19a4f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:55.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 >> 172.21.15.84:0/2445277228 conn(0x7f53fc07b850 msgr2=0x7f53fc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:55.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 shutdown_connections 2024-09-21T02:42:55.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:55.238+0000 7f5404800640 1 -- 172.21.15.84:0/2445277228 wait complete. 2024-09-21T02:42:55.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:55 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2445277228' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:55.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:55 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2445277228' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:55.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:55 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2445277228' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:42:56.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T02:39:47.859217+0000', 'modified': '2024-09-21T02:42:38.113687+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24704, 'mds_1': 24703, 'mds_2': 24679}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24647': {'gid': 24647, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6835/1905318969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1905318969}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1905318969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24668': {'gid': 24668, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.90:6837/939715852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 939715852}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 939715852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/2876777250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2876777250}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 2876777250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24679': {'gid': 24679, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.172:6837/3475533235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3475533235}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3475533235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24703': {'gid': 24703, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.172:6839/3937933536', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3937933536}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3937933536}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24704': {'gid': 24704, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.90:6839/3427873852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6838', 'nonce': 3427873852}, {'type': 'v1', 'addr': '172.21.15.90:6839', 'nonce': 3427873852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24704, 'qdb_cluster': [24679, 24703, 24704]} 2024-09-21T02:42:56.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T02:42:56.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T02:42:56.472 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:56.612 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:56 smithi084 ceph-mon[30747]: pgmap v415: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:42:56.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:56 smithi172 ceph-mon[35067]: pgmap v415: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:42:56.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:56 smithi090 ceph-mon[34571]: pgmap v415: 129 pgs: 129 active+clean; 656 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:42:57.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 -- 172.21.15.84:0/3414037445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a410c020 msgr2=0x7fa2a4112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 --2- 172.21.15.84:0/3414037445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a410c020 0x7fa2a4112850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009be0 tx=0x7fa29c02a6c0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 -- 172.21.15.84:0/3414037445 shutdown_connections 2024-09-21T02:42:57.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 --2- 172.21.15.84:0/3414037445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a410c020 0x7fa2a4112850 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 --2- 172.21.15.84:0/3414037445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a410b6d0 0x7fa2a410bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 --2- 172.21.15.84:0/3414037445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2a4105d90 0x7fa2a41061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 -- 172.21.15.84:0/3414037445 >> 172.21.15.84:0/3414037445 conn(0x7fa2a41017c0 msgr2=0x7fa2a4103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:57.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 -- 172.21.15.84:0/3414037445 shutdown_connections 2024-09-21T02:42:57.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.092+0000 7fa2ab800640 1 -- 172.21.15.84:0/3414037445 wait complete. 2024-09-21T02:42:57.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.094+0000 7fa2ab800640 1 Processor -- start 2024-09-21T02:42:57.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.094+0000 7fa2ab800640 1 -- start start 2024-09-21T02:42:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.094+0000 7fa2ab800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a4105d90 0x7fa2a419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.094+0000 7fa2ab800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a410b6d0 0x7fa2a419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.094+0000 7fa2ab800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2a410c020 0x7fa2a41a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.094+0000 7fa2ab800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4115e20 con 0x7fa2a410b6d0 2024-09-21T02:42:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.094+0000 7fa2ab800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4115ca0 con 0x7fa2a4105d90 2024-09-21T02:42:57.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.094+0000 7fa2ab800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4115fa0 con 0x7fa2a410c020 2024-09-21T02:42:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa29be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a410b6d0 0x7fa2a419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa2a8e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a4105d90 0x7fa2a419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa29be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a410b6d0 0x7fa2a419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49878/0 (socket says 172.21.15.84:49878) 2024-09-21T02:42:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa29be00640 1 -- 172.21.15.84:0/2997992205 learned_addr learned my addr 172.21.15.84:0/2997992205 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa2a9800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2a410c020 0x7fa2a41a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa2a8e00640 1 -- 172.21.15.84:0/2997992205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2a410c020 msgr2=0x7fa2a41a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2a410c020 0x7fa2a41a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa2a8e00640 1 -- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a410b6d0 msgr2=0x7fa2a419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a410b6d0 0x7fa2a419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa2a8e00640 1 -- 172.21.15.84:0/2997992205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a41a2720 con 0x7fa2a4105d90 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.095+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a4105d90 0x7fa2a419c7b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa29400e9f0 tx=0x7fa29400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.096+0000 7fa2a2000640 1 -- 172.21.15.84:0/2997992205 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29400ccc0 con 0x7fa2a4105d90 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.096+0000 7fa2ab800640 1 -- 172.21.15.84:0/2997992205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a41a2a10 con 0x7fa2a4105d90 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.096+0000 7fa2a2000640 1 -- 172.21.15.84:0/2997992205 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa294005020 con 0x7fa2a4105d90 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.096+0000 7fa2a2000640 1 -- 172.21.15.84:0/2997992205 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2940049c0 con 0x7fa2a4105d90 2024-09-21T02:42:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.096+0000 7fa2ab800640 1 -- 172.21.15.84:0/2997992205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a41a9170 con 0x7fa2a4105d90 2024-09-21T02:42:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.099+0000 7fa2b23c0740 1 Processor -- start 2024-09-21T02:42:57.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.099+0000 7fa2b23c0740 1 -- start start 2024-09-21T02:42:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.099+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x56371324d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.099+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e7e0a0 0x56371324d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.099+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371324df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.099+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5637131c4d50 con 0x563712e7e0a0 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.099+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5637131b4180 con 0x563712e86280 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.099+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5637131b7f90 con 0x563712ea6f60 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa2a2000640 1 -- 172.21.15.84:0/2997992205 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fa2940051d0 con 0x7fa2a4105d90 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371324df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371324df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51826/0 (socket says 172.21.15.84:51826) 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 -- 172.21.15.84:0/2888142193 learned_addr learned my addr 172.21.15.84:0/2888142193 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa2a9800640 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x56371324d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 -- 172.21.15.84:0/2888142193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 msgr2=0x56371324d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x56371324d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 -- 172.21.15.84:0/2888142193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e7e0a0 msgr2=0x56371324d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:57.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e7e0a0 0x56371324d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 -- 172.21.15.84:0/2888142193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56371317ea70 con 0x563712e86280 2024-09-21T02:42:57.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa2a9800640 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x56371324d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:42:57.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.100+0000 7fa29be00640 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371324df10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009cc0 tx=0x7fa28c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b0a423d10f4101 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:57.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.101+0000 7fa29a000640 1 -- 172.21.15.84:0/2888142193 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c01e070 con 0x563712e86280 2024-09-21T02:42:57.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.101+0000 7fa29a000640 1 -- 172.21.15.84:0/2888142193 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa28c0198e0 con 0x563712e86280 2024-09-21T02:42:57.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.101+0000 7fa29a000640 1 -- 172.21.15.84:0/2888142193 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0188b0 con 0x563712e86280 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.101+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2888142193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 msgr2=0x56371324df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.101+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371324df10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009cc0 tx=0x7fa28c011810 comp rx=0 tx=0).stop 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2888142193 shutdown_connections 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371324df10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e7e0a0 0x56371324d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/2888142193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x56371324d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2888142193 >> 172.21.15.84:0/2888142193 conn(0x563712e9b350 msgr2=0x56371324b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2a2000640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2880b65a0 0x7fa2880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2888142193 shutdown_connections 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2888142193 wait complete. 2024-09-21T02:42:57.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2a2000640 1 -- 172.21.15.84:0/2997992205 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa2940e7840 con 0x7fa2a4105d90 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.102+0000 7fa2a9800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2880b65a0 0x7fa2880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 1 -- start start 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2a9800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2880b65a0 0x7fa2880b8ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009370 tx=0x7fa29c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 1 Processor -- start 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713259050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e86280 0x563713259590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x563713264f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5637130155f0 con 0x563712e86280 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56371314f460 con 0x563712e7e0a0 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56371325bc70 con 0x563712ea6f60 2024-09-21T02:42:57.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.103+0000 7fa2b23c0740 10 client.0 _ll_register_callbacks cb 0x56371315f210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa29be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e86280 0x563713259590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa29be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e86280 0x563713259590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49900/0 (socket says 172.21.15.84:49900) 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa29be00640 1 -- 172.21.15.84:0/3716825233 learned_addr learned my addr 172.21.15.84:0/3716825233 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713259050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa2a9800640 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x563713264f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa29be00640 1 -- 172.21.15.84:0/3716825233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 msgr2=0x563713264f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa29be00640 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x563713264f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa29be00640 1 -- 172.21.15.84:0/3716825233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 msgr2=0x563713259050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa29be00640 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713259050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa29be00640 1 -- 172.21.15.84:0/3716825233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563712f12540 con 0x563712e86280 2024-09-21T02:42:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.104+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713259050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.105+0000 7fa29be00640 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e86280 0x563713259590 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0058c0 tx=0x7fa28c009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12500b2c40db54cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.105+0000 7fa292a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.105+0000 7fa292a00640 1 -- 172.21.15.84:0/3716825233 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c01e040 con 0x563712e86280 2024-09-21T02:42:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.105+0000 7fa2b23c0740 1 -- 172.21.15.84:0/3716825233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563713151a70 con 0x563712e86280 2024-09-21T02:42:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.105+0000 7fa292a00640 1 -- 172.21.15.84:0/3716825233 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa28c016040 con 0x563712e86280 2024-09-21T02:42:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.105+0000 7fa292a00640 1 -- 172.21.15.84:0/3716825233 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa28c031050 con 0x563712e86280 2024-09-21T02:42:57.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.105+0000 7fa2b23c0740 10 client.15396 fetch_fsmap learned FSMap version 27 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.105+0000 7fa2b23c0740 1 -- 172.21.15.84:0/3716825233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56371316c6f0 con 0x563712e86280 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa292a00640 1 -- 172.21.15.84:0/3716825233 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x563713151a70 con 0x563712e86280 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa292a00640 1 -- 172.21.15.84:0/3716825233 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa28c018a30 con 0x563712e86280 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa2b23c0740 10 client.15396 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa2b23c0740 10 client.15396 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa2b23c0740 20 client.15396 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x563712e658e0 0x56371326b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa2b23c0740 4 client.15396 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa2b23c0740 1 -- 172.21.15.84:0/3716825233 --> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637131c6ca0 con 0x563712e658e0 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.106+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x563712e658e0 0x56371326b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.107+0000 7fa292a00640 10 client.15396 ms_handle_connect on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.107+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x563712e658e0 0x56371326b290 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ff399e5a42cf9fa server_cookie=685aa9958efe3900 in_seq=0 out_seq=0 2024-09-21T02:42:57.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa292a00640 1 -- 172.21.15.84:0/3716825233 <== mds.2 v2:172.21.15.172:6836/3475533235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637131c6ca0 con 0x563712e658e0 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa292a00640 10 client.15396 handle_command_reply: tid=0 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 client.15396 shutdown 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 -- 172.21.15.84:0/3716825233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e86280 msgr2=0x563713259590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e86280 0x563713259590 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0058c0 tx=0x7fa28c009ef0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 -- 172.21.15.84:0/3716825233 shutdown_connections 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x563712e658e0 0x56371326b290 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712ea6f60 0x563713264f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712e86280 0x563713259590 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/3716825233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713259050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 -- 172.21.15.84:0/3716825233 >> 172.21.15.84:0/3716825233 conn(0x563712e9b350 msgr2=0x563713250620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa292a00640 0 client.15396 ms_handle_reset on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.108+0000 7fa2b23c0740 1 -- 172.21.15.84:0/3716825233 shutdown_connections 2024-09-21T02:42:57.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.109+0000 7fa2b23c0740 1 -- 172.21.15.84:0/3716825233 wait complete. 2024-09-21T02:42:57.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.109+0000 7fa2b23c0740 20 client.15396 trim_cache size 0 max 16384 2024-09-21T02:42:57.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.127+0000 7fa2b23c0740 1 Processor -- start 2024-09-21T02:42:57.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.127+0000 7fa2b23c0740 1 -- start start 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713269e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e86280 0x563713264ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x563713253f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5637132695d0 con 0x563712ea6f60 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563713269ca0 con 0x563712e7e0a0 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56371326a370 con 0x563712e86280 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2a9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x563713253f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2a9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x563713253f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49914/0 (socket says 172.21.15.84:49914) 2024-09-21T02:42:57.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2a9800640 1 -- 172.21.15.84:0/2983959917 learned_addr learned my addr 172.21.15.84:0/2983959917 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713269e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa29be00640 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e86280 0x563713264ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2a9800640 1 -- 172.21.15.84:0/2983959917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e86280 msgr2=0x563713264ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.128+0000 7fa2a9800640 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e86280 0x563713264ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.129+0000 7fa2a9800640 1 -- 172.21.15.84:0/2983959917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 msgr2=0x563713269e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.129+0000 7fa2a9800640 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713269e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.129+0000 7fa2a9800640 1 -- 172.21.15.84:0/2983959917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56371324f780 con 0x563712ea6f60 2024-09-21T02:42:57.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.129+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713269e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:42:57.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.129+0000 7fa2a9800640 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x563713253f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009be0 tx=0x7fa29c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881b7a8c67a9a945 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:57.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.129+0000 7fa299600640 1 -- 172.21.15.84:0/2983959917 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c036040 con 0x563712ea6f60 2024-09-21T02:42:57.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.129+0000 7fa299600640 1 -- 172.21.15.84:0/2983959917 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa29c004040 con 0x563712ea6f60 2024-09-21T02:42:57.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.129+0000 7fa299600640 1 -- 172.21.15.84:0/2983959917 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0316a0 con 0x563712ea6f60 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2983959917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 msgr2=0x563713253f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x563713253f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009be0 tx=0x7fa29c03e000 comp rx=0 tx=0).stop 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2983959917 shutdown_connections 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e86280 0x563713264ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x563713253f90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/2983959917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e7e0a0 0x563713269e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2983959917 >> 172.21.15.84:0/2983959917 conn(0x563712e9b350 msgr2=0x563713246010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2983959917 shutdown_connections 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.130+0000 7fa2b23c0740 1 -- 172.21.15.84:0/2983959917 wait complete. 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.131+0000 7fa2b23c0740 1 -- start start 2024-09-21T02:42:57.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.131+0000 7fa2b23c0740 1 Processor -- start 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e7e0a0 0x56371326cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371326d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2b23c0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x5637132721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56371326b110 con 0x563712ea6f60 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56371326aa40 con 0x563712e86280 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2b23c0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56371326b7e0 con 0x563712e7e0a0 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2b23c0740 10 client.0 _ll_register_callbacks cb 0x7fa28c0053e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa29be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371326d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2a9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x5637132721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa29be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371326d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51862/0 (socket says 172.21.15.84:51862) 2024-09-21T02:42:57.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa29be00640 1 -- 172.21.15.84:0/981415135 learned_addr learned my addr 172.21.15.84:0/981415135 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:57.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e7e0a0 0x56371326cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa29be00640 1 -- 172.21.15.84:0/981415135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e7e0a0 msgr2=0x56371326cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa29be00640 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e7e0a0 0x56371326cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa29be00640 1 -- 172.21.15.84:0/981415135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 msgr2=0x5637132721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa29be00640 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x5637132721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.132+0000 7fa29be00640 1 -- 172.21.15.84:0/981415135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563713272820 con 0x563712e86280 2024-09-21T02:42:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa29be00640 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371326d240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x56371325b7e0 tx=0x7fa28c0246d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8327c1fd41c4dc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa292a00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:42:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa292a00640 1 -- 172.21.15.84:0/981415135 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c01e040 con 0x563712e86280 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa292a00640 1 -- 172.21.15.84:0/981415135 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa28c024b50 con 0x563712e86280 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa2b23c0740 1 -- 172.21.15.84:0/981415135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa29c004040 con 0x563712e86280 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa292a00640 1 -- 172.21.15.84:0/981415135 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa28c03c050 con 0x563712e86280 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa2b23c0740 10 client.25409 fetch_fsmap learned FSMap version 27 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa2b23c0740 1 -- 172.21.15.84:0/981415135 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563713273c00 con 0x563712e86280 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.133+0000 7fa292a00640 1 -- 172.21.15.84:0/981415135 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa29c004040 con 0x563712e86280 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.134+0000 7fa292a00640 1 -- 172.21.15.84:0/981415135 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa28c0035f0 con 0x563712e86280 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.134+0000 7fa2b23c0740 10 client.25409 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.134+0000 7fa2b23c0740 10 client.25409 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.134+0000 7fa2b23c0740 20 client.25409 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.134+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x563712e3ac90 0x5637132d9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.134+0000 7fa2b23c0740 4 client.25409 mds_command: new command op to 24679 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.134+0000 7fa2b23c0740 1 -- 172.21.15.84:0/981415135 --> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] -- command(tid 0: {"prefix": "status"}) -- 0x5637131c2750 con 0x563712e3ac90 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.134+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x563712e3ac90 0x5637132d9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2a8e00640 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x563712e3ac90 0x5637132d9780 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf9f3a715ef1cb0e server_cookie=a94d9f8ea918c58b in_seq=0 out_seq=0 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa292a00640 10 client.25409 ms_handle_connect on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa292a00640 1 -- 172.21.15.84:0/981415135 <== mds.2 v2:172.21.15.172:6836/3475533235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5637131c2750 con 0x563712e3ac90 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa292a00640 10 client.25409 handle_command_reply: tid=0 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 client.25409 shutdown 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 -- 172.21.15.84:0/981415135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 msgr2=0x56371326d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371326d240 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x56371325b7e0 tx=0x7fa28c0246d0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 -- 172.21.15.84:0/981415135 shutdown_connections 2024-09-21T02:42:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.172:6836/3475533235,v1:172.21.15.172:6837/3475533235] conn(0x563712e3ac90 0x5637132d9780 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563712ea6f60 0x5637132721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563712e86280 0x56371326d240 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa292a00640 0 client.25409 ms_handle_reset on v2:172.21.15.172:6836/3475533235 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 --2- 172.21.15.84:0/981415135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563712e7e0a0 0x56371326cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 -- 172.21.15.84:0/981415135 >> 172.21.15.84:0/981415135 conn(0x563712e9b350 msgr2=0x563713253f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 -- 172.21.15.84:0/981415135 shutdown_connections 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.135+0000 7fa2b23c0740 1 -- 172.21.15.84:0/981415135 wait complete. 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2b23c0740 20 client.25409 trim_cache size 0 max 16384 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:42:57.141 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24679, 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 136.75172783299999, 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 27, 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 218.114308112 2024-09-21T02:42:57.142 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:42:57.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 -- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2880b65a0 msgr2=0x7fa2880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2880b65a0 0x7fa2880b8ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009370 tx=0x7fa29c004a40 comp rx=0 tx=0).stop 2024-09-21T02:42:57.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 -- 172.21.15.84:0/2997992205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a4105d90 msgr2=0x7fa2a419c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:57.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a4105d90 0x7fa2a419c7b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa29400e9f0 tx=0x7fa29400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 -- 172.21.15.84:0/2997992205 shutdown_connections 2024-09-21T02:42:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa2880b65a0 0x7fa2880b8ab0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa2a410c020 0x7fa2a41a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2a410b6d0 0x7fa2a419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 --2- 172.21.15.84:0/2997992205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2a4105d90 0x7fa2a419c7b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.136+0000 7fa2ab800640 1 -- 172.21.15.84:0/2997992205 >> 172.21.15.84:0/2997992205 conn(0x7fa2a41017c0 msgr2=0x7fa2a4108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.137+0000 7fa2ab800640 1 -- 172.21.15.84:0/2997992205 shutdown_connections 2024-09-21T02:42:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:57.137+0000 7fa2ab800640 1 -- 172.21.15.84:0/2997992205 wait complete. 2024-09-21T02:42:57.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:57 smithi084 ceph-mon[30747]: pgmap v416: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T02:42:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:57 smithi172 ceph-mon[35067]: pgmap v416: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T02:42:58.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:57 smithi090 ceph-mon[34571]: pgmap v416: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T02:42:58.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T02:42:58.513 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:42:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 -- 172.21.15.84:0/41144979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010c010 msgr2=0x7f4a40112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 --2- 172.21.15.84:0/41144979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010c010 0x7f4a40112840 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009900 tx=0x7f4a3802a410 comp rx=0 tx=0).stop 2024-09-21T02:42:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 -- 172.21.15.84:0/41144979 shutdown_connections 2024-09-21T02:42:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 --2- 172.21.15.84:0/41144979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a4010b6c0 0x7f4a4010bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 --2- 172.21.15.84:0/41144979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010c010 0x7f4a40112840 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 --2- 172.21.15.84:0/41144979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a40105d80 0x7f4a40106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 -- 172.21.15.84:0/41144979 >> 172.21.15.84:0/41144979 conn(0x7f4a40101810 msgr2=0x7f4a40103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 -- 172.21.15.84:0/41144979 shutdown_connections 2024-09-21T02:42:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.180+0000 7f4a45c00640 1 -- 172.21.15.84:0/41144979 wait complete. 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.181+0000 7f4a45c00640 1 Processor -- start 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.181+0000 7f4a45c00640 1 -- start start 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a45c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a40105d80 0x7f4a4019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a45c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010b6c0 0x7f4a4019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a45c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a4010c010 0x7f4a401a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a45c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4a40115e60 con 0x7f4a4010b6c0 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a45c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a40115ce0 con 0x7f4a40105d80 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a45c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a40115fe0 con 0x7f4a4010c010 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a3e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010b6c0 0x7f4a4019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a3ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a40105d80 0x7f4a4019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a3ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a40105d80 0x7f4a4019c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51868/0 (socket says 172.21.15.84:51868) 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a3e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010b6c0 0x7f4a4019ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49940/0 (socket says 172.21.15.84:49940) 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a3ea00640 1 -- 172.21.15.84:0/2868987196 learned_addr learned my addr 172.21.15.84:0/2868987196 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.182+0000 7f4a3f400640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a4010c010 0x7f4a401a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a3ea00640 1 -- 172.21.15.84:0/2868987196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a4010c010 msgr2=0x7f4a401a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a3ea00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a4010c010 0x7f4a401a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a3ea00640 1 -- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010b6c0 msgr2=0x7f4a4019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a3ea00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010b6c0 0x7f4a4019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a3ea00640 1 -- 172.21.15.84:0/2868987196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a401a26c0 con 0x7f4a40105d80 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a3ea00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a40105d80 0x7f4a4019c750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009d50 tx=0x7f4a3000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a37400640 1 -- 172.21.15.84:0/2868987196 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30003b70 con 0x7f4a40105d80 2024-09-21T02:42:59.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a45c00640 1 -- 172.21.15.84:0/2868987196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a401a29b0 con 0x7f4a40105d80 2024-09-21T02:42:59.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a37400640 1 -- 172.21.15.84:0/2868987196 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a30003d10 con 0x7f4a40105d80 2024-09-21T02:42:59.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.183+0000 7f4a37400640 1 -- 172.21.15.84:0/2868987196 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30010990 con 0x7f4a40105d80 2024-09-21T02:42:59.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.184+0000 7f4a45c00640 1 -- 172.21.15.84:0/2868987196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a401a9110 con 0x7f4a40105d80 2024-09-21T02:42:59.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.186+0000 7f4a4c816740 1 Processor -- start 2024-09-21T02:42:59.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a4c816740 1 -- start start 2024-09-21T02:42:59.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac70490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac70f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a4c816740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55befabe7d50 con 0x55befa8a10a0 2024-09-21T02:42:59.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a4c816740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55befabd7180 con 0x55befa8a9280 2024-09-21T02:42:59.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a4c816740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55befabdaf90 con 0x55befa8c9f60 2024-09-21T02:42:59.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a3e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac70f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a3f400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac70490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a3e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac70f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51874/0 (socket says 172.21.15.84:51874) 2024-09-21T02:42:59.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.187+0000 7f4a3e000640 1 -- 172.21.15.84:0/845440979 learned_addr learned my addr 172.21.15.84:0/845440979 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:59.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.188+0000 7f4a37400640 1 -- 172.21.15.84:0/2868987196 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f4a30004610 con 0x7f4a40105d80 2024-09-21T02:42:59.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.188+0000 7f4a3f400640 1 -- 172.21.15.84:0/845440979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 msgr2=0x55befac70f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.188+0000 7f4a3f400640 1 --2- 172.21.15.84:0/845440979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac70f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.188+0000 7f4a3f400640 1 -- 172.21.15.84:0/845440979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 msgr2=0x55befac709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.188+0000 7f4a3f400640 1 --2- 172.21.15.84:0/845440979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.188+0000 7f4a3f400640 1 -- 172.21.15.84:0/845440979 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55befaba1a70 con 0x55befa8c9f60 2024-09-21T02:42:59.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.188+0000 7f4a3f400640 1 --2- 172.21.15.84:0/845440979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac70490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a3802a930 tx=0x7f4a380040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e4db2bde51f36c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.188+0000 7f4a2be00640 1 -- 172.21.15.84:0/845440979 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38040070 con 0x55befa8c9f60 2024-09-21T02:42:59.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.189+0000 7f4a2be00640 1 -- 172.21.15.84:0/845440979 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a380054f0 con 0x55befa8c9f60 2024-09-21T02:42:59.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.189+0000 7f4a2be00640 1 -- 172.21.15.84:0/845440979 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38035040 con 0x55befa8c9f60 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.189+0000 7f4a37400640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4a240b65a0 0x7f4a240b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.189+0000 7f4a4c816740 1 -- 172.21.15.84:0/845440979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 msgr2=0x55befac70490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.189+0000 7f4a4c816740 1 --2- 172.21.15.84:0/845440979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac70490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a3802a930 tx=0x7f4a380040d0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a37400640 1 -- 172.21.15.84:0/2868987196 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f4a300e7f40 con 0x7f4a40105d80 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a3ea00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4a240b65a0 0x7f4a240b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a4c816740 1 -- 172.21.15.84:0/845440979 shutdown_connections 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a4c816740 1 --2- 172.21.15.84:0/845440979 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac70f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a4c816740 1 --2- 172.21.15.84:0/845440979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a4c816740 1 --2- 172.21.15.84:0/845440979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac70490 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a4c816740 1 -- 172.21.15.84:0/845440979 >> 172.21.15.84:0/845440979 conn(0x55befa8be350 msgr2=0x55befac6e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a4c816740 1 -- 172.21.15.84:0/845440979 shutdown_connections 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a4c816740 1 -- 172.21.15.84:0/845440979 wait complete. 2024-09-21T02:42:59.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.190+0000 7f4a3ea00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4a240b65a0 0x7f4a240b8ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4a300e5530 tx=0x7f4a300a9b30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 1 -- start start 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 1 Processor -- start 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8a10a0 0x55befac7c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac7c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8c9f60 0x55befac87f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55befaa385f0 con 0x55befa8c9f60 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55befab72460 con 0x55befa8a9280 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55befac7ec10 con 0x55befa8a10a0 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.191+0000 7f4a4c816740 10 client.0 _ll_register_callbacks cb 0x55befab82210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8c9f60 0x55befac87f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac7c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac7c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51884/0 (socket says 172.21.15.84:51884) 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8c9f60 0x55befac87f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49960/0 (socket says 172.21.15.84:49960) 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3e000640 1 -- 172.21.15.84:0/213654 learned_addr learned my addr 172.21.15.84:0/213654 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3f400640 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8a10a0 0x55befac7c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3e000640 1 -- 172.21.15.84:0/213654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8a10a0 msgr2=0x55befac7c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3e000640 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8a10a0 0x55befac7c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3e000640 1 -- 172.21.15.84:0/213654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8c9f60 msgr2=0x55befac87f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3e000640 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8c9f60 0x55befac87f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.192+0000 7f4a3e000640 1 -- 172.21.15.84:0/213654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55befa935540 con 0x55befa8a9280 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.193+0000 7f4a3e000640 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac7c560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c012810 tx=0x7f4a2c012cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61f5755aec308dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.193+0000 7f4a28c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.193+0000 7f4a28c00640 1 -- 172.21.15.84:0/213654 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c004050 con 0x55befa8a9280 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.193+0000 7f4a4c816740 1 -- 172.21.15.84:0/213654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55befab74a70 con 0x55befa8a9280 2024-09-21T02:42:59.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.193+0000 7f4a28c00640 1 -- 172.21.15.84:0/213654 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f4a2c0041f0 con 0x55befa8a9280 2024-09-21T02:42:59.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.193+0000 7f4a28c00640 1 -- 172.21.15.84:0/213654 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4a2c0043f0 con 0x55befa8a9280 2024-09-21T02:42:59.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.193+0000 7f4a4c816740 10 client.25421 fetch_fsmap learned FSMap version 27 2024-09-21T02:42:59.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.193+0000 7f4a4c816740 1 -- 172.21.15.84:0/213654 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55befab8f6f0 con 0x55befa8a9280 2024-09-21T02:42:59.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.194+0000 7f4a28c00640 1 -- 172.21.15.84:0/213654 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55befab74a70 con 0x55befa8a9280 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.194+0000 7f4a28c00640 1 -- 172.21.15.84:0/213654 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4a2c003bf0 con 0x55befa8a9280 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.194+0000 7f4a4c816740 10 client.25421 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.194+0000 7f4a4c816740 10 client.25421 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.194+0000 7f4a4c816740 20 client.25421 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.194+0000 7f4a4c816740 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x55befa8888e0 0x55befac8e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.194+0000 7f4a4c816740 4 client.25421 mds_command: new command op to 24703 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.194+0000 7f4a4c816740 1 -- 172.21.15.84:0/213654 --> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55befabe9ca0 con 0x55befa8888e0 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.195+0000 7f4a3f400640 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x55befa8888e0 0x55befac8e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.195+0000 7f4a3f400640 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x55befa8888e0 0x55befac8e520 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d350225116d358c server_cookie=c1327bc2adefa462 in_seq=0 out_seq=0 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.195+0000 7f4a28c00640 10 client.25421 ms_handle_connect on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a28c00640 1 -- 172.21.15.84:0/213654 <== mds.1 v2:172.21.15.172:6838/3937933536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55befabe9ca0 con 0x55befa8888e0 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a28c00640 10 client.25421 handle_command_reply: tid=0 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 client.25421 shutdown 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 -- 172.21.15.84:0/213654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 msgr2=0x55befac7c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac7c560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c012810 tx=0x7f4a2c012cd0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 -- 172.21.15.84:0/213654 shutdown_connections 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x55befa8888e0 0x55befac8e520 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8c9f60 0x55befac87f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac7c560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 --2- 172.21.15.84:0/213654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8a10a0 0x55befac7c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a28c00640 0 client.25421 ms_handle_reset on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.196+0000 7f4a4c816740 1 -- 172.21.15.84:0/213654 >> 172.21.15.84:0/213654 conn(0x55befa8be350 msgr2=0x55befac73670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.197+0000 7f4a4c816740 1 -- 172.21.15.84:0/213654 shutdown_connections 2024-09-21T02:42:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.197+0000 7f4a4c816740 1 -- 172.21.15.84:0/213654 wait complete. 2024-09-21T02:42:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.197+0000 7f4a4c816740 20 client.25421 trim_cache size 0 max 16384 2024-09-21T02:42:59.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.215+0000 7f4a4c816740 1 Processor -- start 2024-09-21T02:42:59.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.215+0000 7f4a4c816740 1 -- start start 2024-09-21T02:42:59.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a10a0 0x55befac8de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a9280 0x55befac87e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac69010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a4c816740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55befac8c860 con 0x55befa8a9280 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a4c816740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55befac8cf30 con 0x55befa8a10a0 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a4c816740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55befac8d600 con 0x55befa8c9f60 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a9280 0x55befac87e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a9280 0x55befac87e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49962/0 (socket says 172.21.15.84:49962) 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3e000640 1 -- 172.21.15.84:0/3362693804 learned_addr learned my addr 172.21.15.84:0/3362693804 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3f400640 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a10a0 0x55befac8de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3f400640 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac69010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3f400640 1 -- 172.21.15.84:0/3362693804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 msgr2=0x55befac69010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3f400640 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac69010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3f400640 1 -- 172.21.15.84:0/3362693804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a9280 msgr2=0x55befac87e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3f400640 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a9280 0x55befac87e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.216+0000 7f4a3f400640 1 -- 172.21.15.84:0/3362693804 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55befac732f0 con 0x55befa8a10a0 2024-09-21T02:42:59.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.217+0000 7f4a3f400640 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a10a0 0x55befac8de50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004dc0 tx=0x7f4a38031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30140354a37de88a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.217+0000 7f4a2b400640 1 -- 172.21.15.84:0/3362693804 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38040040 con 0x55befa8a10a0 2024-09-21T02:42:59.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.217+0000 7f4a2b400640 1 -- 172.21.15.84:0/3362693804 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a380054b0 con 0x55befa8a10a0 2024-09-21T02:42:59.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.217+0000 7f4a2b400640 1 -- 172.21.15.84:0/3362693804 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38035040 con 0x55befa8a10a0 2024-09-21T02:42:59.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 -- 172.21.15.84:0/3362693804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a10a0 msgr2=0x55befac8de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a10a0 0x55befac8de50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004dc0 tx=0x7f4a38031400 comp rx=0 tx=0).stop 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 -- 172.21.15.84:0/3362693804 shutdown_connections 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac69010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a9280 0x55befac87e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 --2- 172.21.15.84:0/3362693804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a10a0 0x55befac8de50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 -- 172.21.15.84:0/3362693804 >> 172.21.15.84:0/3362693804 conn(0x55befa8be350 msgr2=0x55befac76fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 -- 172.21.15.84:0/3362693804 shutdown_connections 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 -- 172.21.15.84:0/3362693804 wait complete. 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.218+0000 7f4a4c816740 1 -- start start 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a4c816740 1 Processor -- start 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac90f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac914c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a4c816740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac95d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a4c816740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55befac8e3a0 con 0x55befa8a10a0 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a4c816740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55befac8dcd0 con 0x55befa8a9280 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a4c816740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55befac8ea70 con 0x55befa8c9f60 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a4c816740 10 client.0 _ll_register_callbacks cb 0x7f4a2c012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a3f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac90f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a3f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac90f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49968/0 (socket says 172.21.15.84:49968) 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a3f400640 1 -- 172.21.15.84:0/412833598 learned_addr learned my addr 172.21.15.84:0/412833598 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.219+0000 7f4a3e000640 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac914c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a3f400640 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac95d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a3f400640 1 -- 172.21.15.84:0/412833598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 msgr2=0x55befac95d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a3f400640 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac95d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a3f400640 1 -- 172.21.15.84:0/412833598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 msgr2=0x55befac914c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:42:59.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a3f400640 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac914c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a3f400640 1 -- 172.21.15.84:0/412833598 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55befac963c0 con 0x55befa8a10a0 2024-09-21T02:42:59.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a3f400640 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac90f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004150 tx=0x7f4a38005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f830ddff3fbdbb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:42:59.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a28c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a28c00640 1 -- 172.21.15.84:0/412833598 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38040070 con 0x55befa8a10a0 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a28c00640 1 -- 172.21.15.84:0/412833598 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f4a38004fe0 con 0x55befa8a10a0 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.220+0000 7f4a4c816740 1 -- 172.21.15.84:0/412833598 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a380054b0 con 0x55befa8a10a0 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a28c00640 1 -- 172.21.15.84:0/412833598 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4a38035040 con 0x55befa8a10a0 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a4c816740 10 client.15417 fetch_fsmap learned FSMap version 27 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a4c816740 1 -- 172.21.15.84:0/412833598 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55befacf99f0 con 0x55befa8a10a0 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a28c00640 1 -- 172.21.15.84:0/412833598 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4a380054b0 con 0x55befa8a10a0 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a28c00640 1 -- 172.21.15.84:0/412833598 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4a38055040 con 0x55befa8a10a0 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a4c816740 10 client.15417 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a4c816740 10 client.15417 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T02:42:59.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a4c816740 20 client.15417 populate_metadata read hostname 'smithi084' 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a4c816740 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x55befa85dc90 0x55befacfcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a4c816740 4 client.15417 mds_command: new command op to 24703 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.221+0000 7f4a4c816740 1 -- 172.21.15.84:0/412833598 --> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] -- command(tid 0: {"prefix": "status"}) -- 0x55befabe5750 con 0x55befa85dc90 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.222+0000 7f4a3e000640 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x55befa85dc90 0x55befacfcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.222+0000 7f4a3e000640 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x55befa85dc90 0x55befacfcaa0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd6273f7bfd08f34 server_cookie=8c8c8dfe0d4c6122 in_seq=0 out_seq=0 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.222+0000 7f4a28c00640 10 client.15417 ms_handle_connect on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a28c00640 1 -- 172.21.15.84:0/412833598 <== mds.1 v2:172.21.15.172:6838/3937933536 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55befabe5750 con 0x55befa85dc90 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a28c00640 10 client.15417 handle_command_reply: tid=0 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 client.15417 shutdown 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 -- 172.21.15.84:0/412833598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 msgr2=0x55befac90f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac90f00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004150 tx=0x7f4a38005fd0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 -- 172.21.15.84:0/412833598 shutdown_connections 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55befa8c9f60 0x55befac95d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.172:6838/3937933536,v1:172.21.15.172:6839/3937933536] conn(0x55befa85dc90 0x55befacfcaa0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55befa8a9280 0x55befac914c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 --2- 172.21.15.84:0/412833598 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55befa8a10a0 0x55befac90f00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 -- 172.21.15.84:0/412833598 >> 172.21.15.84:0/412833598 conn(0x55befa8be350 msgr2=0x55befac7a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a28c00640 0 client.15417 ms_handle_reset on v2:172.21.15.172:6838/3937933536 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 -- 172.21.15.84:0/412833598 shutdown_connections 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 1 -- 172.21.15.84:0/412833598 wait complete. 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.223+0000 7f4a4c816740 20 client.15417 trim_cache size 0 max 16384 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:42:59.228 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24703, 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 139.86115282399999, 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 27, 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 214.86152709199999 2024-09-21T02:42:59.229 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:42:59.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 -- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4a240b65a0 msgr2=0x7f4a240b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4a240b65a0 0x7f4a240b8ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4a300e5530 tx=0x7f4a300a9b30 comp rx=0 tx=0).stop 2024-09-21T02:42:59.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 -- 172.21.15.84:0/2868987196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a40105d80 msgr2=0x7f4a4019c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:42:59.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a40105d80 0x7f4a4019c750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009d50 tx=0x7f4a3000c6a0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 -- 172.21.15.84:0/2868987196 shutdown_connections 2024-09-21T02:42:59.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4a240b65a0 0x7f4a240b8ab0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a4010c010 0x7f4a401a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a4010b6c0 0x7f4a4019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 --2- 172.21.15.84:0/2868987196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a40105d80 0x7f4a4019c750 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:42:59.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 -- 172.21.15.84:0/2868987196 >> 172.21.15.84:0/2868987196 conn(0x7f4a40101810 msgr2=0x7f4a4010ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:42:59.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 -- 172.21.15.84:0/2868987196 shutdown_connections 2024-09-21T02:42:59.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:42:59.224+0000 7f4a45c00640 1 -- 172.21.15.84:0/2868987196 wait complete. 2024-09-21T02:43:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:42:59 smithi172 ceph-mon[35067]: pgmap v417: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:00.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:42:59 smithi084 ceph-mon[30747]: pgmap v417: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:00.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:42:59 smithi090 ceph-mon[34571]: pgmap v417: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:00.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T02:43:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.223+0000 7fae25400640 1 -- 172.21.15.84:0/1500501265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010b6c0 msgr2=0x7fae2010bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.223+0000 7fae25400640 1 --2- 172.21.15.84:0/1500501265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010b6c0 0x7fae2010bad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae08009900 tx=0x7fae0802a410 comp rx=0 tx=0).stop 2024-09-21T02:43:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.224+0000 7fae25400640 1 -- 172.21.15.84:0/1500501265 shutdown_connections 2024-09-21T02:43:01.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.224+0000 7fae25400640 1 --2- 172.21.15.84:0/1500501265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2010c010 0x7fae20112840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.224+0000 7fae25400640 1 --2- 172.21.15.84:0/1500501265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010b6c0 0x7fae2010bad0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.224+0000 7fae25400640 1 --2- 172.21.15.84:0/1500501265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae20105d80 0x7fae20106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.224+0000 7fae25400640 1 -- 172.21.15.84:0/1500501265 >> 172.21.15.84:0/1500501265 conn(0x7fae20101810 msgr2=0x7fae20103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.224+0000 7fae25400640 1 -- 172.21.15.84:0/1500501265 shutdown_connections 2024-09-21T02:43:01.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.224+0000 7fae25400640 1 -- 172.21.15.84:0/1500501265 wait complete. 2024-09-21T02:43:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.225+0000 7fae25400640 1 Processor -- start 2024-09-21T02:43:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.225+0000 7fae25400640 1 -- start start 2024-09-21T02:43:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.225+0000 7fae25400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae20105d80 0x7fae2019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.225+0000 7fae25400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2010b6c0 0x7fae2019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.225+0000 7fae25400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010c010 0x7fae201a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.225+0000 7fae25400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fae20115df0 con 0x7fae2010c010 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.225+0000 7fae25400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae20115c70 con 0x7fae20105d80 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.225+0000 7fae25400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae20115f70 con 0x7fae2010b6c0 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010c010 0x7fae201a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae20105d80 0x7fae2019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010c010 0x7fae201a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41766/0 (socket says 172.21.15.84:41766) 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1f200640 1 -- 172.21.15.84:0/511802731 learned_addr learned my addr 172.21.15.84:0/511802731 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae15e00640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2010b6c0 0x7fae2019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1e800640 1 -- 172.21.15.84:0/511802731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2010b6c0 msgr2=0x7fae2019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1e800640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2010b6c0 0x7fae2019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1e800640 1 -- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010c010 msgr2=0x7fae201a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1e800640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010c010 0x7fae201a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1e800640 1 -- 172.21.15.84:0/511802731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae201a2710 con 0x7fae20105d80 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.226+0000 7fae1f200640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010c010 0x7fae201a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.227+0000 7fae1e800640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae20105d80 0x7fae2019c7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae1000e9f0 tx=0x7fae1000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.227+0000 7fae17e00640 1 -- 172.21.15.84:0/511802731 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1000ccc0 con 0x7fae20105d80 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.227+0000 7fae25400640 1 -- 172.21.15.84:0/511802731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae201a2a00 con 0x7fae20105d80 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.227+0000 7fae17e00640 1 -- 172.21.15.84:0/511802731 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae10010900 con 0x7fae20105d80 2024-09-21T02:43:01.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.227+0000 7fae17e00640 1 -- 172.21.15.84:0/511802731 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10018920 con 0x7fae20105d80 2024-09-21T02:43:01.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.227+0000 7fae25400640 1 -- 172.21.15.84:0/511802731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae201a9160 con 0x7fae20105d80 2024-09-21T02:43:01.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.231+0000 7fae2c0bb740 1 Processor -- start 2024-09-21T02:43:01.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.231+0000 7fae2c0bb740 1 -- start start 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.231+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.231+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 0x5603555b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.231+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.231+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56035552ed50 con 0x5603551e80a0 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.231+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x56035551e180 con 0x5603551f0280 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.231+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560355521f90 con 0x560355210f60 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:57040/0 (socket says 172.21.15.84:57040) 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 -- 172.21.15.84:0/3938159144 learned_addr learned my addr 172.21.15.84:0/3938159144 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:01.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae15e00640 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 -- 172.21.15.84:0/3938159144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 msgr2=0x5603555b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae17e00640 1 -- 172.21.15.84:0/511802731 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fae10010ab0 con 0x7fae20105d80 2024-09-21T02:43:01.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 -- 172.21.15.84:0/3938159144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 msgr2=0x5603555b79d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:43:01.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 0x5603555b79d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 -- 172.21.15.84:0/3938159144 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603554e8a70 con 0x560355210f60 2024-09-21T02:43:01.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae15e00640 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:01.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.232+0000 7fae1f200640 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555b7490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae180117e0 tx=0x7fae18011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d426b8a9a3b38799 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.233+0000 7fae0f400640 1 -- 172.21.15.84:0/3938159144 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1800fb40 con 0x560355210f60 2024-09-21T02:43:01.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.233+0000 7fae0f400640 1 -- 172.21.15.84:0/3938159144 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae1800fce0 con 0x560355210f60 2024-09-21T02:43:01.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.233+0000 7fae0f400640 1 -- 172.21.15.84:0/3938159144 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae180105d0 con 0x560355210f60 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.233+0000 7fae2c0bb740 1 -- 172.21.15.84:0/3938159144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 msgr2=0x5603555b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.233+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555b7490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae180117e0 tx=0x7fae18011ca0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae2c0bb740 1 -- 172.21.15.84:0/3938159144 shutdown_connections 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 0x5603555b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/3938159144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555b7490 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae2c0bb740 1 -- 172.21.15.84:0/3938159144 >> 172.21.15.84:0/3938159144 conn(0x560355205350 msgr2=0x5603555b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae2c0bb740 1 -- 172.21.15.84:0/3938159144 shutdown_connections 2024-09-21T02:43:01.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae2c0bb740 1 -- 172.21.15.84:0/3938159144 wait complete. 2024-09-21T02:43:01.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae17e00640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae040b64b0 0x7fae040b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae2c0bb740 1 -- start start 2024-09-21T02:43:01.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae17e00640 1 -- 172.21.15.84:0/511802731 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fae100e7b80 con 0x7fae20105d80 2024-09-21T02:43:01.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.234+0000 7fae15e00640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae040b64b0 0x7fae040b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae2c0bb740 1 Processor -- start 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603551f0280 0x5603555c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae15e00640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae040b64b0 0x7fae040b89c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae08005940 tx=0x7fae080058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560355210f60 0x5603555cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56035537f5f0 con 0x560355210f60 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5603554b9460 con 0x5603551e80a0 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5603555c5c70 con 0x5603551f0280 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.235+0000 7fae2c0bb740 10 client.0 _ll_register_callbacks cb 0x5603554c9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560355210f60 0x5603555cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:48032/0 (socket says 172.21.15.84:48032) 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 -- 172.21.15.84:0/4099508611 learned_addr learned my addr 172.21.15.84:0/4099508611 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1f200640 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560355210f60 0x5603555cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41768/0 (socket says 172.21.15.84:41768) 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae15e00640 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603551f0280 0x5603555c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 -- 172.21.15.84:0/4099508611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603551f0280 msgr2=0x5603555c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603551f0280 0x5603555c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 -- 172.21.15.84:0/4099508611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560355210f60 msgr2=0x5603555cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560355210f60 0x5603555cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 -- 172.21.15.84:0/4099508611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56035527c540 con 0x5603551e80a0 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae1e800640 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555c3080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fae1000c6a0 tx=0x7fae100acea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58eef03779ff385d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.236+0000 7fae03e00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae03e00640 1 -- 172.21.15.84:0/4099508611 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae100ad1c0 con 0x5603551e80a0 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae03e00640 1 -- 172.21.15.84:0/4099508611 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fae10018ac0 con 0x5603551e80a0 2024-09-21T02:43:01.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae2c0bb740 1 -- 172.21.15.84:0/4099508611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603554bba70 con 0x5603551e80a0 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae03e00640 1 -- 172.21.15.84:0/4099508611 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fae100acfe0 con 0x5603551e80a0 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae2c0bb740 10 client.25439 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae2c0bb740 1 -- 172.21.15.84:0/4099508611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5603554d66f0 con 0x5603551e80a0 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae03e00640 1 -- 172.21.15.84:0/4099508611 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x5603554bba70 con 0x5603551e80a0 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae03e00640 1 -- 172.21.15.84:0/4099508611 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fae100ac540 con 0x5603551e80a0 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae2c0bb740 10 client.25439 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae2c0bb740 10 client.25439 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.237+0000 7fae2c0bb740 20 client.25439 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.238+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5603551cf8e0 0x5603555d5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.238+0000 7fae2c0bb740 4 client.25439 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.238+0000 7fae2c0bb740 1 -- 172.21.15.84:0/4099508611 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560355530ca0 con 0x5603551cf8e0 2024-09-21T02:43:01.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.238+0000 7fae15e00640 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5603551cf8e0 0x5603555d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.238+0000 7fae15e00640 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5603551cf8e0 0x5603555d5510 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b45bd466203e5dad server_cookie=fd5b756489863291 in_seq=0 out_seq=0 2024-09-21T02:43:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.238+0000 7fae03e00640 10 client.25439 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:01.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.239+0000 7fae03e00640 1 -- 172.21.15.84:0/4099508611 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560355530ca0 con 0x5603551cf8e0 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.239+0000 7fae03e00640 10 client.25439 handle_command_reply: tid=0 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.239+0000 7fae2c0bb740 1 client.25439 shutdown 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 -- 172.21.15.84:0/4099508611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 msgr2=0x5603555c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555c3080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fae1000c6a0 tx=0x7fae100acea0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 -- 172.21.15.84:0/4099508611 shutdown_connections 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603551f0280 0x5603555c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5603551cf8e0 0x5603555d5510 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560355210f60 0x5603555cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/4099508611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555c3080 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae03e00640 0 client.25439 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 -- 172.21.15.84:0/4099508611 >> 172.21.15.84:0/4099508611 conn(0x560355205350 msgr2=0x5603555ba620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 -- 172.21.15.84:0/4099508611 shutdown_connections 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 1 -- 172.21.15.84:0/4099508611 wait complete. 2024-09-21T02:43:01.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.240+0000 7fae2c0bb740 20 client.25439 trim_cache size 0 max 16384 2024-09-21T02:43:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.258+0000 7fae2c0bb740 1 Processor -- start 2024-09-21T02:43:01.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.258+0000 7fae2c0bb740 1 -- start start 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555be000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551f0280 0x5603555be540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5603555d3850 con 0x5603551f0280 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5603555d3f20 con 0x5603551e80a0 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5603555d45f0 con 0x560355210f60 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae15e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551f0280 0x5603555be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae15e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551f0280 0x5603555be540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41778/0 (socket says 172.21.15.84:41778) 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae15e00640 1 -- 172.21.15.84:0/1120746611 learned_addr learned my addr 172.21.15.84:0/1120746611 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae1e800640 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.259+0000 7fae1f200640 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae15e00640 1 -- 172.21.15.84:0/1120746611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 msgr2=0x5603555c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae15e00640 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae15e00640 1 -- 172.21.15.84:0/1120746611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 msgr2=0x5603555be000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae15e00640 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555be000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae15e00640 1 -- 172.21.15.84:0/1120746611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603555c4140 con 0x5603551f0280 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae1e800640 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae1f200640 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:01.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae15e00640 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551f0280 0x5603555be540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fae080317c0 tx=0x7fae0803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d499f5d4bd507923 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae0ea00640 1 -- 172.21.15.84:0/1120746611 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08035040 con 0x5603551f0280 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae0ea00640 1 -- 172.21.15.84:0/1120746611 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae08055030 con 0x5603551f0280 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.260+0000 7fae0ea00640 1 -- 172.21.15.84:0/1120746611 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0803c900 con 0x5603551f0280 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1120746611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551f0280 msgr2=0x5603555be540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551f0280 0x5603555be540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fae080317c0 tx=0x7fae0803e000 comp rx=0 tx=0).stop 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1120746611 shutdown_connections 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551f0280 0x5603555be540 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1120746611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551e80a0 0x5603555be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1120746611 >> 172.21.15.84:0/1120746611 conn(0x560355205350 msgr2=0x5603555c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1120746611 shutdown_connections 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.261+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1120746611 wait complete. 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.262+0000 7fae2c0bb740 1 -- start start 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.262+0000 7fae2c0bb740 1 Processor -- start 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 0x5603555d7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555d8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae2c0bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555dd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5603555d5390 con 0x5603551e80a0 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5603555d4cc0 con 0x5603551f0280 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae2c0bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5603555d5a60 con 0x560355210f60 2024-09-21T02:43:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae2c0bb740 10 client.0 _ll_register_callbacks cb 0x7fae100a9710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:01.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae15e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555d8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae1e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 0x5603555d7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae15e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555d8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:48048/0 (socket says 172.21.15.84:48048) 2024-09-21T02:43:01.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae15e00640 1 -- 172.21.15.84:0/1127798417 learned_addr learned my addr 172.21.15.84:0/1127798417 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:01.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae1f200640 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555dd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae15e00640 1 -- 172.21.15.84:0/1127798417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 msgr2=0x5603555dd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae15e00640 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555dd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae15e00640 1 -- 172.21.15.84:0/1127798417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 msgr2=0x5603555d7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae15e00640 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 0x5603555d7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.263+0000 7fae15e00640 1 -- 172.21.15.84:0/1127798417 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603555d8920 con 0x5603551f0280 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.264+0000 7fae15e00640 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555d8030 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae080096c0 tx=0x7fae0802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd4cc6aa81de82be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.264+0000 7fae03e00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.264+0000 7fae03e00640 1 -- 172.21.15.84:0/1127798417 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae080043c0 con 0x5603551f0280 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.264+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1127798417 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae08055030 con 0x5603551f0280 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.264+0000 7fae03e00640 1 -- 172.21.15.84:0/1127798417 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fae080035f0 con 0x5603551f0280 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.264+0000 7fae03e00640 1 -- 172.21.15.84:0/1127798417 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fae080037f0 con 0x5603551f0280 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae2c0bb740 10 client.25445 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1127798417 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560355640fd0 con 0x5603551f0280 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae03e00640 1 -- 172.21.15.84:0/1127798417 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fae08055030 con 0x5603551f0280 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae03e00640 1 -- 172.21.15.84:0/1127798417 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fae08049420 con 0x5603551f0280 2024-09-21T02:43:01.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae2c0bb740 10 client.25445 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae2c0bb740 10 client.25445 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T02:43:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae2c0bb740 20 client.25445 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5603551a4c90 0x560355644430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae2c0bb740 4 client.25445 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T02:43:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.265+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1127798417 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "status"}) -- 0x56035552c750 con 0x5603551a4c90 2024-09-21T02:43:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.266+0000 7fae1e800640 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5603551a4c90 0x560355644430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.266+0000 7fae1e800640 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5603551a4c90 0x560355644430 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78a16d6279a4c9f4 server_cookie=a39fe5c81ed078d7 in_seq=0 out_seq=0 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.266+0000 7fae03e00640 10 client.25445 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.266+0000 7fae03e00640 1 -- 172.21.15.84:0/1127798417 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56035552c750 con 0x5603551a4c90 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.266+0000 7fae03e00640 10 client.25445 handle_command_reply: tid=0 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.266+0000 7fae2c0bb740 1 client.25445 shutdown 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1127798417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 msgr2=0x5603555d8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555d8030 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae080096c0 tx=0x7fae0802a410 comp rx=0 tx=0).stop 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1127798417 shutdown_connections 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560355210f60 0x5603555dd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5603551a4c90 0x560355644430 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5603551f0280 0x5603555d8030 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 --2- 172.21.15.84:0/1127798417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603551e80a0 0x5603555d7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae03e00640 0 client.25445 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1127798417 >> 172.21.15.84:0/1127798417 conn(0x560355205350 msgr2=0x5603555c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1127798417 shutdown_connections 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 1 -- 172.21.15.84:0/1127798417 wait complete. 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.267+0000 7fae2c0bb740 20 client.25445 trim_cache size 0 max 16384 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "5b18da14-77c1-11ef-baf5-efdc52797490", 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T02:43:01.271 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24704, 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 192.42182716100001, 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 27, 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 88, 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 88, 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 206.974085065 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:43:01.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 -- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae040b64b0 msgr2=0x7fae040b89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae040b64b0 0x7fae040b89c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae08005940 tx=0x7fae080058d0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 -- 172.21.15.84:0/511802731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae20105d80 msgr2=0x7fae2019c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae20105d80 0x7fae2019c7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae1000e9f0 tx=0x7fae1000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 -- 172.21.15.84:0/511802731 shutdown_connections 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fae040b64b0 0x7fae040b89c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae2010b6c0 0x7fae2019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae2010c010 0x7fae201a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 --2- 172.21.15.84:0/511802731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae20105d80 0x7fae2019c7a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 -- 172.21.15.84:0/511802731 >> 172.21.15.84:0/511802731 conn(0x7fae20101810 msgr2=0x7fae20108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 -- 172.21.15.84:0/511802731 shutdown_connections 2024-09-21T02:43:01.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:01.268+0000 7fae25400640 1 -- 172.21.15.84:0/511802731 wait complete. 2024-09-21T02:43:01.986 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:01 smithi084 ceph-mon[30747]: pgmap v418: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-21T02:43:02.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:01 smithi172 ceph-mon[35067]: pgmap v418: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-21T02:43:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:01 smithi090 ceph-mon[34571]: pgmap v418: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-21T02:43:02.026 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T02:43:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:03 smithi172 ceph-mon[35067]: pgmap v419: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:03 smithi084 ceph-mon[30747]: pgmap v419: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:03 smithi090 ceph-mon[34571]: pgmap v419: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 -- 172.21.15.84:0/3221509286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f8104570 msgr2=0x7f27f8104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 --2- 172.21.15.84:0/3221509286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f8104570 0x7f27f8104980 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009900 tx=0x7f27e402a410 comp rx=0 tx=0).stop 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 -- 172.21.15.84:0/3221509286 shutdown_connections 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 --2- 172.21.15.84:0/3221509286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27f8104f10 0x7f27f810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 --2- 172.21.15.84:0/3221509286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f8104570 0x7f27f8104980 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 --2- 172.21.15.84:0/3221509286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f81034f0 0x7f27f8103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 -- 172.21.15.84:0/3221509286 >> 172.21.15.84:0/3221509286 conn(0x7f27f80fee30 msgr2=0x7f27f81012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 -- 172.21.15.84:0/3221509286 shutdown_connections 2024-09-21T02:43:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.814+0000 7f27f7200640 1 -- 172.21.15.84:0/3221509286 wait complete. 2024-09-21T02:43:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.815+0000 7f27f7200640 1 Processor -- start 2024-09-21T02:43:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f7200640 1 -- start start 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f81034f0 0x7f27f819c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f7200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8104570 0x7f27f819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f7200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27f8104f10 0x7f27f819d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27f810f2e0 con 0x7f27f81034f0 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f7200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27f810f160 con 0x7f27f8104f10 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f7200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27f810f460 con 0x7f27f8104570 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f81034f0 0x7f27f819c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f81034f0 0x7f27f819c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41806/0 (socket says 172.21.15.84:41806) 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f5e00640 1 -- 172.21.15.84:0/1054652418 learned_addr learned my addr 172.21.15.84:0/1054652418 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f5400640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8104570 0x7f27f819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.816+0000 7f27f6800640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27f8104f10 0x7f27f819d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f5e00640 1 -- 172.21.15.84:0/1054652418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8104570 msgr2=0x7f27f819c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f5e00640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8104570 0x7f27f819c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f5e00640 1 -- 172.21.15.84:0/1054652418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27f8104f10 msgr2=0x7f27f819d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f5e00640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27f8104f10 0x7f27f819d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f5e00640 1 -- 172.21.15.84:0/1054652418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f819dac0 con 0x7f27f81034f0 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f6800640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27f8104f10 0x7f27f819d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f5e00640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f81034f0 0x7f27f819c080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27e800e9f0 tx=0x7f27e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27eea00640 1 -- 172.21.15.84:0/1054652418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e800cd80 con 0x7f27f81034f0 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f7200640 1 -- 172.21.15.84:0/1054652418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f819ddb0 con 0x7f27f81034f0 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27eea00640 1 -- 172.21.15.84:0/1054652418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27e80054f0 con 0x7f27f81034f0 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27f7200640 1 -- 172.21.15.84:0/1054652418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f81a44a0 con 0x7f27f81034f0 2024-09-21T02:43:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.817+0000 7f27eea00640 1 -- 172.21.15.84:0/1054652418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8018630 con 0x7f27f81034f0 2024-09-21T02:43:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f280421c740 1 Processor -- start 2024-09-21T02:43:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f280421c740 1 -- start start 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f280421c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b0650472b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f280421c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b065047920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f280421c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 0x55b065048470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f280421c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b064fba6b0 con 0x55b064c772f0 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f280421c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b064fa9ae0 con 0x55b064ca01b0 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f280421c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b064fad8f0 con 0x55b064c7f4d0 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f27f6800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b0650472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f27f6800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b0650472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:48068/0 (socket says 172.21.15.84:48068) 2024-09-21T02:43:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f27f6800640 1 -- 172.21.15.84:0/2744100357 learned_addr learned my addr 172.21.15.84:0/2744100357 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f27f5400640 1 --2- 172.21.15.84:0/2744100357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 0x55b065048470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.821+0000 7f27eea00640 1 -- 172.21.15.84:0/1054652418 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f27e80187d0 con 0x7f27f81034f0 2024-09-21T02:43:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27f6800640 1 -- 172.21.15.84:0/2744100357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 msgr2=0x55b065048470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27f6800640 1 --2- 172.21.15.84:0/2744100357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 0x55b065048470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27f6800640 1 -- 172.21.15.84:0/2744100357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 msgr2=0x55b065047920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27f6800640 1 --2- 172.21.15.84:0/2744100357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b065047920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27f6800640 1 -- 172.21.15.84:0/2744100357 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b064f76780 con 0x55b064ca01b0 2024-09-21T02:43:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27f6800640 1 --2- 172.21.15.84:0/2744100357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b0650472b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009fd0 tx=0x7f27f00108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=889eb130b28f6e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27e3400640 1 -- 172.21.15.84:0/2744100357 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011760 con 0x55b064ca01b0 2024-09-21T02:43:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27e3400640 1 -- 172.21.15.84:0/2744100357 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27f0011dd0 con 0x55b064ca01b0 2024-09-21T02:43:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.822+0000 7f27e3400640 1 -- 172.21.15.84:0/2744100357 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f000e3c0 con 0x55b064ca01b0 2024-09-21T02:43:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f27eea00640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f27dc0b65a0 0x7f27dc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f280421c740 1 -- 172.21.15.84:0/2744100357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 msgr2=0x55b0650472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f280421c740 1 --2- 172.21.15.84:0/2744100357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b0650472b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009fd0 tx=0x7f27f00108e0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f27eea00640 1 -- 172.21.15.84:0/1054652418 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f27e80e7df0 con 0x7f27f81034f0 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f280421c740 1 -- 172.21.15.84:0/2744100357 shutdown_connections 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f280421c740 1 --2- 172.21.15.84:0/2744100357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 0x55b065048470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f280421c740 1 --2- 172.21.15.84:0/2744100357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b065047920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f280421c740 1 --2- 172.21.15.84:0/2744100357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b0650472b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f27f5e00640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f27dc0b65a0 0x7f27dc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.823+0000 7f280421c740 1 -- 172.21.15.84:0/2744100357 >> 172.21.15.84:0/2744100357 conn(0x55b064c94300 msgr2=0x55b065042d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.824+0000 7f280421c740 1 -- 172.21.15.84:0/2744100357 shutdown_connections 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.824+0000 7f280421c740 1 -- 172.21.15.84:0/2744100357 wait complete. 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.824+0000 7f27f5e00640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f27dc0b65a0 0x7f27dc0b8ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f27e80ada20 tx=0x7f27e80e80b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.824+0000 7f280421c740 1 -- start start 2024-09-21T02:43:05.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.824+0000 7f280421c740 1 Processor -- start 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f280421c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 0x55b0650509a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f280421c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064c7f4d0 0x55b065051060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f280421c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064ca01b0 0x55b065051bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f280421c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b064ee1ab0 con 0x55b064ca01b0 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f280421c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55b064f50570 con 0x55b064c7f4d0 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f280421c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b065048f90 con 0x55b064c772f0 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f280421c740 10 client.0 _ll_register_callbacks cb 0x55b064f5f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064ca01b0 0x55b065051bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f5400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064c7f4d0 0x55b065051060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064ca01b0 0x55b065051bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41822/0 (socket says 172.21.15.84:41822) 2024-09-21T02:43:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f6800640 1 -- 172.21.15.84:0/256999552 learned_addr learned my addr 172.21.15.84:0/256999552 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f6800640 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 0x55b0650509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f6800640 1 -- 172.21.15.84:0/256999552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 msgr2=0x55b0650509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f6800640 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 0x55b0650509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f6800640 1 -- 172.21.15.84:0/256999552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064c7f4d0 msgr2=0x55b065051060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.825+0000 7f27f6800640 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064c7f4d0 0x55b065051060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f27f6800640 1 -- 172.21.15.84:0/256999552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b064d0b790 con 0x55b064ca01b0 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f27f6800640 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064ca01b0 0x55b065051bd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f27f0011d20 tx=0x7f27f0005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4907d80c20062c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f27d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f27d7e00640 1 -- 172.21.15.84:0/256999552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0024040 con 0x55b064ca01b0 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f27d7e00640 1 -- 172.21.15.84:0/256999552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f27f0004a40 con 0x55b064ca01b0 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f280421c740 1 -- 172.21.15.84:0/256999552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f0011dd0 con 0x55b064ca01b0 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f27d7e00640 1 -- 172.21.15.84:0/256999552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f27f0031050 con 0x55b064ca01b0 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f280421c740 10 client.15441 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.826+0000 7f280421c740 1 -- 172.21.15.84:0/256999552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b064d84620 con 0x55b064ca01b0 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f27d7e00640 1 -- 172.21.15.84:0/256999552 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27f0011dd0 con 0x55b064ca01b0 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f27d7e00640 1 -- 172.21.15.84:0/256999552 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f27f000e3c0 con 0x55b064ca01b0 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f280421c740 10 client.15441 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f280421c740 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f280421c740 20 client.15441 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f280421c740 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55b064c5ed80 0x55b06505de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f280421c740 4 client.15441 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f280421c740 1 -- 172.21.15.84:0/256999552 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b064fbc600 con 0x55b064c5ed80 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.827+0000 7f27f5400640 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55b064c5ed80 0x55b06505de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.828+0000 7f27f5400640 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55b064c5ed80 0x55b06505de70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5211835ab226e server_cookie=e16591cda0fc073d in_seq=0 out_seq=0 2024-09-21T02:43:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.828+0000 7f27d7e00640 10 client.15441 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f27d7e00640 1 -- 172.21.15.84:0/256999552 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b064fbc600 con 0x55b064c5ed80 2024-09-21T02:43:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f27d7e00640 10 client.15441 handle_command_reply: tid=0 2024-09-21T02:43:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 client.15441 shutdown 2024-09-21T02:43:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 -- 172.21.15.84:0/256999552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064ca01b0 msgr2=0x55b065051bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064ca01b0 0x55b065051bd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f27f0011d20 tx=0x7f27f0005c60 comp rx=0 tx=0).stop 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 -- 172.21.15.84:0/256999552 shutdown_connections 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55b064c5ed80 0x55b06505de70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064ca01b0 0x55b065051bd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064c7f4d0 0x55b065051060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f27d7e00640 0 client.15441 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 --2- 172.21.15.84:0/256999552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 0x55b0650509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 -- 172.21.15.84:0/256999552 >> 172.21.15.84:0/256999552 conn(0x55b064c94300 msgr2=0x55b065041360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 -- 172.21.15.84:0/256999552 shutdown_connections 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.829+0000 7f280421c740 1 -- 172.21.15.84:0/256999552 wait complete. 2024-09-21T02:43:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.830+0000 7f280421c740 20 client.15441 trim_cache size 0 max 16384 2024-09-21T02:43:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.844+0000 7f280421c740 1 Processor -- start 2024-09-21T02:43:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f280421c740 1 -- start start 2024-09-21T02:43:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f280421c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b06504f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f280421c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 0x55b06504b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f280421c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b06504b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f280421c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27f81b1160 con 0x55b064c772f0 2024-09-21T02:43:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f280421c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27f81aea30 con 0x55b064ca01b0 2024-09-21T02:43:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f280421c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27f81ac880 con 0x55b064c7f4d0 2024-09-21T02:43:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f27f6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b06504f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f27f6800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b06504f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41828/0 (socket says 172.21.15.84:41828) 2024-09-21T02:43:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f27f6800640 1 -- 172.21.15.84:0/1534301242 learned_addr learned my addr 172.21.15.84:0/1534301242 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f27f5400640 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 0x55b06504b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.845+0000 7f27f6800640 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b06504b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27f6800640 1 -- 172.21.15.84:0/1534301242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 msgr2=0x55b06504b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27f6800640 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 0x55b06504b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27f6800640 1 -- 172.21.15.84:0/1534301242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 msgr2=0x55b06504b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27f6800640 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b06504b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27f6800640 1 -- 172.21.15.84:0/1534301242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b065050e00 con 0x55b064c772f0 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27f6800640 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b06504f5c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f27f00118f0 tx=0x7f27f0009aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f0e17ff306030e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27e2a00640 1 -- 172.21.15.84:0/1534301242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f000ede0 con 0x55b064c772f0 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27e2a00640 1 -- 172.21.15.84:0/1534301242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27f0010de0 con 0x55b064c772f0 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.846+0000 7f27e2a00640 1 -- 172.21.15.84:0/1534301242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f001b510 con 0x55b064c772f0 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 -- 172.21.15.84:0/1534301242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 msgr2=0x55b06504f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b06504f5c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f27f00118f0 tx=0x7f27f0009aa0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 -- 172.21.15.84:0/1534301242 shutdown_connections 2024-09-21T02:43:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c7f4d0 0x55b06504b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b06504b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 --2- 172.21.15.84:0/1534301242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c772f0 0x55b06504f5c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 -- 172.21.15.84:0/1534301242 >> 172.21.15.84:0/1534301242 conn(0x55b064c94300 msgr2=0x55b06504eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 -- 172.21.15.84:0/1534301242 shutdown_connections 2024-09-21T02:43:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.847+0000 7f280421c740 1 -- 172.21.15.84:0/1534301242 wait complete. 2024-09-21T02:43:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 1 -- start start 2024-09-21T02:43:05.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 1 Processor -- start 2024-09-21T02:43:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 0x55b065057f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c7f4d0 0x55b065056c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b065057190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27f81acef0 con 0x55b064c7f4d0 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f27f81ae360 con 0x55b064ca01b0 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27f81ad5c0 con 0x55b064c772f0 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f280421c740 10 client.0 _ll_register_callbacks cb 0x7f27e8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f27f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c7f4d0 0x55b065056c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f27f5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c7f4d0 0x55b065056c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41834/0 (socket says 172.21.15.84:41834) 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f27f5400640 1 -- 172.21.15.84:0/3709080368 learned_addr learned my addr 172.21.15.84:0/3709080368 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.848+0000 7f27f6800640 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 0x55b065057f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27f6800640 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b065057190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27f5400640 1 -- 172.21.15.84:0/3709080368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 msgr2=0x55b065057f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27f5400640 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 0x55b065057f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27f5400640 1 -- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 msgr2=0x55b065057190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27f5400640 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b065057190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27f5400640 1 -- 172.21.15.84:0/3709080368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0650576d0 con 0x55b064c7f4d0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27f6800640 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b065057190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27f5400640 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c7f4d0 0x55b065056c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27e40096c0 tx=0x7f27e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe2a0de47d729bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27d7e00640 1 -- 172.21.15.84:0/3709080368 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4035040 con 0x55b064c7f4d0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f27d7e00640 1 -- 172.21.15.84:0/3709080368 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f27e4005450 con 0x55b064c7f4d0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.849+0000 7f280421c740 1 -- 172.21.15.84:0/3709080368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f0010de0 con 0x55b064c7f4d0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f27d7e00640 1 -- 172.21.15.84:0/3709080368 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f27e4005650 con 0x55b064c7f4d0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f280421c740 10 client.15447 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f280421c740 1 -- 172.21.15.84:0/3709080368 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b065056550 con 0x55b064c7f4d0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f27d7e00640 1 -- 172.21.15.84:0/3709080368 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27f0010de0 con 0x55b064c7f4d0 2024-09-21T02:43:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f27d7e00640 1 -- 172.21.15.84:0/3709080368 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f27e4031af0 con 0x55b064c7f4d0 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f280421c740 10 client.15447 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f280421c740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f280421c740 20 client.15447 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f280421c740 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55b064c341c0 0x55b0650cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f280421c740 4 client.15447 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f280421c740 1 -- 172.21.15.84:0/3709080368 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b064fb80b0 con 0x55b064c341c0 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.850+0000 7f27f6800640 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55b064c341c0 0x55b0650cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.851+0000 7f27f6800640 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55b064c341c0 0x55b0650cafa0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf2840a75abb3830 server_cookie=d536fcc8c543584c in_seq=0 out_seq=0 2024-09-21T02:43:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.851+0000 7f27d7e00640 10 client.15447 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f27d7e00640 1 -- 172.21.15.84:0/3709080368 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b064fb80b0 con 0x55b064c341c0 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f27d7e00640 10 client.15447 handle_command_reply: tid=0 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 client.15447 shutdown 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 -- 172.21.15.84:0/3709080368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c7f4d0 msgr2=0x55b065056c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c7f4d0 0x55b065056c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27e40096c0 tx=0x7f27e4000bc0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 -- 172.21.15.84:0/3709080368 shutdown_connections 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55b064c341c0 0x55b0650cafa0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55b064ca01b0 0x55b065057190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b064c7f4d0 0x55b065056c50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 --2- 172.21.15.84:0/3709080368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b064c772f0 0x55b065057f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f27d7e00640 0 client.15447 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.859+0000 7f280421c740 1 -- 172.21.15.84:0/3709080368 >> 172.21.15.84:0/3709080368 conn(0x55b064c94300 msgr2=0x55b06504ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f280421c740 1 -- 172.21.15.84:0/3709080368 shutdown_connections 2024-09-21T02:43:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f280421c740 1 -- 172.21.15.84:0/3709080368 wait complete. 2024-09-21T02:43:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f280421c740 20 client.15447 trim_cache size 0 max 16384 2024-09-21T02:43:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:43:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:43:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:43:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 -- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f27dc0b65a0 msgr2=0x7f27dc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f27dc0b65a0 0x7f27dc0b8ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f27e80ada20 tx=0x7f27e80e80b0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 -- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f81034f0 msgr2=0x7f27f819c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f81034f0 0x7f27f819c080 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f27e800e9f0 tx=0x7f27e800edf0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 -- 172.21.15.84:0/1054652418 shutdown_connections 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f27dc0b65a0 0x7f27dc0b8ab0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27f8104570 0x7f27f819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27f8104f10 0x7f27f819d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 --2- 172.21.15.84:0/1054652418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27f81034f0 0x7f27f819c080 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.860+0000 7f27f7200640 1 -- 172.21.15.84:0/1054652418 >> 172.21.15.84:0/1054652418 conn(0x7f27f80fee30 msgr2=0x7f27f80755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.861+0000 7f27f7200640 1 -- 172.21.15.84:0/1054652418 shutdown_connections 2024-09-21T02:43:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:05.861+0000 7f27f7200640 1 -- 172.21.15.84:0/1054652418 wait complete. 2024-09-21T02:43:06.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:05 smithi172 ceph-mon[35067]: pgmap v420: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:06.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:05 smithi084 ceph-mon[30747]: pgmap v420: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:06.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:05 smithi090 ceph-mon[34571]: pgmap v420: 129 pgs: 129 active+clean; 667 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T02:43:08.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:07 smithi172 ceph-mon[35067]: pgmap v421: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T02:43:08.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:07 smithi084 ceph-mon[30747]: pgmap v421: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T02:43:08.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:07 smithi090 ceph-mon[34571]: pgmap v421: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-21T02:43:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:09 smithi172 ceph-mon[35067]: pgmap v422: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T02:43:10.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:09 smithi084 ceph-mon[30747]: pgmap v422: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T02:43:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:09 smithi090 ceph-mon[34571]: pgmap v422: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T02:43:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:11 smithi172 ceph-mon[35067]: pgmap v423: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T02:43:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:11 smithi084 ceph-mon[30747]: pgmap v423: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T02:43:12.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:11 smithi090 ceph-mon[34571]: pgmap v423: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T02:43:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:13 smithi172 ceph-mon[35067]: pgmap v424: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:14.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:13 smithi084 ceph-mon[30747]: pgmap v424: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:14.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:13 smithi090 ceph-mon[34571]: pgmap v424: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:15 smithi172 ceph-mon[35067]: pgmap v425: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:15 smithi084 ceph-mon[30747]: pgmap v425: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:15 smithi090 ceph-mon[34571]: pgmap v425: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:17.026 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T02:43:17.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:43:17.420 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:17.829 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:17 smithi084 ceph-mon[30747]: pgmap v426: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T02:43:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:17 smithi172 ceph-mon[35067]: pgmap v426: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T02:43:18.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:17 smithi090 ceph-mon[34571]: pgmap v426: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-21T02:43:18.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.166+0000 7f2df4e00640 1 -- 172.21.15.84:0/2441535651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2df01092f0 msgr2=0x7f2df0109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.166+0000 7f2df4e00640 1 --2- 172.21.15.84:0/2441535651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2df01092f0 0x7f2df0109700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009900 tx=0x7f2ddc02a410 comp rx=0 tx=0).stop 2024-09-21T02:43:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.167+0000 7f2df4e00640 1 -- 172.21.15.84:0/2441535651 shutdown_connections 2024-09-21T02:43:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.167+0000 7f2df4e00640 1 --2- 172.21.15.84:0/2441535651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2df0109c40 0x7f2df0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.167+0000 7f2df4e00640 1 --2- 172.21.15.84:0/2441535651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2df01092f0 0x7f2df0109700 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.167+0000 7f2df4e00640 1 --2- 172.21.15.84:0/2441535651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df01039b0 0x7f2df0103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.167+0000 7f2df4e00640 1 -- 172.21.15.84:0/2441535651 >> 172.21.15.84:0/2441535651 conn(0x7f2df00ff440 msgr2=0x7f2df0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.167+0000 7f2df4e00640 1 -- 172.21.15.84:0/2441535651 shutdown_connections 2024-09-21T02:43:18.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.167+0000 7f2df4e00640 1 -- 172.21.15.84:0/2441535651 wait complete. 2024-09-21T02:43:18.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.168+0000 7f2df4e00640 1 Processor -- start 2024-09-21T02:43:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.168+0000 7f2df4e00640 1 -- start start 2024-09-21T02:43:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2df4e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2df01039b0 0x7f2df019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2df4e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2df01092f0 0x7f2df019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2df4e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0109c40 0x7f2df01a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2df4e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2df0113a70 con 0x7f2df01039b0 2024-09-21T02:43:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2df4e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01138f0 con 0x7f2df01092f0 2024-09-21T02:43:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2df4e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2df0113bf0 con 0x7f2df0109c40 2024-09-21T02:43:18.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2deea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2df01092f0 0x7f2df019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2def400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2df01039b0 0x7f2df019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2deea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2df01092f0 0x7f2df019cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:37058/0 (socket says 172.21.15.84:37058) 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2deea00640 1 -- 172.21.15.84:0/3534845469 learned_addr learned my addr 172.21.15.84:0/3534845469 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2defe00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0109c40 0x7f2df01a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2deea00640 1 -- 172.21.15.84:0/3534845469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0109c40 msgr2=0x7f2df01a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2deea00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0109c40 0x7f2df01a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2deea00640 1 -- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2df01039b0 msgr2=0x7f2df019c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2deea00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2df01039b0 0x7f2df019c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.169+0000 7f2deea00640 1 -- 172.21.15.84:0/3534845469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df01a2570 con 0x7f2df01092f0 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.170+0000 7f2defe00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0109c40 0x7f2df01a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:18.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.170+0000 7f2deea00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2df01092f0 0x7f2df019cba0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc004770 tx=0x7f2ddc003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.170+0000 7f2de7e00640 1 -- 172.21.15.84:0/3534845469 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc03f070 con 0x7f2df01092f0 2024-09-21T02:43:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.170+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df01a2800 con 0x7f2df01092f0 2024-09-21T02:43:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.170+0000 7f2de7e00640 1 -- 172.21.15.84:0/3534845469 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ddc031be0 con 0x7f2df01092f0 2024-09-21T02:43:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.170+0000 7f2de7e00640 1 -- 172.21.15.84:0/3534845469 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc035030 con 0x7f2df01092f0 2024-09-21T02:43:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.170+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df01a8fc0 con 0x7f2df01092f0 2024-09-21T02:43:18.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.172+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df0103dc0 con 0x7f2df01092f0 2024-09-21T02:43:18.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.175+0000 7f2de7e00640 1 -- 172.21.15.84:0/3534845469 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f2ddc042070 con 0x7f2df01092f0 2024-09-21T02:43:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.176+0000 7f2de7e00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2dd40b65a0 0x7f2dd40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.176+0000 7f2de7e00640 1 -- 172.21.15.84:0/3534845469 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f2ddc1086e0 con 0x7f2df01092f0 2024-09-21T02:43:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.176+0000 7f2def400640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2dd40b65a0 0x7f2dd40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.177+0000 7f2def400640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2dd40b65a0 0x7f2dd40b8ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2de000bbe0 tx=0x7f2de000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:18.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.178+0000 7f2de7e00640 1 -- 172.21.15.84:0/3534845469 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ddc0cea20 con 0x7f2df01092f0 2024-09-21T02:43:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.434+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2df01a9190 con 0x7f2df01092f0 2024-09-21T02:43:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.435+0000 7f2de7e00640 1 -- 172.21.15.84:0/3534845469 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7f2ddc0d2e00 con 0x7f2df01092f0 2024-09-21T02:43:18.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:43:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-09-21T02:43:18.437 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"btime":"2024-09-21T02:42:38:701523+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:42:38.113687+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24679,24703,24704]},"id":1}]} 2024-09-21T02:43:18.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2dd40b65a0 msgr2=0x7f2dd40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:18.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2dd40b65a0 0x7f2dd40b8ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2de000bbe0 tx=0x7f2de000b390 comp rx=0 tx=0).stop 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2df01092f0 msgr2=0x7f2df019cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2df01092f0 0x7f2df019cba0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc004770 tx=0x7f2ddc003bb0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 shutdown_connections 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2dd40b65a0 0x7f2dd40b8ab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2df0109c40 0x7f2df01a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2df01092f0 0x7f2df019cba0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 --2- 172.21.15.84:0/3534845469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2df01039b0 0x7f2df019c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 >> 172.21.15.84:0/3534845469 conn(0x7f2df00ff440 msgr2=0x7f2df0108910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 shutdown_connections 2024-09-21T02:43:18.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:18.438+0000 7f2df4e00640 1 -- 172.21.15.84:0/3534845469 wait complete. 2024-09-21T02:43:19.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:18 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3534845469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:19.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:18 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3534845469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:19.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:18 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3534845469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 -- 172.21.15.84:0/1253975020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074104720 msgr2=0x7f3074104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 --2- 172.21.15.84:0/1253975020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074104720 0x7f3074104b30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3060009900 tx=0x7f306002a410 comp rx=0 tx=0).stop 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 -- 172.21.15.84:0/1253975020 shutdown_connections 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 --2- 172.21.15.84:0/1253975020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30741050c0 0x7f307410ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 --2- 172.21.15.84:0/1253975020 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3074104720 0x7f3074104b30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 --2- 172.21.15.84:0/1253975020 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30741036a0 0x7f3074103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 -- 172.21.15.84:0/1253975020 >> 172.21.15.84:0/1253975020 conn(0x7f30740fefe0 msgr2=0x7f3074101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 -- 172.21.15.84:0/1253975020 shutdown_connections 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.067+0000 7f3078c00640 1 -- 172.21.15.84:0/1253975020 wait complete. 2024-09-21T02:43:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.069+0000 7f3078c00640 1 Processor -- start 2024-09-21T02:43:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.069+0000 7f3078c00640 1 -- start start 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.069+0000 7f3078c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30741036a0 0x7f307419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.069+0000 7f3078c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3074104720 0x7f307419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.069+0000 7f3078c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30741050c0 0x7f307419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.069+0000 7f3078c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f307410f440 con 0x7f30741050c0 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.069+0000 7f3078c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f307410f2c0 con 0x7f30741036a0 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.069+0000 7f3078c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f307410f5c0 con 0x7f3074104720 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30741050c0 0x7f307419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30741050c0 0x7f307419b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53444/0 (socket says 172.21.15.84:53444) 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 -- 172.21.15.84:0/1026478510 learned_addr learned my addr 172.21.15.84:0/1026478510 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3071e00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30741036a0 0x7f307419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3071400640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3074104720 0x7f307419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 -- 172.21.15.84:0/1026478510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3074104720 msgr2=0x7f307419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3074104720 0x7f307419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 -- 172.21.15.84:0/1026478510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30741036a0 msgr2=0x7f307419a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30741036a0 0x7f307419a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 -- 172.21.15.84:0/1026478510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307419ba70 con 0x7f30741050c0 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3071e00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30741036a0 0x7f307419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.070+0000 7f3072800640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30741050c0 0x7f307419b250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f306c00efd0 tx=0x7f306c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.071+0000 7f306aa00640 1 -- 172.21.15.84:0/1026478510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c003b70 con 0x7f30741050c0 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.071+0000 7f306aa00640 1 -- 172.21.15.84:0/1026478510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f306c003d10 con 0x7f30741050c0 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.071+0000 7f3078c00640 1 -- 172.21.15.84:0/1026478510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307419bd60 con 0x7f30741050c0 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.071+0000 7f306aa00640 1 -- 172.21.15.84:0/1026478510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c010990 con 0x7f30741050c0 2024-09-21T02:43:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.071+0000 7f3078c00640 1 -- 172.21.15.84:0/1026478510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30741a2450 con 0x7f30741050c0 2024-09-21T02:43:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.075+0000 7f307fc18740 1 Processor -- start 2024-09-21T02:43:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.075+0000 7f306aa00640 1 -- 172.21.15.84:0/1026478510 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f306c010b30 con 0x7f30741050c0 2024-09-21T02:43:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f307fc18740 1 -- start start 2024-09-21T02:43:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f307fc18740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 0x55937701f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f307fc18740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c4b2f0 0x55937701fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f307fc18740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c534d0 0x5593770206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f307fc18740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559376f8e6b0 con 0x559376c534d0 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f307fc18740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559376f7dae0 con 0x559376c741b0 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f307fc18740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559376f818f0 con 0x559376c4b2f0 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f3071e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c4b2f0 0x55937701fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f3071e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c4b2f0 0x55937701fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:59050/0 (socket says 172.21.15.84:59050) 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f3071e00640 1 -- 172.21.15.84:0/3018702432 learned_addr learned my addr 172.21.15.84:0/3018702432 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.076+0000 7f3071400640 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 0x55937701f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f3071400640 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c534d0 0x5593770206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f3071e00640 1 -- 172.21.15.84:0/3018702432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 msgr2=0x55937701f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f3071e00640 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 0x55937701f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f3071e00640 1 -- 172.21.15.84:0/3018702432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c534d0 msgr2=0x5593770206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f3071e00640 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c534d0 0x5593770206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f3071e00640 1 -- 172.21.15.84:0/3018702432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559376f4a780 con 0x559376c4b2f0 2024-09-21T02:43:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f3071e00640 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c4b2f0 0x55937701fb50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3064011540 tx=0x7f3064011a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95087b3eeb8741a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f306aa00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f30580b65a0 0x7f30580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.077+0000 7f305f000640 1 -- 172.21.15.84:0/3018702432 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306400f640 con 0x559376c4b2f0 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.078+0000 7f305f000640 1 -- 172.21.15.84:0/3018702432 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f306400fcb0 con 0x559376c4b2f0 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.078+0000 7f305f000640 1 -- 172.21.15.84:0/3018702432 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064019d10 con 0x559376c4b2f0 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.078+0000 7f306aa00640 1 -- 172.21.15.84:0/1026478510 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f306c0e7ca0 con 0x7f30741050c0 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.078+0000 7f3071400640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f30580b65a0 0x7f30580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 -- 172.21.15.84:0/3018702432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c4b2f0 msgr2=0x55937701fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f3071400640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f30580b65a0 0x7f30580b8ab0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3060000c00 tx=0x7f306002a410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c4b2f0 0x55937701fb50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3064011540 tx=0x7f3064011a00 comp rx=0 tx=0).stop 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 -- 172.21.15.84:0/3018702432 shutdown_connections 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c4b2f0 0x55937701fb50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c534d0 0x5593770206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 --2- 172.21.15.84:0/3018702432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 0x55937701f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 -- 172.21.15.84:0/3018702432 >> 172.21.15.84:0/3018702432 conn(0x559376c68300 msgr2=0x559377016b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 -- 172.21.15.84:0/3018702432 shutdown_connections 2024-09-21T02:43:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 -- 172.21.15.84:0/3018702432 wait complete. 2024-09-21T02:43:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.079+0000 7f307fc18740 1 -- start start 2024-09-21T02:43:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.080+0000 7f307fc18740 1 Processor -- start 2024-09-21T02:43:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.080+0000 7f307fc18740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x559377028b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.080+0000 7f307fc18740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 0x559377029240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.080+0000 7f307fc18740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 0x559377029db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.080+0000 7f307fc18740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559376eb5ab0 con 0x559376c4b2f0 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.080+0000 7f307fc18740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559376f24570 con 0x559376c741b0 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.080+0000 7f307fc18740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5593770211c0 con 0x559376c534d0 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.080+0000 7f307fc18740 10 client.0 _ll_register_callbacks cb 0x559376f33100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x559377028b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 0x559377029240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x559377028b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53466/0 (socket says 172.21.15.84:53466) 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 -- 172.21.15.84:0/3072258486 learned_addr learned my addr 172.21.15.84:0/3072258486 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3072800640 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 0x559377029db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 -- 172.21.15.84:0/3072258486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 msgr2=0x559377029240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 0x559377029240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 -- 172.21.15.84:0/3072258486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 msgr2=0x559377029db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 0x559377029db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 -- 172.21.15.84:0/3072258486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559376cdf790 con 0x559376c4b2f0 2024-09-21T02:43:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3071e00640 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x559377028b80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3064009350 tx=0x7f3064009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9688213f2c99756 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.081+0000 7f3053400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:43:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.082+0000 7f3053400640 1 -- 172.21.15.84:0/3072258486 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064026020 con 0x559376c4b2f0 2024-09-21T02:43:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.082+0000 7f3053400640 1 -- 172.21.15.84:0/3072258486 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f306400f850 con 0x559376c4b2f0 2024-09-21T02:43:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.082+0000 7f307fc18740 1 -- 172.21.15.84:0/3072258486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f306400fcb0 con 0x559376c4b2f0 2024-09-21T02:43:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.082+0000 7f3053400640 1 -- 172.21.15.84:0/3072258486 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f306400fa50 con 0x559376c4b2f0 2024-09-21T02:43:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.082+0000 7f307fc18740 10 client.15465 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.082+0000 7f307fc18740 1 -- 172.21.15.84:0/3072258486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559376d58620 con 0x559376c4b2f0 2024-09-21T02:43:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.082+0000 7f3053400640 1 -- 172.21.15.84:0/3072258486 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f306400fcb0 con 0x559376c4b2f0 2024-09-21T02:43:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.083+0000 7f3053400640 1 -- 172.21.15.84:0/3072258486 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3064004b40 con 0x559376c4b2f0 2024-09-21T02:43:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.084+0000 7f307fc18740 10 client.15465 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.084+0000 7f307fc18740 10 client.15465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.084+0000 7f307fc18740 20 client.15465 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.084+0000 7f307fc18740 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559376c32d80 0x5593770361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.084+0000 7f307fc18740 4 client.15465 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.084+0000 7f307fc18740 1 -- 172.21.15.84:0/3072258486 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559376f90600 con 0x559376c32d80 2024-09-21T02:43:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.084+0000 7f3071400640 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559376c32d80 0x5593770361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.085+0000 7f3071400640 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559376c32d80 0x5593770361a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0a7301cbdf5d3d7 server_cookie=a1a9a99f0cda17fa in_seq=0 out_seq=0 2024-09-21T02:43:19.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.085+0000 7f3053400640 10 client.15465 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.085+0000 7f3053400640 1 -- 172.21.15.84:0/3072258486 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559376f90600 con 0x559376c32d80 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.085+0000 7f3053400640 10 client.15465 handle_command_reply: tid=0 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 client.15465 shutdown 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 -- 172.21.15.84:0/3072258486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 msgr2=0x559377028b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x559377028b80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3064009350 tx=0x7f3064009e60 comp rx=0 tx=0).stop 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 -- 172.21.15.84:0/3072258486 shutdown_connections 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 0x559377029240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559376c32d80 0x5593770361a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c741b0 0x559377029db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 --2- 172.21.15.84:0/3072258486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x559377028b80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 -- 172.21.15.84:0/3072258486 >> 172.21.15.84:0/3072258486 conn(0x559376c68300 msgr2=0x5593770150e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f3053400640 0 client.15465 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 -- 172.21.15.84:0/3072258486 shutdown_connections 2024-09-21T02:43:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 1 -- 172.21.15.84:0/3072258486 wait complete. 2024-09-21T02:43:19.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.086+0000 7f307fc18740 20 client.15465 trim_cache size 0 max 16384 2024-09-21T02:43:19.105 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.103+0000 7f307fc18740 1 Processor -- start 2024-09-21T02:43:19.105 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.103+0000 7f307fc18740 1 -- start start 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.103+0000 7f307fc18740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c4b2f0 0x559377027090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.103+0000 7f307fc18740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 0x559377030c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f307fc18740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c741b0 0x5593770275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f307fc18740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f30741acdd0 con 0x559376c741b0 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f307fc18740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30741aa6a0 con 0x559376c4b2f0 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f307fc18740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30741a84f0 con 0x559376c534d0 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3072800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c741b0 0x5593770275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3072800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c741b0 0x5593770275d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53482/0 (socket says 172.21.15.84:53482) 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3072800640 1 -- 172.21.15.84:0/1865726147 learned_addr learned my addr 172.21.15.84:0/1865726147 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3071e00640 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c4b2f0 0x559377027090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3071400640 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 0x559377030c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3072800640 1 -- 172.21.15.84:0/1865726147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 msgr2=0x559377030c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3072800640 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 0x559377030c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3072800640 1 -- 172.21.15.84:0/1865726147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c4b2f0 msgr2=0x559377027090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3072800640 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c4b2f0 0x559377027090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.104+0000 7f3072800640 1 -- 172.21.15.84:0/1865726147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559377026d10 con 0x559376c741b0 2024-09-21T02:43:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.105+0000 7f3072800640 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c741b0 0x5593770275d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f306c00cba0 tx=0x7f306c0ad350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7565db500ead15ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.105+0000 7f305e600640 1 -- 172.21.15.84:0/1865726147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c097020 con 0x559376c741b0 2024-09-21T02:43:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.105+0000 7f305e600640 1 -- 172.21.15.84:0/1865726147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f306c0b2070 con 0x559376c741b0 2024-09-21T02:43:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.105+0000 7f305e600640 1 -- 172.21.15.84:0/1865726147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c0b7360 con 0x559376c741b0 2024-09-21T02:43:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 -- 172.21.15.84:0/1865726147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c741b0 msgr2=0x5593770275d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c741b0 0x5593770275d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f306c00cba0 tx=0x7f306c0ad350 comp rx=0 tx=0).stop 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 -- 172.21.15.84:0/1865726147 shutdown_connections 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c534d0 0x559377030c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c741b0 0x5593770275d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 --2- 172.21.15.84:0/1865726147 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c4b2f0 0x559377027090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 -- 172.21.15.84:0/1865726147 >> 172.21.15.84:0/1865726147 conn(0x559376c68300 msgr2=0x5593770286e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 -- 172.21.15.84:0/1865726147 shutdown_connections 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.106+0000 7f307fc18740 1 -- 172.21.15.84:0/1865726147 wait complete. 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.107+0000 7f307fc18740 1 -- start start 2024-09-21T02:43:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.107+0000 7f307fc18740 1 Processor -- start 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.107+0000 7f307fc18740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x55937702dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.107+0000 7f307fc18740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c534d0 0x55937702e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.107+0000 7f307fc18740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c741b0 0x55937702ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.107+0000 7f307fc18740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f30741a8b60 con 0x559376c4b2f0 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.107+0000 7f307fc18740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30741a9fd0 con 0x559376c534d0 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.107+0000 7f307fc18740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30741a9230 con 0x559376c741b0 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f307fc18740 10 client.0 _ll_register_callbacks cb 0x7f3064011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x55937702dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x55937702dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53488/0 (socket says 172.21.15.84:53488) 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 -- 172.21.15.84:0/4027776753 learned_addr learned my addr 172.21.15.84:0/4027776753 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071400640 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c534d0 0x55937702e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3072800640 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c741b0 0x55937702ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 -- 172.21.15.84:0/4027776753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c741b0 msgr2=0x55937702ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c741b0 0x55937702ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 -- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c534d0 msgr2=0x55937702e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c534d0 0x55937702e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 -- 172.21.15.84:0/4027776753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55937702f690 con 0x559376c4b2f0 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071400640 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c534d0 0x55937702e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3071e00640 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x55937702dde0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3064004f40 tx=0x7f3064005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fee528f6f3f814 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.108+0000 7f3053400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.109+0000 7f3053400640 1 -- 172.21.15.84:0/4027776753 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064038070 con 0x559376c4b2f0 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.109+0000 7f3053400640 1 -- 172.21.15.84:0/4027776753 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f3064022c30 con 0x559376c4b2f0 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.109+0000 7f307fc18740 1 -- 172.21.15.84:0/4027776753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f306c0b2070 con 0x559376c4b2f0 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.109+0000 7f3053400640 1 -- 172.21.15.84:0/4027776753 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3064026070 con 0x559376c4b2f0 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.109+0000 7f307fc18740 10 client.15471 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.109+0000 7f307fc18740 1 -- 172.21.15.84:0/4027776753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559377030980 con 0x559376c4b2f0 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.109+0000 7f3053400640 1 -- 172.21.15.84:0/4027776753 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f306c0b2070 con 0x559376c4b2f0 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.109+0000 7f3053400640 1 -- 172.21.15.84:0/4027776753 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f306403b020 con 0x559376c4b2f0 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f307fc18740 10 client.15471 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f307fc18740 10 client.15471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f307fc18740 20 client.15471 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f307fc18740 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559376c081c0 0x5593770a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f307fc18740 4 client.15471 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f307fc18740 1 -- 172.21.15.84:0/4027776753 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559376f8c0b0 con 0x559376c081c0 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f3071400640 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559376c081c0 0x5593770a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f3053400640 10 client.15471 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.110+0000 7f3071400640 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559376c081c0 0x5593770a2d40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51429821111a367d server_cookie=babf96978573db0a in_seq=0 out_seq=0 2024-09-21T02:43:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f3053400640 1 -- 172.21.15.84:0/4027776753 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559376f8c0b0 con 0x559376c081c0 2024-09-21T02:43:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f3053400640 10 client.15471 handle_command_reply: tid=0 2024-09-21T02:43:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 client.15471 shutdown 2024-09-21T02:43:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 -- 172.21.15.84:0/4027776753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 msgr2=0x55937702dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x55937702dde0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3064004f40 tx=0x7f3064005dc0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 -- 172.21.15.84:0/4027776753 shutdown_connections 2024-09-21T02:43:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559376c741b0 0x55937702ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559376c081c0 0x5593770a2d40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559376c534d0 0x55937702e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 --2- 172.21.15.84:0/4027776753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559376c4b2f0 0x55937702dde0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f3053400640 0 client.15471 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.116+0000 7f307fc18740 1 -- 172.21.15.84:0/4027776753 >> 172.21.15.84:0/4027776753 conn(0x559376c68300 msgr2=0x559377026f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.117+0000 7f307fc18740 1 -- 172.21.15.84:0/4027776753 shutdown_connections 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.117+0000 7f307fc18740 1 -- 172.21.15.84:0/4027776753 wait complete. 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.117+0000 7f307fc18740 20 client.15471 trim_cache size 0 max 16384 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:43:19.119 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:43:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.117+0000 7f3078c00640 1 -- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f30580b65a0 msgr2=0x7f30580b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.117+0000 7f3078c00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f30580b65a0 0x7f30580b8ab0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3060000c00 tx=0x7f306002a410 comp rx=0 tx=0).stop 2024-09-21T02:43:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.117+0000 7f3078c00640 1 -- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30741050c0 msgr2=0x7f307419b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.117+0000 7f3078c00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30741050c0 0x7f307419b250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f306c00efd0 tx=0x7f306c00c6a0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.118+0000 7f3078c00640 1 -- 172.21.15.84:0/1026478510 shutdown_connections 2024-09-21T02:43:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.118+0000 7f3078c00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f30580b65a0 0x7f30580b8ab0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.118+0000 7f3078c00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3074104720 0x7f307419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.118+0000 7f3078c00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30741050c0 0x7f307419b250 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.118+0000 7f3078c00640 1 --2- 172.21.15.84:0/1026478510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30741036a0 0x7f307419a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.118+0000 7f3078c00640 1 -- 172.21.15.84:0/1026478510 >> 172.21.15.84:0/1026478510 conn(0x7f30740fefe0 msgr2=0x7f3074107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.118+0000 7f3078c00640 1 -- 172.21.15.84:0/1026478510 shutdown_connections 2024-09-21T02:43:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:19.118+0000 7f3078c00640 1 -- 172.21.15.84:0/1026478510 wait complete. 2024-09-21T02:43:19.230 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T02:43:19.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T02:43:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:19.979 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:19 smithi084 ceph-mon[30747]: pgmap v427: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:19 smithi172 ceph-mon[35067]: pgmap v427: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:20.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:19 smithi090 ceph-mon[34571]: pgmap v427: 129 pgs: 129 active+clean; 668 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T02:43:20.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 -- 172.21.15.84:0/2447747593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a901049d0 msgr2=0x7f7a90104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 --2- 172.21.15.84:0/2447747593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a901049d0 0x7f7a90104de0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009900 tx=0x7f7a8002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 -- 172.21.15.84:0/2447747593 shutdown_connections 2024-09-21T02:43:20.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 --2- 172.21.15.84:0/2447747593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a90105400 0x7f7a9010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 --2- 172.21.15.84:0/2447747593 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a9010df10 0x7f7a90110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 --2- 172.21.15.84:0/2447747593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a901049d0 0x7f7a90104de0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 -- 172.21.15.84:0/2447747593 >> 172.21.15.84:0/2447747593 conn(0x7f7a90079720 msgr2=0x7f7a90079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:20.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 -- 172.21.15.84:0/2447747593 shutdown_connections 2024-09-21T02:43:20.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.295+0000 7f7a96a00640 1 -- 172.21.15.84:0/2447747593 wait complete. 2024-09-21T02:43:20.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.297+0000 7f7a96a00640 1 Processor -- start 2024-09-21T02:43:20.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.297+0000 7f7a96a00640 1 -- start start 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.297+0000 7f7a96a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a901049d0 0x7f7a90102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.297+0000 7f7a96a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90105400 0x7f7a90102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.297+0000 7f7a96a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a9010df10 0x7f7a90103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.297+0000 7f7a96a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7a90113d00 con 0x7f7a9010df10 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.297+0000 7f7a96a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a90113b80 con 0x7f7a90105400 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.297+0000 7f7a96a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a90113e80 con 0x7f7a901049d0 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90105400 0x7f7a90102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a901049d0 0x7f7a90102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90105400 0x7f7a90102c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:37106/0 (socket says 172.21.15.84:37106) 2024-09-21T02:43:20.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a901049d0 0x7f7a90102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:59062/0 (socket says 172.21.15.84:59062) 2024-09-21T02:43:20.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8f400640 1 -- 172.21.15.84:0/1660659575 learned_addr learned my addr 172.21.15.84:0/1660659575 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:20.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a94a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a9010df10 0x7f7a90103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8f400640 1 -- 172.21.15.84:0/1660659575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a901049d0 msgr2=0x7f7a90102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8f400640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a901049d0 0x7f7a90102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8f400640 1 -- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a9010df10 msgr2=0x7f7a90103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8f400640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a9010df10 0x7f7a90103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.298+0000 7f7a8f400640 1 -- 172.21.15.84:0/1660659575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a901a8930 con 0x7f7a90105400 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.299+0000 7f7a8f400640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90105400 0x7f7a90102c50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00e9c0 tx=0x7f7a7c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.299+0000 7f7a8cc00640 1 -- 172.21.15.84:0/1660659575 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c00cd80 con 0x7f7a90105400 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.299+0000 7f7a96a00640 1 -- 172.21.15.84:0/1660659575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a901a8c20 con 0x7f7a90105400 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.299+0000 7f7a8cc00640 1 -- 172.21.15.84:0/1660659575 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a7c0054f0 con 0x7f7a90105400 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.299+0000 7f7a8cc00640 1 -- 172.21.15.84:0/1660659575 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c010690 con 0x7f7a90105400 2024-09-21T02:43:20.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.299+0000 7f7a96a00640 1 -- 172.21.15.84:0/1660659575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a901a91b0 con 0x7f7a90105400 2024-09-21T02:43:20.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.302+0000 7f7a9d675740 1 Processor -- start 2024-09-21T02:43:20.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a9d675740 1 -- start start 2024-09-21T02:43:20.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a8cc00640 1 -- 172.21.15.84:0/1660659575 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f7a7c0046c0 con 0x7f7a90105400 2024-09-21T02:43:20.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 0x5644e3f87350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bb6980 0x5644e3f87890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bbeb60 0x5644e3f87dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a9d675740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5644e3efcca0 con 0x5644e3bbeb60 2024-09-21T02:43:20.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a9d675740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5644e3eec0d0 con 0x5644e3bb6980 2024-09-21T02:43:20.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a9d675740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644e3eefee0 con 0x5644e3bdf840 2024-09-21T02:43:20.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a8fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bb6980 0x5644e3f87890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a8fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bb6980 0x5644e3f87890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:45750/0 (socket says 172.21.15.84:45750) 2024-09-21T02:43:20.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a8fe00640 1 -- 172.21.15.84:0/3659158077 learned_addr learned my addr 172.21.15.84:0/3659158077 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.303+0000 7f7a94a00640 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 0x5644e3f87350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.304+0000 7f7a8f400640 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bbeb60 0x5644e3f87dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.304+0000 7f7a8fe00640 1 -- 172.21.15.84:0/3659158077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 msgr2=0x5644e3f87350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.304+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 0x5644e3f87350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.304+0000 7f7a8fe00640 1 -- 172.21.15.84:0/3659158077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bbeb60 msgr2=0x5644e3f87dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.304+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bbeb60 0x5644e3f87dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.304+0000 7f7a8fe00640 1 -- 172.21.15.84:0/3659158077 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644e3e9e400 con 0x5644e3bb6980 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.304+0000 7f7a8f400640 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bbeb60 0x5644e3f87dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:20.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.304+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bb6980 0x5644e3f87890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009900 tx=0x7f7a80005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81e6ba329e34659 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:20.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.305+0000 7f7a85200640 1 -- 172.21.15.84:0/3659158077 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80040070 con 0x5644e3bb6980 2024-09-21T02:43:20.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.305+0000 7f7a85200640 1 -- 172.21.15.84:0/3659158077 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a80004480 con 0x5644e3bb6980 2024-09-21T02:43:20.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.305+0000 7f7a85200640 1 -- 172.21.15.84:0/3659158077 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80035040 con 0x5644e3bb6980 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.305+0000 7f7a8cc00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7a740b65a0 0x7f7a740b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.305+0000 7f7a8cc00640 1 -- 172.21.15.84:0/1660659575 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f7a7c0e7e30 con 0x7f7a90105400 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.305+0000 7f7a94a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7a740b65a0 0x7f7a740b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 -- 172.21.15.84:0/3659158077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bb6980 msgr2=0x5644e3f87890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bb6980 0x5644e3f87890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009900 tx=0x7f7a80005fd0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 -- 172.21.15.84:0/3659158077 shutdown_connections 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bbeb60 0x5644e3f87dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bb6980 0x5644e3f87890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 --2- 172.21.15.84:0/3659158077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 0x5644e3f87350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 -- 172.21.15.84:0/3659158077 >> 172.21.15.84:0/3659158077 conn(0x5644e3bd3990 msgr2=0x5644e3f85240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 -- 172.21.15.84:0/3659158077 shutdown_connections 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a94a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7a740b65a0 0x7f7a740b8ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7a88005fd0 tx=0x7f7a88009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:20.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.306+0000 7f7a9d675740 1 -- 172.21.15.84:0/3659158077 wait complete. 2024-09-21T02:43:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.307+0000 7f7a9d675740 1 -- start start 2024-09-21T02:43:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.307+0000 7f7a9d675740 1 Processor -- start 2024-09-21T02:43:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bb6980 0x5644e3f929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 0x5644e3f92ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 0x5644e3f9edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a9d675740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5644e3d4d7a0 con 0x5644e3bb6980 2024-09-21T02:43:20.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a9d675740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5644e3e91a10 con 0x5644e3bbeb60 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a9d675740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5644e3f95ad0 con 0x5644e3bdf840 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a9d675740 10 client.0 _ll_register_callbacks cb 0x5644e3ea1be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a8fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bb6980 0x5644e3f929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a8fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bb6980 0x5644e3f929a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56368/0 (socket says 172.21.15.84:56368) 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a8fe00640 1 -- 172.21.15.84:0/2626227681 learned_addr learned my addr 172.21.15.84:0/2626227681 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a94a00640 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 0x5644e3f9edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a8fe00640 1 -- 172.21.15.84:0/2626227681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 msgr2=0x5644e3f9edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 0x5644e3f9edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a8fe00640 1 -- 172.21.15.84:0/2626227681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 msgr2=0x5644e3f92ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 0x5644e3f92ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.308+0000 7f7a8fe00640 1 -- 172.21.15.84:0/2626227681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644e3c59b90 con 0x5644e3bb6980 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.309+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bb6980 0x5644e3f929a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7a80031480 tx=0x7f7a800058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6646068de599fe8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.309+0000 7f7a79600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:43:20.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.309+0000 7f7a79600640 1 -- 172.21.15.84:0/2626227681 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80035070 con 0x5644e3bb6980 2024-09-21T02:43:20.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.309+0000 7f7a79600640 1 -- 172.21.15.84:0/2626227681 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f7a800037f0 con 0x5644e3bb6980 2024-09-21T02:43:20.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.309+0000 7f7a9d675740 1 -- 172.21.15.84:0/2626227681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a80004480 con 0x5644e3bb6980 2024-09-21T02:43:20.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.309+0000 7f7a79600640 1 -- 172.21.15.84:0/2626227681 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7a80040040 con 0x5644e3bb6980 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a9d675740 10 client.15480 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a9d675740 1 -- 172.21.15.84:0/2626227681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5644e3fa16f0 con 0x5644e3bb6980 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a79600640 1 -- 172.21.15.84:0/2626227681 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a80004480 con 0x5644e3bb6980 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a79600640 1 -- 172.21.15.84:0/2626227681 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7a80005400 con 0x5644e3bb6980 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a9d675740 10 client.15480 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a9d675740 10 client.15480 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a9d675740 20 client.15480 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a9d675740 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5644e3b9e1c0 0x5644e3fa4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a9d675740 4 client.15480 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.310+0000 7f7a9d675740 1 -- 172.21.15.84:0/2626227681 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644e3efebf0 con 0x5644e3b9e1c0 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.311+0000 7f7a8f400640 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5644e3b9e1c0 0x5644e3fa4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.311+0000 7f7a8f400640 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5644e3b9e1c0 0x5644e3fa4a50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dca774a17919ce02 server_cookie=cbdb4ed626bfad74 in_seq=0 out_seq=0 2024-09-21T02:43:20.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.311+0000 7f7a79600640 10 client.15480 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:20.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a79600640 1 -- 172.21.15.84:0/2626227681 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644e3efebf0 con 0x5644e3b9e1c0 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a79600640 10 client.15480 handle_command_reply: tid=0 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 client.15480 shutdown 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 -- 172.21.15.84:0/2626227681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bb6980 msgr2=0x5644e3f929a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bb6980 0x5644e3f929a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7a80031480 tx=0x7f7a800058e0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 -- 172.21.15.84:0/2626227681 shutdown_connections 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bdf840 0x5644e3f9edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5644e3b9e1c0 0x5644e3fa4a50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 0x5644e3f92ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 --2- 172.21.15.84:0/2626227681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bb6980 0x5644e3f929a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a79600640 0 client.15480 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:20.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.312+0000 7f7a9d675740 1 -- 172.21.15.84:0/2626227681 >> 172.21.15.84:0/2626227681 conn(0x5644e3bd3990 msgr2=0x5644e3f839a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:20.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.313+0000 7f7a9d675740 1 -- 172.21.15.84:0/2626227681 shutdown_connections 2024-09-21T02:43:20.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.313+0000 7f7a9d675740 1 -- 172.21.15.84:0/2626227681 wait complete. 2024-09-21T02:43:20.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.313+0000 7f7a9d675740 20 client.15480 trim_cache size 0 max 16384 2024-09-21T02:43:20.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.331+0000 7f7a9d675740 1 Processor -- start 2024-09-21T02:43:20.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.331+0000 7f7a9d675740 1 -- start start 2024-09-21T02:43:20.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.331+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bb6980 0x5644e3f849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.331+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 0x5644e3f84ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e3f9e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a9d675740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b5650 con 0x5644e3bdf840 2024-09-21T02:43:20.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a9d675740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b2f20 con 0x5644e3bbeb60 2024-09-21T02:43:20.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a9d675740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b0d70 con 0x5644e3bb6980 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a94a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e3f9e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a94a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e3f9e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56378/0 (socket says 172.21.15.84:56378) 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a8fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bb6980 0x5644e3f849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a94a00640 1 -- 172.21.15.84:0/1606020133 learned_addr learned my addr 172.21.15.84:0/1606020133 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a8f400640 1 --2- 172.21.15.84:0/1606020133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 0x5644e3f84ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a8fe00640 1 -- 172.21.15.84:0/1606020133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 msgr2=0x5644e3f84ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/1606020133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 0x5644e3f84ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a8fe00640 1 -- 172.21.15.84:0/1606020133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 msgr2=0x5644e3f9e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:20.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/1606020133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e3f9e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.332+0000 7f7a8fe00640 1 -- 172.21.15.84:0/1606020133 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644e3f80c50 con 0x5644e3bb6980 2024-09-21T02:43:20.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.333+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/1606020133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bb6980 0x5644e3f849b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a8002a910 tx=0x7f7a80005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f3a085af948375 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:20.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.333+0000 7f7a7be00640 1 -- 172.21.15.84:0/1606020133 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80035040 con 0x5644e3bb6980 2024-09-21T02:43:20.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.333+0000 7f7a7be00640 1 -- 172.21.15.84:0/1606020133 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a80004480 con 0x5644e3bb6980 2024-09-21T02:43:20.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.333+0000 7f7a7be00640 1 -- 172.21.15.84:0/1606020133 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80004cc0 con 0x5644e3bb6980 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.334+0000 7f7a9d675740 1 -- 172.21.15.84:0/1606020133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bb6980 msgr2=0x5644e3f849b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.335+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1606020133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bb6980 0x5644e3f849b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a8002a910 tx=0x7f7a80005fd0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.335+0000 7f7a9d675740 1 -- 172.21.15.84:0/1606020133 shutdown_connections 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.335+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1606020133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e3f9e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.335+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1606020133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3bbeb60 0x5644e3f84ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.335+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1606020133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bb6980 0x5644e3f849b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.335+0000 7f7a9d675740 1 -- 172.21.15.84:0/1606020133 >> 172.21.15.84:0/1606020133 conn(0x5644e3bd3990 msgr2=0x5644e3f88c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.335+0000 7f7a9d675740 1 -- 172.21.15.84:0/1606020133 shutdown_connections 2024-09-21T02:43:20.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.335+0000 7f7a9d675740 1 -- 172.21.15.84:0/1606020133 wait complete. 2024-09-21T02:43:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.336+0000 7f7a9d675740 1 -- start start 2024-09-21T02:43:20.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.336+0000 7f7a9d675740 1 Processor -- start 2024-09-21T02:43:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bbeb60 0x5644e40074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e4007a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a9d675740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3b73570 0x5644e4008260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a9d675740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b13e0 con 0x5644e3bdf840 2024-09-21T02:43:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a9d675740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b2850 con 0x5644e3b73570 2024-09-21T02:43:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a9d675740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b1ab0 con 0x5644e3bbeb60 2024-09-21T02:43:20.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a9d675740 10 client.0 _ll_register_callbacks cb 0x7f7a880099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a94a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3b73570 0x5644e4008260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a8fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bbeb60 0x5644e40074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a94a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3b73570 0x5644e4008260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:45774/0 (socket says 172.21.15.84:45774) 2024-09-21T02:43:20.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a94a00640 1 -- 172.21.15.84:0/1579509811 learned_addr learned my addr 172.21.15.84:0/1579509811 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a8f400640 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e4007a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a94a00640 1 -- 172.21.15.84:0/1579509811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bbeb60 msgr2=0x5644e40074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a94a00640 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bbeb60 0x5644e40074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a94a00640 1 -- 172.21.15.84:0/1579509811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 msgr2=0x5644e4007a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a94a00640 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e4007a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.337+0000 7f7a94a00640 1 -- 172.21.15.84:0/1579509811 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644e40089d0 con 0x5644e3b73570 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.338+0000 7f7a94a00640 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3b73570 0x5644e4008260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7a8801e9d0 tx=0x7f7a88004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4da20914db7db54d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.338+0000 7f7a79600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.338+0000 7f7a79600640 1 -- 172.21.15.84:0/1579509811 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8802e060 con 0x5644e3b73570 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.338+0000 7f7a9d675740 1 -- 172.21.15.84:0/1579509811 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a80004480 con 0x5644e3b73570 2024-09-21T02:43:20.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.338+0000 7f7a79600640 1 -- 172.21.15.84:0/1579509811 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f7a8801d620 con 0x5644e3b73570 2024-09-21T02:43:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a79600640 1 -- 172.21.15.84:0/1579509811 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7a88035050 con 0x5644e3b73570 2024-09-21T02:43:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a9d675740 10 client.25502 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:20.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a9d675740 1 -- 172.21.15.84:0/1579509811 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5644e400fe30 con 0x5644e3b73570 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a79600640 1 -- 172.21.15.84:0/1579509811 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a80004480 con 0x5644e3b73570 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a79600640 1 -- 172.21.15.84:0/1579509811 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f7a88029bc0 con 0x5644e3b73570 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a9d675740 10 client.25502 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a9d675740 10 client.25502 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a9d675740 20 client.25502 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5644e4010630 0x5644e4012a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a9d675740 4 client.25502 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.339+0000 7f7a9d675740 1 -- 172.21.15.84:0/1579509811 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x5644e3efa6a0 con 0x5644e4010630 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.340+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5644e4010630 0x5644e4012a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.340+0000 7f7a79600640 10 client.25502 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:20.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.340+0000 7f7a8fe00640 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5644e4010630 0x5644e4012a50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9b82612eaba8cc7 server_cookie=7e76fd97f22bdfe7 in_seq=0 out_seq=0 2024-09-21T02:43:20.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a79600640 1 -- 172.21.15.84:0/1579509811 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5644e3efa6a0 con 0x5644e4010630 2024-09-21T02:43:20.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a79600640 10 client.25502 handle_command_reply: tid=0 2024-09-21T02:43:20.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 client.25502 shutdown 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 -- 172.21.15.84:0/1579509811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3b73570 msgr2=0x5644e4008260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3b73570 0x5644e4008260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7a8801e9d0 tx=0x7f7a88004a40 comp rx=0 tx=0).stop 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 -- 172.21.15.84:0/1579509811 shutdown_connections 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5644e4010630 0x5644e4012a50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5644e3b73570 0x5644e4008260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5644e3bdf840 0x5644e4007a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 --2- 172.21.15.84:0/1579509811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5644e3bbeb60 0x5644e40074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 -- 172.21.15.84:0/1579509811 >> 172.21.15.84:0/1579509811 conn(0x5644e3bd3990 msgr2=0x5644e3f88c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a79600640 0 client.25502 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 -- 172.21.15.84:0/1579509811 shutdown_connections 2024-09-21T02:43:20.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.357+0000 7f7a9d675740 1 -- 172.21.15.84:0/1579509811 wait complete. 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a9d675740 20 client.25502 trim_cache size 0 max 16384 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 27, 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 2, 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stdout: "45045b33": { 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 2, 2024-09-21T02:43:20.360 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 134.5, 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:20.361 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:20.362 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:20.362 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:20.362 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:20.362 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:43:20.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 -- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7a740b65a0 msgr2=0x7f7a740b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7a740b65a0 0x7f7a740b8ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7a88005fd0 tx=0x7f7a88009500 comp rx=0 tx=0).stop 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 -- 172.21.15.84:0/1660659575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90105400 msgr2=0x7f7a90102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90105400 0x7f7a90102c50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00e9c0 tx=0x7f7a7c00ee80 comp rx=0 tx=0).stop 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 -- 172.21.15.84:0/1660659575 shutdown_connections 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a9010df10 0x7f7a90103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90105400 0x7f7a90102c50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7a740b65a0 0x7f7a740b8ab0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 --2- 172.21.15.84:0/1660659575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a901049d0 0x7f7a90102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.358+0000 7f7a96a00640 1 -- 172.21.15.84:0/1660659575 >> 172.21.15.84:0/1660659575 conn(0x7f7a90079720 msgr2=0x7f7a900ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.359+0000 7f7a96a00640 1 -- 172.21.15.84:0/1660659575 shutdown_connections 2024-09-21T02:43:20.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:20.359+0000 7f7a96a00640 1 -- 172.21.15.84:0/1660659575 wait complete. 2024-09-21T02:43:21.184 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '45045b33', quiesce took 4.2 seconds. Will release after: 10.3 2024-09-21T02:43:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:21 smithi172 ceph-mon[35067]: pgmap v428: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T02:43:22.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:21 smithi084 ceph-mon[30747]: pgmap v428: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T02:43:22.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:21 smithi090 ceph-mon[34571]: pgmap v428: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-21T02:43:24.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:23 smithi172 ceph-mon[35067]: pgmap v429: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:24.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:23 smithi084 ceph-mon[30747]: pgmap v429: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:23 smithi090 ceph-mon[34571]: pgmap v429: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:26.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:25 smithi172 ceph-mon[35067]: pgmap v430: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:26.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:25 smithi084 ceph-mon[30747]: pgmap v430: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:26.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:25 smithi090 ceph-mon[34571]: pgmap v430: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:27 smithi172 ceph-mon[35067]: pgmap v431: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:43:28.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:27 smithi084 ceph-mon[30747]: pgmap v431: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:43:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:27 smithi090 ceph-mon[34571]: pgmap v431: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T02:43:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:29 smithi172 ceph-mon[35067]: pgmap v432: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:30.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:29 smithi090 ceph-mon[34571]: pgmap v432: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:30.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:29 smithi084 ceph-mon[30747]: pgmap v432: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-21T02:43:31.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:43:31.815 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:31 smithi084 ceph-mon[30747]: pgmap v433: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:31.961 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:31 smithi172 ceph-mon[35067]: pgmap v433: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:32.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:31 smithi090 ceph-mon[34571]: pgmap v433: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.327+0000 7f2b16800640 1 -- 172.21.15.84:0/1713810033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 msgr2=0x7f2b10076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.327+0000 7f2b16800640 1 --2- 172.21.15.84:0/1713810033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 0x7f2b10076100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009900 tx=0x7f2afc02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.328+0000 7f2b16800640 1 -- 172.21.15.84:0/1713810033 shutdown_connections 2024-09-21T02:43:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.328+0000 7f2b16800640 1 --2- 172.21.15.84:0/1713810033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b1010b630 0x7f2b1010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.328+0000 7f2b16800640 1 --2- 172.21.15.84:0/1713810033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 0x7f2b10076100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.328+0000 7f2b16800640 1 --2- 172.21.15.84:0/1713810033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b100770f0 0x7f2b100757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.328+0000 7f2b16800640 1 -- 172.21.15.84:0/1713810033 >> 172.21.15.84:0/1713810033 conn(0x7f2b100fefe0 msgr2=0x7f2b10101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.328+0000 7f2b16800640 1 -- 172.21.15.84:0/1713810033 shutdown_connections 2024-09-21T02:43:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.328+0000 7f2b16800640 1 -- 172.21.15.84:0/1713810033 wait complete. 2024-09-21T02:43:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.329+0000 7f2b16800640 1 Processor -- start 2024-09-21T02:43:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.330+0000 7f2b16800640 1 -- start start 2024-09-21T02:43:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.330+0000 7f2b16800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 0x7f2b1019c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.330+0000 7f2b16800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b100770f0 0x7f2b1019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.330+0000 7f2b16800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b1010b630 0x7f2b1019d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.330+0000 7f2b16800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10111660 con 0x7f2b1010b630 2024-09-21T02:43:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.330+0000 7f2b16800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101114e0 con 0x7f2b10075cf0 2024-09-21T02:43:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.330+0000 7f2b16800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101117e0 con 0x7f2b100770f0 2024-09-21T02:43:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 0x7f2b1019c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b100770f0 0x7f2b1019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 0x7f2b1019c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52340/0 (socket says 172.21.15.84:52340) 2024-09-21T02:43:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0f400640 1 -- 172.21.15.84:0/4078564428 learned_addr learned my addr 172.21.15.84:0/4078564428 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b1010b630 0x7f2b1019d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0f400640 1 -- 172.21.15.84:0/4078564428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b100770f0 msgr2=0x7f2b1019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0f400640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b100770f0 0x7f2b1019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0f400640 1 -- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b1010b630 msgr2=0x7f2b1019d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0f400640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b1010b630 0x7f2b1019d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0f400640 1 -- 172.21.15.84:0/4078564428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1019dc50 con 0x7f2b10075cf0 2024-09-21T02:43:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.331+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b100770f0 0x7f2b1019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.332+0000 7f2b0f400640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 0x7f2b1019c210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000e9f0 tx=0x7f2b0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.332+0000 7f2b07e00640 1 -- 172.21.15.84:0/4078564428 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0000cd80 con 0x7f2b10075cf0 2024-09-21T02:43:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.332+0000 7f2b07e00640 1 -- 172.21.15.84:0/4078564428 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b00010900 con 0x7f2b10075cf0 2024-09-21T02:43:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.332+0000 7f2b07e00640 1 -- 172.21.15.84:0/4078564428 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00018920 con 0x7f2b10075cf0 2024-09-21T02:43:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.332+0000 7f2b16800640 1 -- 172.21.15.84:0/4078564428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1019df40 con 0x7f2b10075cf0 2024-09-21T02:43:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.332+0000 7f2b16800640 1 -- 172.21.15.84:0/4078564428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b101a4630 con 0x7f2b10075cf0 2024-09-21T02:43:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.336+0000 7f2b1d9fe740 1 Processor -- start 2024-09-21T02:43:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.336+0000 7f2b1d9fe740 1 -- start start 2024-09-21T02:43:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.336+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.336+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbb22f0 0x5652cdf82740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.336+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf83290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.337+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5652cdef56b0 con 0x5652cdbba4d0 2024-09-21T02:43:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.337+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5652cdee4ae0 con 0x5652cdbb22f0 2024-09-21T02:43:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.337+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5652cdee88f0 con 0x5652cdbdb1b0 2024-09-21T02:43:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.337+0000 7f2b0fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.337+0000 7f2b0fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf820d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54292/0 (socket says 172.21.15.84:54292) 2024-09-21T02:43:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.337+0000 7f2b0fe00640 1 -- 172.21.15.84:0/2506595177 learned_addr learned my addr 172.21.15.84:0/2506595177 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.337+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf83290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.338+0000 7f2b0fe00640 1 -- 172.21.15.84:0/2506595177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbb22f0 msgr2=0x5652cdf82740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:43:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.338+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbb22f0 0x5652cdf82740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.338+0000 7f2b0fe00640 1 -- 172.21.15.84:0/2506595177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 msgr2=0x5652cdf83290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.338+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf83290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.338+0000 7f2b0fe00640 1 -- 172.21.15.84:0/2506595177 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cdeb1780 con 0x5652cdbdb1b0 2024-09-21T02:43:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.338+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf83290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.338+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf820d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009fa0 tx=0x7f2b0800f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771b22cfd0aa428b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.338+0000 7f2b07e00640 1 -- 172.21.15.84:0/4078564428 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7f2b00018b40 con 0x7f2b10075cf0 2024-09-21T02:43:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.339+0000 7f2b04c00640 1 -- 172.21.15.84:0/2506595177 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08015070 con 0x5652cdbdb1b0 2024-09-21T02:43:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.339+0000 7f2b04c00640 1 -- 172.21.15.84:0/2506595177 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b08011910 con 0x5652cdbdb1b0 2024-09-21T02:43:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.339+0000 7f2b04c00640 1 -- 172.21.15.84:0/2506595177 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08010b40 con 0x5652cdbdb1b0 2024-09-21T02:43:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.340+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2506595177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 msgr2=0x5652cdf820d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.340+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf820d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009fa0 tx=0x7f2b0800f7f0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.341+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2506595177 shutdown_connections 2024-09-21T02:43:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.341+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf83290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.341+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbb22f0 0x5652cdf82740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.341+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2506595177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf820d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.341+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2506595177 >> 172.21.15.84:0/2506595177 conn(0x5652cdbcf300 msgr2=0x5652cdf7db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.341+0000 7f2b07e00640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2af40b66f0 0x7f2af40b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.341+0000 7f2b07e00640 1 -- 172.21.15.84:0/4078564428 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f2b000e7b30 con 0x7f2b10075cf0 2024-09-21T02:43:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.342+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2af40b66f0 0x7f2af40b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.342+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2506595177 shutdown_connections 2024-09-21T02:43:32.346 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.343+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2af40b66f0 0x7f2af40b8c00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b08010620 tx=0x7f2b08000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:32.346 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.343+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2506595177 wait complete. 2024-09-21T02:43:32.346 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.344+0000 7f2b1d9fe740 1 -- start start 2024-09-21T02:43:32.346 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.344+0000 7f2b1d9fe740 1 Processor -- start 2024-09-21T02:43:32.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.345+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 0x5652cdf8b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.345+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf8bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.345+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.345+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5652cde1cab0 con 0x5652cdbdb1b0 2024-09-21T02:43:32.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.345+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5652cde8b570 con 0x5652cdbba4d0 2024-09-21T02:43:32.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.345+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5652cdf83db0 con 0x5652cdbb22f0 2024-09-21T02:43:32.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.345+0000 7f2b1d9fe740 10 client.0 _ll_register_callbacks cb 0x5652cde9a100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:32.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.346+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf8bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.346+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf8bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52356/0 (socket says 172.21.15.84:52356) 2024-09-21T02:43:32.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.346+0000 7f2b0ea00640 1 -- 172.21.15.84:0/1613032586 learned_addr learned my addr 172.21.15.84:0/1613032586 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:32.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.346+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.346+0000 7f2b0f400640 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 0x5652cdf8b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.346+0000 7f2b0ea00640 1 -- 172.21.15.84:0/1613032586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 msgr2=0x5652cdf8b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:32.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.346+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 0x5652cdf8b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.347+0000 7f2b0ea00640 1 -- 172.21.15.84:0/1613032586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbdb1b0 msgr2=0x5652cdf8cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:32.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.347+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.347+0000 7f2b0ea00640 1 -- 172.21.15.84:0/1613032586 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cdc46790 con 0x5652cdbba4d0 2024-09-21T02:43:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.347+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.347+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf8bfd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2afc006010 tx=0x7f2afc0318c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930287994a212136 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.347+0000 7f2af9600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.348+0000 7f2af9600640 1 -- 172.21.15.84:0/1613032586 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc035040 con 0x5652cdbba4d0 2024-09-21T02:43:32.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.348+0000 7f2af9600640 1 -- 172.21.15.84:0/1613032586 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f2afc031cb0 con 0x5652cdbba4d0 2024-09-21T02:43:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.348+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1613032586 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b08011910 con 0x5652cdbba4d0 2024-09-21T02:43:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.349+0000 7f2af9600640 1 -- 172.21.15.84:0/1613032586 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2afc0035f0 con 0x5652cdbba4d0 2024-09-21T02:43:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.349+0000 7f2b1d9fe740 10 client.25511 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:32.351 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.349+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1613032586 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5652cdcbf620 con 0x5652cdbba4d0 2024-09-21T02:43:32.352 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.350+0000 7f2af9600640 1 -- 172.21.15.84:0/1613032586 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2b08011910 con 0x5652cdbba4d0 2024-09-21T02:43:32.353 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.351+0000 7f2af9600640 1 -- 172.21.15.84:0/1613032586 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2afc003790 con 0x5652cdbba4d0 2024-09-21T02:43:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.351+0000 7f2b1d9fe740 10 client.25511 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.351+0000 7f2b1d9fe740 10 client.25511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.351+0000 7f2b1d9fe740 20 client.25511 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.351+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5652cdb99d80 0x5652cdf92fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.351+0000 7f2b1d9fe740 4 client.25511 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.351+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1613032586 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652cdef7600 con 0x5652cdb99d80 2024-09-21T02:43:32.354 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.352+0000 7f2b0f400640 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5652cdb99d80 0x5652cdf92fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.352+0000 7f2af9600640 10 client.25511 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.352+0000 7f2b0f400640 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5652cdb99d80 0x5652cdf92fe0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24bacf18b5fa0f8e server_cookie=9fa90f8629d2bfb2 in_seq=0 out_seq=0 2024-09-21T02:43:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.353+0000 7f2af9600640 1 -- 172.21.15.84:0/1613032586 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652cdef7600 con 0x5652cdb99d80 2024-09-21T02:43:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.353+0000 7f2af9600640 10 client.25511 handle_command_reply: tid=0 2024-09-21T02:43:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.354+0000 7f2b1d9fe740 1 client.25511 shutdown 2024-09-21T02:43:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.354+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1613032586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 msgr2=0x5652cdf8bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.354+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf8bfd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2afc006010 tx=0x7f2afc0318c0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1613032586 shutdown_connections 2024-09-21T02:43:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5652cdb99d80 0x5652cdf92fe0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf8bfd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1613032586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 0x5652cdf8b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1613032586 >> 172.21.15.84:0/1613032586 conn(0x5652cdbcf300 msgr2=0x5652cdf7c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2af9600640 0 client.25511 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1613032586 shutdown_connections 2024-09-21T02:43:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1613032586 wait complete. 2024-09-21T02:43:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.355+0000 7f2b1d9fe740 20 client.25511 trim_cache size 0 max 16384 2024-09-21T02:43:32.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.378+0000 7f2b1d9fe740 1 Processor -- start 2024-09-21T02:43:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.378+0000 7f2b1d9fe740 1 -- start start 2024-09-21T02:43:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.378+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 0x5652cdf7c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.378+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf7d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.378+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.379+0000 7f2b0f400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 0x5652cdf7c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.379+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101acf20 con 0x5652cdbba4d0 2024-09-21T02:43:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.379+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101aa7f0 con 0x5652cdbdb1b0 2024-09-21T02:43:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.379+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101a8640 con 0x5652cdbb22f0 2024-09-21T02:43:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.379+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf7d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.379+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf7d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40504/0 (socket says 172.21.15.84:40504) 2024-09-21T02:43:32.384 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.379+0000 7f2b0ea00640 1 -- 172.21.15.84:0/1360415416 learned_addr learned my addr 172.21.15.84:0/1360415416 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.379+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/1360415416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.380+0000 7f2b0ea00640 1 -- 172.21.15.84:0/1360415416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 msgr2=0x5652cdf7c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.380+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/1360415416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 0x5652cdf7c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.380+0000 7f2b0ea00640 1 -- 172.21.15.84:0/1360415416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbdb1b0 msgr2=0x5652cdf8ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.380+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/1360415416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.385 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.380+0000 7f2b0ea00640 1 -- 172.21.15.84:0/1360415416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652cdf8bc80 con 0x5652cdbba4d0 2024-09-21T02:43:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.380+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/1360415416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf7d4a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2afc02a910 tx=0x7f2afc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6190228075532551 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.380+0000 7f2afbe00640 1 -- 172.21.15.84:0/1360415416 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc035030 con 0x5652cdbba4d0 2024-09-21T02:43:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.380+0000 7f2afbe00640 1 -- 172.21.15.84:0/1360415416 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2afc031e00 con 0x5652cdbba4d0 2024-09-21T02:43:32.386 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.381+0000 7f2afbe00640 1 -- 172.21.15.84:0/1360415416 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0049d0 con 0x5652cdbba4d0 2024-09-21T02:43:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.381+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1360415416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 msgr2=0x5652cdf7d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.381+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1360415416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf7d4a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2afc02a910 tx=0x7f2afc001e70 comp rx=0 tx=0).stop 2024-09-21T02:43:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1360415416 shutdown_connections 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1360415416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbdb1b0 0x5652cdf8ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1360415416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbba4d0 0x5652cdf7d4a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/1360415416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbb22f0 0x5652cdf7c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1360415416 >> 172.21.15.84:0/1360415416 conn(0x5652cdbcf300 msgr2=0x5652cdf8be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1360415416 shutdown_connections 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/1360415416 wait complete. 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 -- start start 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.382+0000 7f2b1d9fe740 1 Processor -- start 2024-09-21T02:43:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.383+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbb22f0 0x5652cdf95740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.383+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf95e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.383+0000 7f2b1d9fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf96970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.383+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101a8cb0 con 0x5652cdbb22f0 2024-09-21T02:43:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.383+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101aa120 con 0x5652cdbba4d0 2024-09-21T02:43:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.383+0000 7f2b1d9fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b101a9380 con 0x5652cdbdb1b0 2024-09-21T02:43:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.383+0000 7f2b1d9fe740 10 client.0 _ll_register_callbacks cb 0x7f2afc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.383+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf95e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0ea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf95e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52370/0 (socket says 172.21.15.84:52370) 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0ea00640 1 -- 172.21.15.84:0/2546649958 learned_addr learned my addr 172.21.15.84:0/2546649958 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0fe00640 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf96970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0ea00640 1 -- 172.21.15.84:0/2546649958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 msgr2=0x5652cdf96970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf96970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0f400640 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbb22f0 0x5652cdf95740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0ea00640 1 -- 172.21.15.84:0/2546649958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbb22f0 msgr2=0x5652cdf95740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbb22f0 0x5652cdf95740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0ea00640 1 -- 172.21.15.84:0/2546649958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652cdf970d0 con 0x5652cdbba4d0 2024-09-21T02:43:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.384+0000 7f2b0f400640 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbb22f0 0x5652cdf95740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.385+0000 7f2b0ea00640 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf95e00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2afc02a9e0 tx=0x7f2afc0045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6069d80108229e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.385+0000 7f2af9600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.385+0000 7f2af9600640 1 -- 172.21.15.84:0/2546649958 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc035040 con 0x5652cdbba4d0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.385+0000 7f2af9600640 1 -- 172.21.15.84:0/2546649958 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f2afc003790 con 0x5652cdbba4d0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.385+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2546649958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2afc031e00 con 0x5652cdbba4d0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.385+0000 7f2af9600640 1 -- 172.21.15.84:0/2546649958 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2afc004770 con 0x5652cdbba4d0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.385+0000 7f2b1d9fe740 10 client.25517 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.385+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2546649958 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5652cdf983c0 con 0x5652cdbba4d0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.386+0000 7f2af9600640 1 -- 172.21.15.84:0/2546649958 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2afc031e00 con 0x5652cdbba4d0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.386+0000 7f2af9600640 1 -- 172.21.15.84:0/2546649958 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f2afc0469d0 con 0x5652cdbba4d0 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.386+0000 7f2b1d9fe740 10 client.25517 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.386+0000 7f2b1d9fe740 10 client.25517 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.386+0000 7f2b1d9fe740 20 client.25517 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:32.395 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.386+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5652cdb6f1c0 0x5652cdf98d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.387+0000 7f2b1d9fe740 4 client.25517 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.387+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2546649958 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5652cdef30b0 con 0x5652cdb6f1c0 2024-09-21T02:43:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.387+0000 7f2b0f400640 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5652cdb6f1c0 0x5652cdf98d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.387+0000 7f2b0f400640 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5652cdb6f1c0 0x5652cdf98d70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2f157bb39ac1a09 server_cookie=4108caee4c63bc1a in_seq=0 out_seq=0 2024-09-21T02:43:32.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.387+0000 7f2af9600640 10 client.25517 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.398+0000 7f2af9600640 1 -- 172.21.15.84:0/2546649958 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5652cdef30b0 con 0x5652cdb6f1c0 2024-09-21T02:43:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.398+0000 7f2af9600640 10 client.25517 handle_command_reply: tid=0 2024-09-21T02:43:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 client.25517 shutdown 2024-09-21T02:43:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2546649958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 msgr2=0x5652cdf95e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf95e00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2afc02a9e0 tx=0x7f2afc0045f0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2546649958 shutdown_connections 2024-09-21T02:43:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5652cdbdb1b0 0x5652cdf96970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5652cdb6f1c0 0x5652cdf98d70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5652cdbba4d0 0x5652cdf95e00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 --2- 172.21.15.84:0/2546649958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5652cdbb22f0 0x5652cdf95740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2546649958 >> 172.21.15.84:0/2546649958 conn(0x5652cdbcf300 msgr2=0x5652cdf7d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.399+0000 7f2af9600640 0 client.25517 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.400+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2546649958 shutdown_connections 2024-09-21T02:43:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.400+0000 7f2b1d9fe740 1 -- 172.21.15.84:0/2546649958 wait complete. 2024-09-21T02:43:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.400+0000 7f2b1d9fe740 20 client.25517 trim_cache size 0 max 16384 2024-09-21T02:43:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:43:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:43:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:43:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:43:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 -- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2af40b66f0 msgr2=0x7f2af40b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2af40b66f0 0x7f2af40b8c00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b08010620 tx=0x7f2b08000f40 comp rx=0 tx=0).stop 2024-09-21T02:43:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 -- 172.21.15.84:0/4078564428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 msgr2=0x7f2b1019c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 0x7f2b1019c210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000e9f0 tx=0x7f2b0000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 -- 172.21.15.84:0/4078564428 shutdown_connections 2024-09-21T02:43:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2af40b66f0 0x7f2af40b8c00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b100770f0 0x7f2b1019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b1010b630 0x7f2b1019d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 --2- 172.21.15.84:0/4078564428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b10075cf0 0x7f2b1019c210 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.401+0000 7f2b16800640 1 -- 172.21.15.84:0/4078564428 >> 172.21.15.84:0/4078564428 conn(0x7f2b100fefe0 msgr2=0x7f2b10101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.402+0000 7f2b16800640 1 -- 172.21.15.84:0/4078564428 shutdown_connections 2024-09-21T02:43:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:32.402+0000 7f2b16800640 1 -- 172.21.15.84:0/4078564428 wait complete. 2024-09-21T02:43:32.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.783+0000 7fcfee600640 1 -- 172.21.15.84:0/3655551985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfe81092f0 msgr2=0x7fcfe8109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.783+0000 7fcfee600640 1 --2- 172.21.15.84:0/3655551985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfe81092f0 0x7fcfe8109700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009900 tx=0x7fcfd402a410 comp rx=0 tx=0).stop 2024-09-21T02:43:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.783+0000 7fcfee600640 1 -- 172.21.15.84:0/3655551985 shutdown_connections 2024-09-21T02:43:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.783+0000 7fcfee600640 1 --2- 172.21.15.84:0/3655551985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe8109c40 0x7fcfe8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.783+0000 7fcfee600640 1 --2- 172.21.15.84:0/3655551985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfe81092f0 0x7fcfe8109700 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.783+0000 7fcfee600640 1 --2- 172.21.15.84:0/3655551985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe81039b0 0x7fcfe8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.783+0000 7fcfee600640 1 -- 172.21.15.84:0/3655551985 >> 172.21.15.84:0/3655551985 conn(0x7fcfe80ff440 msgr2=0x7fcfe8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:32.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.784+0000 7fcfee600640 1 -- 172.21.15.84:0/3655551985 shutdown_connections 2024-09-21T02:43:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.784+0000 7fcfee600640 1 -- 172.21.15.84:0/3655551985 wait complete. 2024-09-21T02:43:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.785+0000 7fcfee600640 1 Processor -- start 2024-09-21T02:43:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.786+0000 7fcfee600640 1 -- start start 2024-09-21T02:43:32.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.786+0000 7fcfee600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe81039b0 0x7fcfe8198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfee600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfe81092f0 0x7fcfe8199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfee600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe8109c40 0x7fcfe819ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfee600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8113a70 con 0x7fcfe81092f0 2024-09-21T02:43:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfee600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81138f0 con 0x7fcfe81039b0 2024-09-21T02:43:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfee600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8113bf0 con 0x7fcfe8109c40 2024-09-21T02:43:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfe7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfe81092f0 0x7fcfe8199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfed200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe81039b0 0x7fcfe8198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfed200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe81039b0 0x7fcfe8198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52400/0 (socket says 172.21.15.84:52400) 2024-09-21T02:43:32.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.787+0000 7fcfed200640 1 -- 172.21.15.84:0/2967340720 learned_addr learned my addr 172.21.15.84:0/2967340720 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.788+0000 7fcfedc00640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe8109c40 0x7fcfe819ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.789+0000 7fcfedc00640 1 -- 172.21.15.84:0/2967340720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe81039b0 msgr2=0x7fcfe8198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.789+0000 7fcfedc00640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe81039b0 0x7fcfe8198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.789+0000 7fcfedc00640 1 -- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfe81092f0 msgr2=0x7fcfe8199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.789+0000 7fcfedc00640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfe81092f0 0x7fcfe8199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.789+0000 7fcfedc00640 1 -- 172.21.15.84:0/2967340720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe8199d10 con 0x7fcfe8109c40 2024-09-21T02:43:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.789+0000 7fcfed200640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe81039b0 0x7fcfe8198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.789+0000 7fcfedc00640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe8109c40 0x7fcfe819ff80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000da10 tx=0x7fcfe000ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.790+0000 7fcfe5600640 1 -- 172.21.15.84:0/2967340720 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000bd70 con 0x7fcfe8109c40 2024-09-21T02:43:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.790+0000 7fcfe5600640 1 -- 172.21.15.84:0/2967340720 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfe0003e40 con 0x7fcfe8109c40 2024-09-21T02:43:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.790+0000 7fcfe5600640 1 -- 172.21.15.84:0/2967340720 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00106a0 con 0x7fcfe8109c40 2024-09-21T02:43:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.790+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe81a05e0 con 0x7fcfe8109c40 2024-09-21T02:43:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.790+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe81a0aa0 con 0x7fcfe8109c40 2024-09-21T02:43:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.791+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe8103dc0 con 0x7fcfe8109c40 2024-09-21T02:43:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.796+0000 7fcfe5600640 1 -- 172.21.15.84:0/2967340720 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fcfe0004b40 con 0x7fcfe8109c40 2024-09-21T02:43:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.798+0000 7fcfe5600640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcfd00b65e0 0x7fcfd00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.799+0000 7fcfe5600640 1 -- 172.21.15.84:0/2967340720 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fcfe00e7c80 con 0x7fcfe8109c40 2024-09-21T02:43:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.799+0000 7fcfe5600640 1 -- 172.21.15.84:0/2967340720 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcfe00e80e0 con 0x7fcfe8109c40 2024-09-21T02:43:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.799+0000 7fcfed200640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcfd00b65e0 0x7fcfd00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:32.801+0000 7fcfed200640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcfd00b65e0 0x7fcfd00b8af0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8110520 tx=0x7fcfdc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:33.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.182+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfe810fdd0 con 0x7fcfe8109c40 2024-09-21T02:43:33.186 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:43:33.187 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"btime":"2024-09-21T02:42:38:701523+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:42:38.113687+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24679,24703,24704]},"id":1}]} 2024-09-21T02:43:33.187 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-09-21T02:43:33.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.183+0000 7fcfe5600640 1 -- 172.21.15.84:0/2967340720 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7fcfe00adfc0 con 0x7fcfe8109c40 2024-09-21T02:43:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.186+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcfd00b65e0 msgr2=0x7fcfd00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.186+0000 7fcfee600640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcfd00b65e0 0x7fcfd00b8af0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8110520 tx=0x7fcfdc005f90 comp rx=0 tx=0).stop 2024-09-21T02:43:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.186+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe8109c40 msgr2=0x7fcfe819ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.186+0000 7fcfee600640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe8109c40 0x7fcfe819ff80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000da10 tx=0x7fcfe000ded0 comp rx=0 tx=0).stop 2024-09-21T02:43:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.188+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 shutdown_connections 2024-09-21T02:43:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.188+0000 7fcfee600640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fcfd00b65e0 0x7fcfd00b8af0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.188+0000 7fcfee600640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcfe8109c40 0x7fcfe819ff80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.188+0000 7fcfee600640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfe81092f0 0x7fcfe8199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.188+0000 7fcfee600640 1 --2- 172.21.15.84:0/2967340720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfe81039b0 0x7fcfe8198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.188+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 >> 172.21.15.84:0/2967340720 conn(0x7fcfe80ff440 msgr2=0x7fcfe8102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:33.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.188+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 shutdown_connections 2024-09-21T02:43:33.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:33.188+0000 7fcfee600640 1 -- 172.21.15.84:0/2967340720 wait complete. 2024-09-21T02:43:33.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:33 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2967340720' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:33.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:33 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2967340720' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:33.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:33 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2967340720' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:43:34.061 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 45045b33 --release --await' 2024-09-21T02:43:34.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 45045b33 --release --await 2024-09-21T02:43:34.253 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:34 smithi084 ceph-mon[30747]: pgmap v434: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T02:43:34.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:34 smithi172 ceph-mon[35067]: pgmap v434: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T02:43:34.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:34 smithi090 ceph-mon[34571]: pgmap v434: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T02:43:34.686 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:43:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 -- 172.21.15.84:0/3850645032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c105320 msgr2=0x7fd02c10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 --2- 172.21.15.84:0/3850645032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c105320 0x7fd02c10d870 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd018009860 tx=0x7fd01802a340 comp rx=0 tx=0).stop 2024-09-21T02:43:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 -- 172.21.15.84:0/3850645032 shutdown_connections 2024-09-21T02:43:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 --2- 172.21.15.84:0/3850645032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c10de30 0x7fd02c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 --2- 172.21.15.84:0/3850645032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c105320 0x7fd02c10d870 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 --2- 172.21.15.84:0/3850645032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd02c1049d0 0x7fd02c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 -- 172.21.15.84:0/3850645032 >> 172.21.15.84:0/3850645032 conn(0x7fd02c079740 msgr2=0x7fd02c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 -- 172.21.15.84:0/3850645032 shutdown_connections 2024-09-21T02:43:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.434+0000 7fd033600640 1 -- 172.21.15.84:0/3850645032 wait complete. 2024-09-21T02:43:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.435+0000 7fd033600640 1 Processor -- start 2024-09-21T02:43:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.435+0000 7fd033600640 1 -- start start 2024-09-21T02:43:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd033600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd02c1049d0 0x7fd02c102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd033600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c105320 0x7fd02c102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd033600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c10de30 0x7fd02c103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd033600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c113bb0 con 0x7fd02c10de30 2024-09-21T02:43:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd033600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c113a30 con 0x7fd02c105320 2024-09-21T02:43:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd033600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c113d30 con 0x7fd02c1049d0 2024-09-21T02:43:35.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd030c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd02c1049d0 0x7fd02c102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd030c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd02c1049d0 0x7fd02c102710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54354/0 (socket says 172.21.15.84:54354) 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd030c00640 1 -- 172.21.15.84:0/1185096130 learned_addr learned my addr 172.21.15.84:0/1185096130 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.436+0000 7fd02be00640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c105320 0x7fd02c102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd031600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c10de30 0x7fd02c103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd030c00640 1 -- 172.21.15.84:0/1185096130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c105320 msgr2=0x7fd02c102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd030c00640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c105320 0x7fd02c102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd030c00640 1 -- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c10de30 msgr2=0x7fd02c103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd030c00640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c10de30 0x7fd02c103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd030c00640 1 -- 172.21.15.84:0/1185096130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c19e500 con 0x7fd02c1049d0 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd02be00640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c105320 0x7fd02c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd031600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c10de30 0x7fd02c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:35.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.437+0000 7fd030c00640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd02c1049d0 0x7fd02c102710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd02000e9c0 tx=0x7fd02000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.438+0000 7fd029600640 1 -- 172.21.15.84:0/1185096130 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02000cde0 con 0x7fd02c1049d0 2024-09-21T02:43:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.438+0000 7fd029600640 1 -- 172.21.15.84:0/1185096130 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd020010900 con 0x7fd02c1049d0 2024-09-21T02:43:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.438+0000 7fd029600640 1 -- 172.21.15.84:0/1185096130 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0200189d0 con 0x7fd02c1049d0 2024-09-21T02:43:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.438+0000 7fd033600640 1 -- 172.21.15.84:0/1185096130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02c1ad080 con 0x7fd02c1049d0 2024-09-21T02:43:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.438+0000 7fd033600640 1 -- 172.21.15.84:0/1185096130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02c1ad540 con 0x7fd02c1049d0 2024-09-21T02:43:35.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.442+0000 7fd03a3be740 1 Processor -- start 2024-09-21T02:43:35.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.442+0000 7fd03a3be740 1 -- start start 2024-09-21T02:43:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.442+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54921c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.442+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50c2660 0x564ef5492700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.442+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef5492c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.442+0000 7fd03a3be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564ef5409290 con 0x564ef50c2660 2024-09-21T02:43:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.442+0000 7fd03a3be740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564ef53f86c0 con 0x564ef50eb520 2024-09-21T02:43:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.442+0000 7fd03a3be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ef53fc4d0 con 0x564ef50ca840 2024-09-21T02:43:35.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef5492c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd031600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef5492c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54356/0 (socket says 172.21.15.84:54356) 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 -- 172.21.15.84:0/1562070293 learned_addr learned my addr 172.21.15.84:0/1562070293 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 -- 172.21.15.84:0/1562070293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 msgr2=0x564ef54921c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 --2- 172.21.15.84:0/1562070293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54921c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 -- 172.21.15.84:0/1562070293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50c2660 msgr2=0x564ef5492700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 --2- 172.21.15.84:0/1562070293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50c2660 0x564ef5492700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 -- 172.21.15.84:0/1562070293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef5385460 con 0x564ef50ca840 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd029600640 1 -- 172.21.15.84:0/1185096130 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 19) ==== 154563+0+0 (secure 0 0 0) 0x7fd02001f020 con 0x7fd02c1049d0 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.443+0000 7fd02be00640 1 --2- 172.21.15.84:0/1562070293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef5492c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd018000c00 tx=0x7fd01802ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b891f37809dc09f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.444+0000 7fd01dc00640 1 -- 172.21.15.84:0/1562070293 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018037040 con 0x564ef50ca840 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.444+0000 7fd01dc00640 1 -- 172.21.15.84:0/1562070293 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd018041070 con 0x564ef50ca840 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.444+0000 7fd01dc00640 1 -- 172.21.15.84:0/1562070293 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018030340 con 0x564ef50ca840 2024-09-21T02:43:35.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.444+0000 7fd03a3be740 1 -- 172.21.15.84:0/1562070293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 msgr2=0x564ef5492c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.444+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1562070293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef5492c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd018000c00 tx=0x7fd01802ad00 comp rx=0 tx=0).stop 2024-09-21T02:43:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.445+0000 7fd03a3be740 1 -- 172.21.15.84:0/1562070293 shutdown_connections 2024-09-21T02:43:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.445+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1562070293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef5492c40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.445+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1562070293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50c2660 0x564ef5492700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.445+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1562070293 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54921c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.445+0000 7fd03a3be740 1 -- 172.21.15.84:0/1562070293 >> 172.21.15.84:0/1562070293 conn(0x564ef50df910 msgr2=0x564ef54900b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.446+0000 7fd029600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0140b65b0 0x7fd0140b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.446+0000 7fd03a3be740 1 -- 172.21.15.84:0/1562070293 shutdown_connections 2024-09-21T02:43:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.446+0000 7fd029600640 1 -- 172.21.15.84:0/1185096130 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fd0200e7b50 con 0x7fd02c1049d0 2024-09-21T02:43:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.446+0000 7fd03a3be740 1 -- 172.21.15.84:0/1562070293 wait complete. 2024-09-21T02:43:35.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.446+0000 7fd02be00640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0140b65b0 0x7fd0140b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.447+0000 7fd03a3be740 1 -- start start 2024-09-21T02:43:35.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.447+0000 7fd03a3be740 1 Processor -- start 2024-09-21T02:43:35.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.447+0000 7fd02be00640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0140b65b0 0x7fd0140b8ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd01802a860 tx=0x7fd01802a340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50c2660 0x564ef549de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef549e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd03a3be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564ef5259bb0 con 0x564ef50ca840 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd03a3be740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564ef53936c0 con 0x564ef50eb520 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd03a3be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ef54a0940 con 0x564ef50c2660 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd03a3be740 10 client.0 _ll_register_callbacks cb 0x564ef53ae490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd030c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50c2660 0x564ef549de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd030c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50c2660 0x564ef549de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54372/0 (socket says 172.21.15.84:54372) 2024-09-21T02:43:35.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.448+0000 7fd030c00640 1 -- 172.21.15.84:0/1550260743 learned_addr learned my addr 172.21.15.84:0/1550260743 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.449+0000 7fd031600640 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.449+0000 7fd02be00640 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef549e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.449+0000 7fd031600640 1 -- 172.21.15.84:0/1550260743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50c2660 msgr2=0x564ef549de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:35.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.449+0000 7fd031600640 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50c2660 0x564ef549de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.449+0000 7fd031600640 1 -- 172.21.15.84:0/1550260743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 msgr2=0x564ef549e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.449+0000 7fd031600640 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef549e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.449+0000 7fd031600640 1 -- 172.21.15.84:0/1550260743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef5156b00 con 0x564ef50eb520 2024-09-21T02:43:35.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.449+0000 7fd02be00640 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef549e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.450+0000 7fd031600640 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54a9c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd02400fbb0 tx=0x7fd02400d7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20265202e7465a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:35.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.450+0000 7fd012000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:35.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.450+0000 7fd012000640 1 -- 172.21.15.84:0/1550260743 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0240195f0 con 0x564ef50eb520 2024-09-21T02:43:35.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.450+0000 7fd012000640 1 -- 172.21.15.84:0/1550260743 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fd024019790 con 0x564ef50eb520 2024-09-21T02:43:35.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.450+0000 7fd03a3be740 1 -- 172.21.15.84:0/1550260743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd018041070 con 0x564ef50eb520 2024-09-21T02:43:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd012000640 1 -- 172.21.15.84:0/1550260743 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd024004b20 con 0x564ef50eb520 2024-09-21T02:43:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd03a3be740 10 client.25535 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd03a3be740 1 -- 172.21.15.84:0/1550260743 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564ef51cd960 con 0x564ef50eb520 2024-09-21T02:43:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd012000640 1 -- 172.21.15.84:0/1550260743 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd02401e070 con 0x564ef50eb520 2024-09-21T02:43:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd012000640 1 -- 172.21.15.84:0/1550260743 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd02400b040 con 0x564ef50eb520 2024-09-21T02:43:35.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd03a3be740 10 client.25535 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd03a3be740 10 client.25535 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd03a3be740 20 client.25535 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564ef50a9ea0 0x564ef54afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd03a3be740 4 client.25535 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.451+0000 7fd03a3be740 1 -- 172.21.15.84:0/1550260743 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd018041070 con 0x564ef50a9ea0 2024-09-21T02:43:35.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.452+0000 7fd030c00640 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564ef50a9ea0 0x564ef54afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.452+0000 7fd030c00640 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564ef50a9ea0 0x564ef54afde0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966100f91b8c18c5 server_cookie=8b813003eeec47cc in_seq=0 out_seq=0 2024-09-21T02:43:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.452+0000 7fd012000640 10 client.25535 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.453+0000 7fd012000640 1 -- 172.21.15.84:0/1550260743 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd018041070 con 0x564ef50a9ea0 2024-09-21T02:43:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.453+0000 7fd012000640 10 client.25535 handle_command_reply: tid=0 2024-09-21T02:43:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.453+0000 7fd03a3be740 1 client.25535 shutdown 2024-09-21T02:43:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 -- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 msgr2=0x564ef54a9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54a9c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd02400fbb0 tx=0x7fd02400d7b0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 -- 172.21.15.84:0/1550260743 shutdown_connections 2024-09-21T02:43:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564ef50a9ea0 0x564ef54afde0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd012000640 0 client.25535 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50eb520 0x564ef54a9c30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef549e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1550260743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50c2660 0x564ef549de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 -- 172.21.15.84:0/1550260743 >> 172.21.15.84:0/1550260743 conn(0x564ef50df910 msgr2=0x564ef54953a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 -- 172.21.15.84:0/1550260743 shutdown_connections 2024-09-21T02:43:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.454+0000 7fd03a3be740 1 -- 172.21.15.84:0/1550260743 wait complete. 2024-09-21T02:43:35.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.455+0000 7fd03a3be740 20 client.25535 trim_cache size 0 max 16384 2024-09-21T02:43:35.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.473+0000 7fd03a3be740 1 Processor -- start 2024-09-21T02:43:35.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.473+0000 7fd03a3be740 1 -- start start 2024-09-21T02:43:35.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.473+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50a9ea0 0x564ef54a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.473+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 0x564ef54aa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.473+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef549ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.473+0000 7fd03a3be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1b9ae0 con 0x564ef50a9ea0 2024-09-21T02:43:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.473+0000 7fd03a3be740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1b73b0 con 0x564ef50c2660 2024-09-21T02:43:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.473+0000 7fd03a3be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1b5200 con 0x564ef50ca840 2024-09-21T02:43:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd030c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50a9ea0 0x564ef54a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd031600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef549ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd030c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50a9ea0 0x564ef54a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40552/0 (socket says 172.21.15.84:40552) 2024-09-21T02:43:35.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd030c00640 1 -- 172.21.15.84:0/1542634454 learned_addr learned my addr 172.21.15.84:0/1542634454 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd02be00640 1 --2- 172.21.15.84:0/1542634454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 0x564ef54aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd031600640 1 -- 172.21.15.84:0/1542634454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 msgr2=0x564ef54aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd031600640 1 --2- 172.21.15.84:0/1542634454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 0x564ef54aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd031600640 1 -- 172.21.15.84:0/1542634454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50a9ea0 msgr2=0x564ef54a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd031600640 1 --2- 172.21.15.84:0/1542634454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50a9ea0 0x564ef54a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.474+0000 7fd031600640 1 -- 172.21.15.84:0/1542634454 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef549c160 con 0x564ef50ca840 2024-09-21T02:43:35.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.475+0000 7fd031600640 1 --2- 172.21.15.84:0/1542634454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef549ae70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd024005490 tx=0x7fd0240097e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9df702930fec669 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:35.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.475+0000 7fd01d200640 1 -- 172.21.15.84:0/1542634454 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024003b70 con 0x564ef50ca840 2024-09-21T02:43:35.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.475+0000 7fd01d200640 1 -- 172.21.15.84:0/1542634454 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd02401e070 con 0x564ef50ca840 2024-09-21T02:43:35.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.475+0000 7fd01d200640 1 -- 172.21.15.84:0/1542634454 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024004260 con 0x564ef50ca840 2024-09-21T02:43:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 -- 172.21.15.84:0/1542634454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 msgr2=0x564ef549ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1542634454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef549ae70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd024005490 tx=0x7fd0240097e0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 -- 172.21.15.84:0/1542634454 shutdown_connections 2024-09-21T02:43:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1542634454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50ca840 0x564ef549ae70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1542634454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 0x564ef54aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 --2- 172.21.15.84:0/1542634454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50a9ea0 0x564ef54a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 -- 172.21.15.84:0/1542634454 >> 172.21.15.84:0/1542634454 conn(0x564ef50df910 msgr2=0x564ef5493bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 -- 172.21.15.84:0/1542634454 shutdown_connections 2024-09-21T02:43:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.476+0000 7fd03a3be740 1 -- 172.21.15.84:0/1542634454 wait complete. 2024-09-21T02:43:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.477+0000 7fd03a3be740 1 -- start start 2024-09-21T02:43:35.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.477+0000 7fd03a3be740 1 Processor -- start 2024-09-21T02:43:35.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50a9ea0 0x564ef54a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 0x564ef54a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd03a3be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef551a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd03a3be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1b5870 con 0x564ef50ca840 2024-09-21T02:43:35.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd03a3be740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1b6ce0 con 0x564ef50c2660 2024-09-21T02:43:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd03a3be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1b5f40 con 0x564ef50a9ea0 2024-09-21T02:43:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd03a3be740 10 client.0 _ll_register_callbacks cb 0x7fd024009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd031600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef551a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd031600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef551a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40566/0 (socket says 172.21.15.84:40566) 2024-09-21T02:43:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd031600640 1 -- 172.21.15.84:0/2860814624 learned_addr learned my addr 172.21.15.84:0/2860814624 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd02be00640 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 0x564ef54a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.478+0000 7fd030c00640 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50a9ea0 0x564ef54a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.479+0000 7fd031600640 1 -- 172.21.15.84:0/2860814624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50a9ea0 msgr2=0x564ef54a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:35.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.479+0000 7fd031600640 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50a9ea0 0x564ef54a3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.479+0000 7fd031600640 1 -- 172.21.15.84:0/2860814624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 msgr2=0x564ef54a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:35.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.479+0000 7fd031600640 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 0x564ef54a3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.479+0000 7fd031600640 1 -- 172.21.15.84:0/2860814624 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef551ace0 con 0x564ef50ca840 2024-09-21T02:43:35.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.479+0000 7fd031600640 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef551a7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd024005530 tx=0x7fd024004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515e7ffce0d0d032 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.479+0000 7fd012000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:43:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.480+0000 7fd012000640 1 -- 172.21.15.84:0/2860814624 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0240050d0 con 0x564ef50ca840 2024-09-21T02:43:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.480+0000 7fd012000640 1 -- 172.21.15.84:0/2860814624 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fd024004020 con 0x564ef50ca840 2024-09-21T02:43:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.480+0000 7fd03a3be740 1 -- 172.21.15.84:0/2860814624 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd02401e070 con 0x564ef50ca840 2024-09-21T02:43:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.480+0000 7fd012000640 1 -- 172.21.15.84:0/2860814624 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd0240059c0 con 0x564ef50ca840 2024-09-21T02:43:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.480+0000 7fd03a3be740 10 client.15522 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:35.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.480+0000 7fd03a3be740 1 -- 172.21.15.84:0/2860814624 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564ef551bf00 con 0x564ef50ca840 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.481+0000 7fd012000640 1 -- 172.21.15.84:0/2860814624 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd02401e070 con 0x564ef50ca840 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.481+0000 7fd012000640 1 -- 172.21.15.84:0/2860814624 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fd024029070 con 0x564ef50ca840 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.481+0000 7fd03a3be740 10 client.15522 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.481+0000 7fd03a3be740 10 client.15522 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.481+0000 7fd03a3be740 20 client.15522 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.481+0000 7fd03a3be740 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564ef50eb520 0x564ef551e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.481+0000 7fd03a3be740 4 client.15522 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "45045b33", "release": true, "await": true}] 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.481+0000 7fd03a3be740 1 -- 172.21.15.84:0/2860814624 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "set_id": "45045b33", "release": true, "await": true}) -- 0x564ef540b1e0 con 0x564ef50eb520 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.482+0000 7fd030c00640 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564ef50eb520 0x564ef551e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:35.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.482+0000 7fd030c00640 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564ef50eb520 0x564ef551e5d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=460d303c7f803571 server_cookie=1b8c5375c545e005 in_seq=0 out_seq=0 2024-09-21T02:43:35.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.482+0000 7fd012000640 10 client.15522 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd012000640 1 -- 172.21.15.84:0/2860814624 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564ef540b1e0 con 0x564ef50eb520 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd012000640 10 client.15522 handle_command_reply: tid=0 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 client.15522 shutdown 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 -- 172.21.15.84:0/2860814624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 msgr2=0x564ef551a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef551a7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd024005530 tx=0x7fd024004ab0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 -- 172.21.15.84:0/2860814624 shutdown_connections 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564ef50eb520 0x564ef551e5d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ef50ca840 0x564ef551a7a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564ef50c2660 0x564ef54a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 --2- 172.21.15.84:0/2860814624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ef50a9ea0 0x564ef54a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 -- 172.21.15.84:0/2860814624 >> 172.21.15.84:0/2860814624 conn(0x564ef50df910 msgr2=0x564ef5493bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:35.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd012000640 0 client.15522 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:35.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 -- 172.21.15.84:0/2860814624 shutdown_connections 2024-09-21T02:43:35.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.484+0000 7fd03a3be740 1 -- 172.21.15.84:0/2860814624 wait complete. 2024-09-21T02:43:35.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.485+0000 7fd03a3be740 20 client.15522 trim_cache size 0 max 16384 2024-09-21T02:43:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:43:35.491 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 27, 2024-09-21T02:43:35.491 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 4, 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "45045b33": { 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 4, 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 134.5, 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T02:43:35.492 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:43:35.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 -- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0140b65b0 msgr2=0x7fd0140b8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0140b65b0 0x7fd0140b8ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd01802a860 tx=0x7fd01802a340 comp rx=0 tx=0).stop 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 -- 172.21.15.84:0/1185096130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd02c1049d0 msgr2=0x7fd02c102710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd02c1049d0 0x7fd02c102710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd02000e9c0 tx=0x7fd02000ee80 comp rx=0 tx=0).stop 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 -- 172.21.15.84:0/1185096130 shutdown_connections 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd02c10de30 0x7fd02c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd02c105320 0x7fd02c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0140b65b0 0x7fd0140b8ac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 --2- 172.21.15.84:0/1185096130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd02c1049d0 0x7fd02c102710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 -- 172.21.15.84:0/1185096130 >> 172.21.15.84:0/1185096130 conn(0x7fd02c079740 msgr2=0x7fd02c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 -- 172.21.15.84:0/1185096130 shutdown_connections 2024-09-21T02:43:35.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:43:35.486+0000 7fd033600640 1 -- 172.21.15.84:0/1185096130 wait complete. 2024-09-21T02:43:36.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:35 smithi172 ceph-mon[35067]: pgmap v435: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:43:36.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:35 smithi084 ceph-mon[30747]: pgmap v435: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:43:36.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:35 smithi090 ceph-mon[34571]: pgmap v435: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:43:36.377 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '45045b33', total seconds elapsed: 19.4 2024-09-21T02:43:38.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:37 smithi172 ceph-mon[35067]: pgmap v436: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:38.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:37 smithi084 ceph-mon[30747]: pgmap v436: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:37 smithi090 ceph-mon[34571]: pgmap v436: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:40.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:39 smithi172 ceph-mon[35067]: pgmap v437: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:40.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:39 smithi084 ceph-mon[30747]: pgmap v437: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:40.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:39 smithi090 ceph-mon[34571]: pgmap v437: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:41 smithi172 ceph-mon[35067]: pgmap v438: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T02:43:42.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:41 smithi084 ceph-mon[30747]: pgmap v438: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T02:43:42.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:41 smithi090 ceph-mon[34571]: pgmap v438: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-21T02:43:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:43 smithi172 ceph-mon[35067]: pgmap v439: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T02:43:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:43 smithi084 ceph-mon[30747]: pgmap v439: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T02:43:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:43 smithi090 ceph-mon[34571]: pgmap v439: 129 pgs: 129 active+clean; 674 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T02:43:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 -- 172.21.15.84:0/3250117141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c104f00 msgr2=0x7f4e6c10b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 --2- 172.21.15.84:0/3250117141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c104f00 0x7f4e6c10b8a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009ca0 tx=0x7f4e6402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 -- 172.21.15.84:0/3250117141 shutdown_connections 2024-09-21T02:43:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 --2- 172.21.15.84:0/3250117141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c104560 0x7f4e6c104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 --2- 172.21.15.84:0/3250117141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c104f00 0x7f4e6c10b8a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 --2- 172.21.15.84:0/3250117141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e6c1034e0 0x7f4e6c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 -- 172.21.15.84:0/3250117141 >> 172.21.15.84:0/3250117141 conn(0x7f4e6c0fee20 msgr2=0x7f4e6c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 -- 172.21.15.84:0/3250117141 shutdown_connections 2024-09-21T02:43:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.653+0000 7f4e71200640 1 -- 172.21.15.84:0/3250117141 wait complete. 2024-09-21T02:43:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.655+0000 7f4e71200640 1 Processor -- start 2024-09-21T02:43:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.655+0000 7f4e71200640 1 -- start start 2024-09-21T02:43:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.655+0000 7f4e71200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c1034e0 0x7f4e6c19bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.655+0000 7f4e71200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e6c104560 0x7f4e6c19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.655+0000 7f4e71200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c104f00 0x7f4e6c19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.655+0000 7f4e71200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c10f2d0 con 0x7f4e6c104560 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.655+0000 7f4e71200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c10f150 con 0x7f4e6c1034e0 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.655+0000 7f4e71200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c10f450 con 0x7f4e6c104f00 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c1034e0 0x7f4e6c19bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c1034e0 0x7f4e6c19bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:36524/0 (socket says 172.21.15.84:36524) 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 -- 172.21.15.84:0/1972314972 learned_addr learned my addr 172.21.15.84:0/1972314972 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6be00640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c104f00 0x7f4e6c19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e6c104560 0x7f4e6c19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 -- 172.21.15.84:0/1972314972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c104f00 msgr2=0x7f4e6c19d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c104f00 0x7f4e6c19d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 -- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e6c104560 msgr2=0x7f4e6c19c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e6c104560 0x7f4e6c19c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.658 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 -- 172.21.15.84:0/1972314972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c19d9f0 con 0x7f4e6c1034e0 2024-09-21T02:43:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e6c104560 0x7f4e6c19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:43:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.656+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c1034e0 0x7f4e6c19bfb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00e9f0 tx=0x7f4e5c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.657+0000 7f4e63e00640 1 -- 172.21.15.84:0/1972314972 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00cd80 con 0x7f4e6c1034e0 2024-09-21T02:43:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.657+0000 7f4e63e00640 1 -- 172.21.15.84:0/1972314972 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e5c010900 con 0x7f4e6c1034e0 2024-09-21T02:43:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.657+0000 7f4e63e00640 1 -- 172.21.15.84:0/1972314972 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c018920 con 0x7f4e6c1034e0 2024-09-21T02:43:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.657+0000 7f4e71200640 1 -- 172.21.15.84:0/1972314972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c19dce0 con 0x7f4e6c1034e0 2024-09-21T02:43:45.659 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.657+0000 7f4e71200640 1 -- 172.21.15.84:0/1972314972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c1a43d0 con 0x7f4e6c1034e0 2024-09-21T02:43:45.662 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.661+0000 7f4e7988f740 1 Processor -- start 2024-09-21T02:43:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.661+0000 7f4e7988f740 1 -- start start 2024-09-21T02:43:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.662+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbe61b0 0x561b4ff8d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.662+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff8d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.662+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff8e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.662+0000 7f4e7988f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561b4ff006b0 con 0x561b4fbc54d0 2024-09-21T02:43:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.662+0000 7f4e7988f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561b4feefae0 con 0x561b4fbe61b0 2024-09-21T02:43:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.662+0000 7f4e7988f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561b4fef38f0 con 0x561b4fbbd2f0 2024-09-21T02:43:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.662+0000 7f4e63e00640 1 -- 172.21.15.84:0/1972314972 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f4e5c010ab0 con 0x7f4e6c1034e0 2024-09-21T02:43:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.663+0000 7f4e6be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbe61b0 0x561b4ff8d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.663+0000 7f4e6be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbe61b0 0x561b4ff8d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:36534/0 (socket says 172.21.15.84:36534) 2024-09-21T02:43:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.663+0000 7f4e6be00640 1 -- 172.21.15.84:0/1612126208 learned_addr learned my addr 172.21.15.84:0/1612126208 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.663+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff8e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.663+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff8d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.666 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.664+0000 7f4e6b400640 1 -- 172.21.15.84:0/1612126208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbe61b0 msgr2=0x561b4ff8d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:45.666 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.664+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbe61b0 0x561b4ff8d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.666 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.664+0000 7f4e6b400640 1 -- 172.21.15.84:0/1612126208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 msgr2=0x561b4ff8e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.664+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff8e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.664+0000 7f4e6b400640 1 -- 172.21.15.84:0/1612126208 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4febc780 con 0x561b4fbbd2f0 2024-09-21T02:43:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.664+0000 7f4e6be00640 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbe61b0 0x561b4ff8d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.664+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff8d920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0e5150 tx=0x7f4e5c0f04f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eafed03752381814 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.665+0000 7f4e60c00640 1 -- 172.21.15.84:0/1612126208 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0fb070 con 0x561b4fbbd2f0 2024-09-21T02:43:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.665+0000 7f4e60c00640 1 -- 172.21.15.84:0/1612126208 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e5c0f0dd0 con 0x561b4fbbd2f0 2024-09-21T02:43:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.665+0000 7f4e60c00640 1 -- 172.21.15.84:0/1612126208 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0f56d0 con 0x561b4fbbd2f0 2024-09-21T02:43:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.665+0000 7f4e63e00640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4e500b6590 0x7f4e500b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.665+0000 7f4e63e00640 1 -- 172.21.15.84:0/1972314972 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f4e5c0e7aa0 con 0x7f4e6c1034e0 2024-09-21T02:43:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.666+0000 7f4e6be00640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4e500b6590 0x7f4e500b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.666+0000 7f4e7988f740 1 -- 172.21.15.84:0/1612126208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 msgr2=0x561b4ff8d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.666+0000 7f4e7988f740 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff8d920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0e5150 tx=0x7f4e5c0f04f0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.666+0000 7f4e7988f740 1 -- 172.21.15.84:0/1612126208 shutdown_connections 2024-09-21T02:43:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.666+0000 7f4e7988f740 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff8d920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.666+0000 7f4e7988f740 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff8e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.666+0000 7f4e7988f740 1 --2- 172.21.15.84:0/1612126208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbe61b0 0x561b4ff8d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.666+0000 7f4e7988f740 1 -- 172.21.15.84:0/1612126208 >> 172.21.15.84:0/1612126208 conn(0x561b4fbda300 msgr2=0x561b4ff88d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.667+0000 7f4e6be00640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4e500b6590 0x7f4e500b8aa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009ca0 tx=0x7f4e64031b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.667+0000 7f4e7988f740 1 -- 172.21.15.84:0/1612126208 shutdown_connections 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.667+0000 7f4e7988f740 1 -- 172.21.15.84:0/1612126208 wait complete. 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.667+0000 7f4e7988f740 1 -- start start 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.667+0000 7f4e7988f740 1 Processor -- start 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff969d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbc54d0 0x561b4ff97090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff97b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e7988f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561b4fe27ab0 con 0x561b4fbe61b0 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e7988f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561b4fe96570 con 0x561b4fbc54d0 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e7988f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561b4ff8ef90 con 0x561b4fbbd2f0 2024-09-21T02:43:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e7988f740 10 client.0 _ll_register_callbacks cb 0x561b4fea5100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e6be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff97b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e6be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff97b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59192/0 (socket says 172.21.15.84:59192) 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e6be00640 1 -- 172.21.15.84:0/438961845 learned_addr learned my addr 172.21.15.84:0/438961845 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.668+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbc54d0 0x561b4ff97090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e6b400640 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e6aa00640 1 -- 172.21.15.84:0/438961845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 msgr2=0x561b4ff969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e6aa00640 1 -- 172.21.15.84:0/438961845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 msgr2=0x561b4ff97b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff97b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.672 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e6aa00640 1 -- 172.21.15.84:0/438961845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4fc51790 con 0x561b4fbc54d0 2024-09-21T02:43:45.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbc54d0 0x561b4ff97090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e58013710 tx=0x7f4e58013bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19d890f2cac69b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e55600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.669+0000 7f4e55600640 1 -- 172.21.15.84:0/438961845 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58011dd0 con 0x561b4fbc54d0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.670+0000 7f4e7988f740 1 -- 172.21.15.84:0/438961845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e5c0f0dd0 con 0x561b4fbc54d0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.670+0000 7f4e55600640 1 -- 172.21.15.84:0/438961845 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f4e58004030 con 0x561b4fbc54d0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.670+0000 7f4e55600640 1 -- 172.21.15.84:0/438961845 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4e58004230 con 0x561b4fbc54d0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.670+0000 7f4e7988f740 10 client.25553 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.670+0000 7f4e7988f740 1 -- 172.21.15.84:0/438961845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561b4fcca620 con 0x561b4fbc54d0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.671+0000 7f4e55600640 1 -- 172.21.15.84:0/438961845 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e5c0f0dd0 con 0x561b4fbc54d0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.671+0000 7f4e55600640 1 -- 172.21.15.84:0/438961845 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4e5800f040 con 0x561b4fbc54d0 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.671+0000 7f4e7988f740 10 client.25553 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.671+0000 7f4e7988f740 10 client.25553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:45.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.671+0000 7f4e7988f740 20 client.25553 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.671+0000 7f4e7988f740 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x561b4fba4d80 0x561b4ffa4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.671+0000 7f4e7988f740 4 client.25553 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.671+0000 7f4e7988f740 1 -- 172.21.15.84:0/438961845 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b4ff02600 con 0x561b4fba4d80 2024-09-21T02:43:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.672+0000 7f4e6b400640 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x561b4fba4d80 0x561b4ffa4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.672+0000 7f4e55600640 10 client.25553 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:45.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.672+0000 7f4e6b400640 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x561b4fba4d80 0x561b4ffa4150 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c74587662e65b260 server_cookie=213f6ab78ff164f2 in_seq=0 out_seq=0 2024-09-21T02:43:45.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.673+0000 7f4e55600640 1 -- 172.21.15.84:0/438961845 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b4ff02600 con 0x561b4fba4d80 2024-09-21T02:43:45.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.673+0000 7f4e55600640 10 client.25553 handle_command_reply: tid=0 2024-09-21T02:43:45.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.673+0000 7f4e7988f740 1 client.25553 shutdown 2024-09-21T02:43:45.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 -- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbc54d0 msgr2=0x561b4ff97090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbc54d0 0x561b4ff97090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4e58013710 tx=0x7f4e58013bd0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 -- 172.21.15.84:0/438961845 shutdown_connections 2024-09-21T02:43:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x561b4fba4d80 0x561b4ffa4150 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff97b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbc54d0 0x561b4ff97090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 --2- 172.21.15.84:0/438961845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbbd2f0 0x561b4ff969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 -- 172.21.15.84:0/438961845 >> 172.21.15.84:0/438961845 conn(0x561b4fbda300 msgr2=0x561b4ff87360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e55600640 0 client.25553 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 -- 172.21.15.84:0/438961845 shutdown_connections 2024-09-21T02:43:45.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 1 -- 172.21.15.84:0/438961845 wait complete. 2024-09-21T02:43:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.674+0000 7f4e7988f740 20 client.25553 trim_cache size 0 max 16384 2024-09-21T02:43:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.689+0000 7f4e7988f740 1 Processor -- start 2024-09-21T02:43:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.689+0000 7f4e7988f740 1 -- start start 2024-09-21T02:43:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff88680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff89760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbe61b0 0x561b4ff89ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e7988f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c1b1120 con 0x561b4fbc54d0 2024-09-21T02:43:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e7988f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c1ae9f0 con 0x561b4fbbd2f0 2024-09-21T02:43:45.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e7988f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c1ac840 con 0x561b4fbe61b0 2024-09-21T02:43:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e6aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff89760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.692 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e6b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff88680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e6aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff89760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59200/0 (socket says 172.21.15.84:59200) 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e6aa00640 1 -- 172.21.15.84:0/1217507083 learned_addr learned my addr 172.21.15.84:0/1217507083 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.690+0000 7f4e6be00640 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbe61b0 0x561b4ff89ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e6b400640 1 -- 172.21.15.84:0/1217507083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbe61b0 msgr2=0x561b4ff89ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbe61b0 0x561b4ff89ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e6b400640 1 -- 172.21.15.84:0/1217507083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 msgr2=0x561b4ff89760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff89760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e6b400640 1 -- 172.21.15.84:0/1217507083 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b4ffa0a20 con 0x561b4fbbd2f0 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff89760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e6b400640 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff88680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0a9e10 tx=0x7f4e5c01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc6cb0c8961df33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e57e00640 1 -- 172.21.15.84:0/1217507083 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0ad610 con 0x561b4fbbd2f0 2024-09-21T02:43:45.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e57e00640 1 -- 172.21.15.84:0/1217507083 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e5c010e20 con 0x561b4fbbd2f0 2024-09-21T02:43:45.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.691+0000 7f4e57e00640 1 -- 172.21.15.84:0/1217507083 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0a9e90 con 0x561b4fbbd2f0 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 -- 172.21.15.84:0/1217507083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 msgr2=0x561b4ff88680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff88680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0a9e10 tx=0x7f4e5c01f000 comp rx=0 tx=0).stop 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 -- 172.21.15.84:0/1217507083 shutdown_connections 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbe61b0 0x561b4ff89ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbc54d0 0x561b4ff89760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 --2- 172.21.15.84:0/1217507083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff88680 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 -- 172.21.15.84:0/1217507083 >> 172.21.15.84:0/1217507083 conn(0x561b4fbda300 msgr2=0x561b4ff8cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 -- 172.21.15.84:0/1217507083 shutdown_connections 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.692+0000 7f4e7988f740 1 -- 172.21.15.84:0/1217507083 wait complete. 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.693+0000 7f4e7988f740 1 -- start start 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.693+0000 7f4e7988f740 1 Processor -- start 2024-09-21T02:43:45.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.693+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff9b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.693+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbc54d0 0x561b4ff9bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.693+0000 7f4e7988f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff9cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e7988f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c1aceb0 con 0x561b4fbe61b0 2024-09-21T02:43:45.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e7988f740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c1ae320 con 0x561b4fbbd2f0 2024-09-21T02:43:45.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e7988f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c1ad580 con 0x561b4fbc54d0 2024-09-21T02:43:45.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e7988f740 10 client.0 _ll_register_callbacks cb 0x7f4e58005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:45.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff9cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff9b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff9b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:36562/0 (socket says 172.21.15.84:36562) 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6b400640 1 -- 172.21.15.84:0/410852566 learned_addr learned my addr 172.21.15.84:0/410852566 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbc54d0 0x561b4ff9bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6b400640 1 -- 172.21.15.84:0/410852566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbc54d0 msgr2=0x561b4ff9bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6b400640 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbc54d0 0x561b4ff9bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6b400640 1 -- 172.21.15.84:0/410852566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 msgr2=0x561b4ff9cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6b400640 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff9cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.694+0000 7f4e6b400640 1 -- 172.21.15.84:0/410852566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b4ff9d220 con 0x561b4fbbd2f0 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e6b400640 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff9b900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0eb6b0 tx=0x7f4e5c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b284da25960e592 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e55600640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:45.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e55600640 1 -- 172.21.15.84:0/410852566 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0b2040 con 0x561b4fbbd2f0 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e7988f740 1 -- 172.21.15.84:0/410852566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b4fefe0b0 con 0x561b4fbbd2f0 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e55600640 1 -- 172.21.15.84:0/410852566 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f4e5c0f0bd0 con 0x561b4fbbd2f0 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e55600640 1 -- 172.21.15.84:0/410852566 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4e5c0acfb0 con 0x561b4fbbd2f0 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e7988f740 10 client.25559 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e7988f740 1 -- 172.21.15.84:0/410852566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561b4ff9e540 con 0x561b4fbbd2f0 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.695+0000 7f4e55600640 1 -- 172.21.15.84:0/410852566 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x561b4fefe0b0 con 0x561b4fbbd2f0 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.696+0000 7f4e55600640 1 -- 172.21.15.84:0/410852566 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f4e5c0eb170 con 0x561b4fbbd2f0 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.696+0000 7f4e7988f740 10 client.25559 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.696+0000 7f4e7988f740 10 client.25559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.696+0000 7f4e7988f740 20 client.25559 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.696+0000 7f4e7988f740 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x561b4fb7a1c0 0x561b4ff9eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.696+0000 7f4e7988f740 4 client.25559 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:45.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.696+0000 7f4e7988f740 1 -- 172.21.15.84:0/410852566 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b4fefb4e0 con 0x561b4fb7a1c0 2024-09-21T02:43:45.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.696+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x561b4fb7a1c0 0x561b4ff9eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:45.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.697+0000 7f4e55600640 10 client.25559 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:45.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.697+0000 7f4e6aa00640 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x561b4fb7a1c0 0x561b4ff9eac0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bfbc04aaa2cb782 server_cookie=dd7831f886540efe in_seq=0 out_seq=0 2024-09-21T02:43:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e55600640 1 -- 172.21.15.84:0/410852566 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b4fefb4e0 con 0x561b4fb7a1c0 2024-09-21T02:43:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e55600640 10 client.25559 handle_command_reply: tid=0 2024-09-21T02:43:45.705 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 client.25559 shutdown 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 -- 172.21.15.84:0/410852566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 msgr2=0x561b4ff9b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff9b900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0eb6b0 tx=0x7f4e5c000bc0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 -- 172.21.15.84:0/410852566 shutdown_connections 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b4fbc54d0 0x561b4ff9bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x561b4fb7a1c0 0x561b4ff9eac0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561b4fbe61b0 0x561b4ff9cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 --2- 172.21.15.84:0/410852566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561b4fbbd2f0 0x561b4ff9b900 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 -- 172.21.15.84:0/410852566 >> 172.21.15.84:0/410852566 conn(0x561b4fbda300 msgr2=0x561b4ff913a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e55600640 0 client.25559 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 -- 172.21.15.84:0/410852566 shutdown_connections 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 1 -- 172.21.15.84:0/410852566 wait complete. 2024-09-21T02:43:45.706 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.704+0000 7f4e7988f740 20 client.25559 trim_cache size 0 max 16384 2024-09-21T02:43:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:43:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:43:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:43:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:43:45.707 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 -- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4e500b6590 msgr2=0x7f4e500b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4e500b6590 0x7f4e500b8aa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009ca0 tx=0x7f4e64031b40 comp rx=0 tx=0).stop 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 -- 172.21.15.84:0/1972314972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c1034e0 msgr2=0x7f4e6c19bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c1034e0 0x7f4e6c19bfb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00e9f0 tx=0x7f4e5c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 -- 172.21.15.84:0/1972314972 shutdown_connections 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f4e500b6590 0x7f4e500b8aa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e6c104f00 0x7f4e6c19d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e6c104560 0x7f4e6c19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 --2- 172.21.15.84:0/1972314972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e6c1034e0 0x7f4e6c19bfb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.705+0000 7f4e71200640 1 -- 172.21.15.84:0/1972314972 >> 172.21.15.84:0/1972314972 conn(0x7f4e6c0fee20 msgr2=0x7f4e6c0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.706+0000 7f4e71200640 1 -- 172.21.15.84:0/1972314972 shutdown_connections 2024-09-21T02:43:45.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:45.706+0000 7f4e71200640 1 -- 172.21.15.84:0/1972314972 wait complete. 2024-09-21T02:43:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:45 smithi172 ceph-mon[35067]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-09-21T02:43:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:45 smithi172 ceph-mon[35067]: pgmap v440: 129 pgs: 129 active+clean; 675 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:46.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:45 smithi084 ceph-mon[30747]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-09-21T02:43:46.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:45 smithi084 ceph-mon[30747]: pgmap v440: 129 pgs: 129 active+clean; 675 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:46.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:45 smithi090 ceph-mon[34571]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-09-21T02:43:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:45 smithi090 ceph-mon[34571]: pgmap v440: 129 pgs: 129 active+clean; 675 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T02:43:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:47 smithi172 ceph-mon[35067]: pgmap v441: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T02:43:48.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:47 smithi084 ceph-mon[30747]: pgmap v441: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T02:43:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:47 smithi090 ceph-mon[34571]: pgmap v441: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T02:43:50.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:49 smithi172 ceph-mon[35067]: pgmap v442: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:49 smithi084 ceph-mon[30747]: pgmap v442: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:50.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:49 smithi090 ceph-mon[34571]: pgmap v442: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:51.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:50 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:43:51.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:50 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:43:51.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:50 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:43:52.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:51 smithi172 ceph-mon[35067]: pgmap v443: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:52.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:43:52.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:43:52.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:51 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:43:52.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:51 smithi084 ceph-mon[30747]: pgmap v443: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:52.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:43:52.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:43:52.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:51 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:43:52.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:51 smithi090 ceph-mon[34571]: pgmap v443: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:43:52.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:43:52.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:43:52.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:51 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:43:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:53 smithi172 ceph-mon[35067]: pgmap v444: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:54.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:53 smithi084 ceph-mon[30747]: pgmap v444: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:54.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:53 smithi090 ceph-mon[34571]: pgmap v444: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:43:56.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:55 smithi172 ceph-mon[35067]: pgmap v445: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T02:43:56.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:55 smithi084 ceph-mon[30747]: pgmap v445: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T02:43:56.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:55 smithi090 ceph-mon[34571]: pgmap v445: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T02:43:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:57 smithi172 ceph-mon[35067]: pgmap v446: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T02:43:58.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:57 smithi084 ceph-mon[30747]: pgmap v446: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T02:43:58.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:57 smithi090 ceph-mon[34571]: pgmap v446: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T02:43:58.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 -- 172.21.15.84:0/2553791907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1230109410 msgr2=0x7f123010b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 --2- 172.21.15.84:0/2553791907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1230109410 0x7f123010b920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1228009ca0 tx=0x7f122802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 -- 172.21.15.84:0/2553791907 shutdown_connections 2024-09-21T02:43:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 --2- 172.21.15.84:0/2553791907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1230106850 0x7f1230108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 --2- 172.21.15.84:0/2553791907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1230109410 0x7f123010b920 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 --2- 172.21.15.84:0/2553791907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f123006c4b0 0x7f1230106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 -- 172.21.15.84:0/2553791907 >> 172.21.15.84:0/2553791907 conn(0x7f12300fdf30 msgr2=0x7f12301003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 -- 172.21.15.84:0/2553791907 shutdown_connections 2024-09-21T02:43:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.900+0000 7f1234a00640 1 -- 172.21.15.84:0/2553791907 wait complete. 2024-09-21T02:43:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.901+0000 7f1234a00640 1 Processor -- start 2024-09-21T02:43:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.901+0000 7f1234a00640 1 -- start start 2024-09-21T02:43:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f1234a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f123006c4b0 0x7f123019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f1234a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1230106850 0x7f123019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f1234a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1230109410 0x7f123019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f1234a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f123010f470 con 0x7f123006c4b0 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f1234a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f123010f2f0 con 0x7f1230109410 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f1234a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f123010f5f0 con 0x7f1230106850 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f123006c4b0 0x7f123019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f123006c4b0 0x7f123019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38892/0 (socket says 172.21.15.84:38892) 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122de00640 1 -- 172.21.15.84:0/802565115 learned_addr learned my addr 172.21.15.84:0/802565115 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122e800640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1230109410 0x7f123019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122d400640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1230106850 0x7f123019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122de00640 1 -- 172.21.15.84:0/802565115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1230106850 msgr2=0x7f123019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122de00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1230106850 0x7f123019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122de00640 1 -- 172.21.15.84:0/802565115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1230109410 msgr2=0x7f123019d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122de00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1230109410 0x7f123019d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122de00640 1 -- 172.21.15.84:0/802565115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123019dc20 con 0x7f123006c4b0 2024-09-21T02:43:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.902+0000 7f122e800640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1230109410 0x7f123019d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:43:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.903+0000 7f122de00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f123006c4b0 0x7f123019c1e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f122000e9f0 tx=0x7f122000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.903+0000 7f1226a00640 1 -- 172.21.15.84:0/802565115 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122000cd80 con 0x7f123006c4b0 2024-09-21T02:43:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.903+0000 7f1234a00640 1 -- 172.21.15.84:0/802565115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123019df10 con 0x7f123006c4b0 2024-09-21T02:43:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.903+0000 7f1226a00640 1 -- 172.21.15.84:0/802565115 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1220010900 con 0x7f123006c4b0 2024-09-21T02:43:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.903+0000 7f1226a00640 1 -- 172.21.15.84:0/802565115 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12200188d0 con 0x7f123006c4b0 2024-09-21T02:43:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.903+0000 7f1234a00640 1 -- 172.21.15.84:0/802565115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12301a4600 con 0x7f123006c4b0 2024-09-21T02:43:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.906+0000 7f123ba8c740 1 Processor -- start 2024-09-21T02:43:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.906+0000 7f123ba8c740 1 -- start start 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.906+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eb00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.906+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.906+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.906+0000 7f123ba8c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ec6e236b0 con 0x563ec6ae02f0 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.906+0000 7f123ba8c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563ec6e12ae0 con 0x563ec6ae84d0 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.906+0000 7f123ba8c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563ec6e168f0 con 0x563ec6b091b0 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f1226a00640 1 -- 172.21.15.84:0/802565115 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f1220010ab0 con 0x7f123006c4b0 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:48266/0 (socket says 172.21.15.84:48266) 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 -- 172.21.15.84:0/258752184 learned_addr learned my addr 172.21.15.84:0/258752184 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122e800640 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eb00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122de00640 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 -- 172.21.15.84:0/258752184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 msgr2=0x563ec6eb00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eb00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 -- 172.21.15.84:0/258752184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 msgr2=0x563ec6eb0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 -- 172.21.15.84:0/258752184 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ec6ddf780 con 0x563ec6ae84d0 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.907+0000 7f122d400640 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb1290 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f121c009ca0 tx=0x7f121c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f95bcff81012b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.908+0000 7f121b000640 1 -- 172.21.15.84:0/258752184 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c01e070 con 0x563ec6ae84d0 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.908+0000 7f121b000640 1 -- 172.21.15.84:0/258752184 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f121c019b00 con 0x563ec6ae84d0 2024-09-21T02:43:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.908+0000 7f121b000640 1 -- 172.21.15.84:0/258752184 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c00ea50 con 0x563ec6ae84d0 2024-09-21T02:43:58.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.908+0000 7f123ba8c740 1 -- 172.21.15.84:0/258752184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 msgr2=0x563ec6eb1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.908+0000 7f123ba8c740 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb1290 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f121c009ca0 tx=0x7f121c011810 comp rx=0 tx=0).stop 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f1226a00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12140b6590 0x7f12140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f123ba8c740 1 -- 172.21.15.84:0/258752184 shutdown_connections 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f123ba8c740 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb1290 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f123ba8c740 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f123ba8c740 1 --2- 172.21.15.84:0/258752184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eb00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f123ba8c740 1 -- 172.21.15.84:0/258752184 >> 172.21.15.84:0/258752184 conn(0x563ec6afd300 msgr2=0x563ec6eabb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f122e800640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12140b6590 0x7f12140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f1226a00640 1 -- 172.21.15.84:0/802565115 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f12200e79c0 con 0x7f123006c4b0 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f123ba8c740 1 -- 172.21.15.84:0/258752184 shutdown_connections 2024-09-21T02:43:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f123ba8c740 1 -- 172.21.15.84:0/258752184 wait complete. 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.909+0000 7f122e800640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12140b6590 0x7f12140b8aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f12280094e0 tx=0x7f1228033000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 1 -- start start 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 1 Processor -- start 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae02f0 0x563ec6eb9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae84d0 0x563ec6eb9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6b091b0 0x563ec6eba970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563ec6d4aab0 con 0x563ec6b091b0 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563ec6db9570 con 0x563ec6ae02f0 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563ec6eb1db0 con 0x563ec6ae84d0 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.910+0000 7f123ba8c740 10 client.0 _ll_register_callbacks cb 0x563ec6dc8100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae02f0 0x563ec6eb9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae02f0 0x563ec6eb9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:48268/0 (socket says 172.21.15.84:48268) 2024-09-21T02:43:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 -- 172.21.15.84:0/1297903048 learned_addr learned my addr 172.21.15.84:0/1297903048 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122e800640 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6b091b0 0x563ec6eba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122d400640 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae84d0 0x563ec6eb9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 -- 172.21.15.84:0/1297903048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae84d0 msgr2=0x563ec6eb9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae84d0 0x563ec6eb9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 -- 172.21.15.84:0/1297903048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6b091b0 msgr2=0x563ec6eba970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6b091b0 0x563ec6eba970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 -- 172.21.15.84:0/1297903048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ec6b74790 con 0x563ec6ae02f0 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122e800640 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6b091b0 0x563ec6eba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f122de00640 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae02f0 0x563ec6eb9740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12200ad510 tx=0x7f12200ace40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a0397fdfbe7a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.911+0000 7f120f400640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:43:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f120f400640 1 -- 172.21.15.84:0/1297903048 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12200acf80 con 0x563ec6ae02f0 2024-09-21T02:43:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f123ba8c740 1 -- 172.21.15.84:0/1297903048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f121c019b00 con 0x563ec6ae02f0 2024-09-21T02:43:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f120f400640 1 -- 172.21.15.84:0/1297903048 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f1220018ab0 con 0x563ec6ae02f0 2024-09-21T02:43:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f120f400640 1 -- 172.21.15.84:0/1297903048 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1220010e20 con 0x563ec6ae02f0 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f123ba8c740 10 client.25571 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f123ba8c740 1 -- 172.21.15.84:0/1297903048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563ec6bed620 con 0x563ec6ae02f0 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f120f400640 1 -- 172.21.15.84:0/1297903048 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f121c019b00 con 0x563ec6ae02f0 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f120f400640 1 -- 172.21.15.84:0/1297903048 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f12200b33d0 con 0x563ec6ae02f0 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f123ba8c740 10 client.25571 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f123ba8c740 10 client.25571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.912+0000 7f123ba8c740 20 client.25571 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.913+0000 7f123ba8c740 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x563ec6ac7d80 0x563ec6ec6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.913+0000 7f123ba8c740 4 client.25571 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.913+0000 7f123ba8c740 1 -- 172.21.15.84:0/1297903048 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ec6e25600 con 0x563ec6ac7d80 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.913+0000 7f122d400640 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x563ec6ac7d80 0x563ec6ec6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.913+0000 7f120f400640 10 client.25571 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.913+0000 7f122d400640 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x563ec6ac7d80 0x563ec6ec6e90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8183a92dcfd95b server_cookie=8048f94c6cac4319 in_seq=0 out_seq=0 2024-09-21T02:43:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f120f400640 1 -- 172.21.15.84:0/1297903048 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ec6e25600 con 0x563ec6ac7d80 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f120f400640 10 client.25571 handle_command_reply: tid=0 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 client.25571 shutdown 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 -- 172.21.15.84:0/1297903048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae02f0 msgr2=0x563ec6eb9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae02f0 0x563ec6eb9740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12200ad510 tx=0x7f12200ace40 comp rx=0 tx=0).stop 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 -- 172.21.15.84:0/1297903048 shutdown_connections 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae84d0 0x563ec6eb9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x563ec6ac7d80 0x563ec6ec6e90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6b091b0 0x563ec6eba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 --2- 172.21.15.84:0/1297903048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae02f0 0x563ec6eb9740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f123ba8c740 1 -- 172.21.15.84:0/1297903048 >> 172.21.15.84:0/1297903048 conn(0x563ec6afd300 msgr2=0x563ec6eaa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.914+0000 7f120f400640 0 client.25571 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.915+0000 7f123ba8c740 1 -- 172.21.15.84:0/1297903048 shutdown_connections 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.915+0000 7f123ba8c740 1 -- 172.21.15.84:0/1297903048 wait complete. 2024-09-21T02:43:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.915+0000 7f123ba8c740 20 client.25571 trim_cache size 0 max 16384 2024-09-21T02:43:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f123ba8c740 1 Processor -- start 2024-09-21T02:43:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f123ba8c740 1 -- start start 2024-09-21T02:43:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eaa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f123ba8c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f12301b1290 con 0x563ec6ae02f0 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f123ba8c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12301aeb60 con 0x563ec6ae84d0 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f123ba8c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12301ac9b0 con 0x563ec6b091b0 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f122de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f122de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38906/0 (socket says 172.21.15.84:38906) 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f122de00640 1 -- 172.21.15.84:0/3116759962 learned_addr learned my addr 172.21.15.84:0/3116759962 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.930+0000 7f122d400640 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f122e800640 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eaa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f122de00640 1 -- 172.21.15.84:0/3116759962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 msgr2=0x563ec6eaa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f122de00640 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eaa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f122de00640 1 -- 172.21.15.84:0/3116759962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 msgr2=0x563ec6eb46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:58.933 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f122de00640 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f122de00640 1 -- 172.21.15.84:0/3116759962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ec6eb78d0 con 0x563ec6ae02f0 2024-09-21T02:43:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f122e800640 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eaa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:43:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f122de00640 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb4190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f12200ad7a0 tx=0x7f122000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326020b8408895ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f121a600640 1 -- 172.21.15.84:0/3116759962 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12200acf80 con 0x563ec6ae02f0 2024-09-21T02:43:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f121a600640 1 -- 172.21.15.84:0/3116759962 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12200ad320 con 0x563ec6ae02f0 2024-09-21T02:43:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.931+0000 7f121a600640 1 -- 172.21.15.84:0/3116759962 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220018a70 con 0x563ec6ae02f0 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 -- 172.21.15.84:0/3116759962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 msgr2=0x563ec6eb4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb4190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f12200ad7a0 tx=0x7f122000cf90 comp rx=0 tx=0).stop 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 -- 172.21.15.84:0/3116759962 shutdown_connections 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6b091b0 0x563ec6eaa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6ae84d0 0x563ec6eb46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 --2- 172.21.15.84:0/3116759962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae02f0 0x563ec6eb4190 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 -- 172.21.15.84:0/3116759962 >> 172.21.15.84:0/3116759962 conn(0x563ec6afd300 msgr2=0x563ec6eb8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 -- 172.21.15.84:0/3116759962 shutdown_connections 2024-09-21T02:43:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.932+0000 7f123ba8c740 1 -- 172.21.15.84:0/3116759962 wait complete. 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 1 -- start start 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 1 Processor -- start 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae02f0 0x563ec6ebeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae84d0 0x563ec6ebf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6b091b0 0x563ec6ebfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f12301ad020 con 0x563ec6ae84d0 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12301ae490 con 0x563ec6b091b0 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12301ad6f0 con 0x563ec6ae02f0 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f123ba8c740 10 client.0 _ll_register_callbacks cb 0x7f1220009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.933+0000 7f122d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae84d0 0x563ec6ebf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6b091b0 0x563ec6ebfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6b091b0 0x563ec6ebfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:48274/0 (socket says 172.21.15.84:48274) 2024-09-21T02:43:58.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122e800640 1 -- 172.21.15.84:0/2800157934 learned_addr learned my addr 172.21.15.84:0/2800157934 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122de00640 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae02f0 0x563ec6ebeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122d400640 1 -- 172.21.15.84:0/2800157934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae02f0 msgr2=0x563ec6ebeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122d400640 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae02f0 0x563ec6ebeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122d400640 1 -- 172.21.15.84:0/2800157934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6b091b0 msgr2=0x563ec6ebfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122d400640 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6b091b0 0x563ec6ebfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122d400640 1 -- 172.21.15.84:0/2800157934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ec6ec0420 con 0x563ec6ae84d0 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f122d400640 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae84d0 0x563ec6ebf1c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f121c005890 tx=0x7f121c0194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3251c765e4ad8c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.934+0000 7f120f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f120f400640 1 -- 172.21.15.84:0/2800157934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121c01e040 con 0x563ec6ae84d0 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 1 -- 172.21.15.84:0/2800157934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12200ad320 con 0x563ec6ae84d0 2024-09-21T02:43:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f120f400640 1 -- 172.21.15.84:0/2800157934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f121c0050d0 con 0x563ec6ae84d0 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f120f400640 1 -- 172.21.15.84:0/2800157934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f121c03a050 con 0x563ec6ae84d0 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 10 client.15555 fetch_fsmap learned FSMap version 27 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 1 -- 172.21.15.84:0/2800157934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563ec6ec1760 con 0x563ec6ae84d0 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f120f400640 1 -- 172.21.15.84:0/2800157934 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12200ad320 con 0x563ec6ae84d0 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f120f400640 1 -- 172.21.15.84:0/2800157934 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f121c003c00 con 0x563ec6ae84d0 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 10 client.15555 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 20 client.15555 populate_metadata read hostname 'smithi084' 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x563ec6a9d1c0 0x563ec6f33a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 4 client.15555 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.935+0000 7f123ba8c740 1 -- 172.21.15.84:0/2800157934 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563ec6e210b0 con 0x563ec6a9d1c0 2024-09-21T02:43:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.936+0000 7f122de00640 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x563ec6a9d1c0 0x563ec6f33a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:43:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.936+0000 7f122de00640 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x563ec6a9d1c0 0x563ec6f33a90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d05841a9e3205f57 server_cookie=3972f1c56cf2b1d1 in_seq=0 out_seq=0 2024-09-21T02:43:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.936+0000 7f120f400640 10 client.15555 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f120f400640 1 -- 172.21.15.84:0/2800157934 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563ec6e210b0 con 0x563ec6a9d1c0 2024-09-21T02:43:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f120f400640 10 client.15555 handle_command_reply: tid=0 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 client.15555 shutdown 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 -- 172.21.15.84:0/2800157934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae84d0 msgr2=0x563ec6ebf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae84d0 0x563ec6ebf1c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f121c005890 tx=0x7f121c0194a0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 -- 172.21.15.84:0/2800157934 shutdown_connections 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x563ec6a9d1c0 0x563ec6f33a90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563ec6b091b0 0x563ec6ebfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563ec6ae84d0 0x563ec6ebf1c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 --2- 172.21.15.84:0/2800157934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563ec6ae02f0 0x563ec6ebeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f120f400640 0 client.15555 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 -- 172.21.15.84:0/2800157934 >> 172.21.15.84:0/2800157934 conn(0x563ec6afd300 msgr2=0x563ec6eb4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 -- 172.21.15.84:0/2800157934 shutdown_connections 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 1 -- 172.21.15.84:0/2800157934 wait complete. 2024-09-21T02:43:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.942+0000 7f123ba8c740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T02:43:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:43:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:43:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:43:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:43:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 -- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12140b6590 msgr2=0x7f12140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12140b6590 0x7f12140b8aa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f12280094e0 tx=0x7f1228033000 comp rx=0 tx=0).stop 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 -- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f123006c4b0 msgr2=0x7f123019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f123006c4b0 0x7f123019c1e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f122000e9f0 tx=0x7f122000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 -- 172.21.15.84:0/802565115 shutdown_connections 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f12140b6590 0x7f12140b8aa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1230106850 0x7f123019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1230109410 0x7f123019d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 --2- 172.21.15.84:0/802565115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f123006c4b0 0x7f123019c1e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 -- 172.21.15.84:0/802565115 >> 172.21.15.84:0/802565115 conn(0x7f12300fdf30 msgr2=0x7f1230100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 -- 172.21.15.84:0/802565115 shutdown_connections 2024-09-21T02:43:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:43:58.943+0000 7f1234a00640 1 -- 172.21.15.84:0/802565115 wait complete. 2024-09-21T02:44:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:43:59 smithi172 ceph-mon[35067]: pgmap v447: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T02:44:00.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:43:59 smithi084 ceph-mon[30747]: pgmap v447: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T02:44:00.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:43:59 smithi090 ceph-mon[34571]: pgmap v447: 129 pgs: 129 active+clean; 676 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T02:44:02.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:01 smithi172 ceph-mon[35067]: pgmap v448: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-21T02:44:02.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:01 smithi084 ceph-mon[30747]: pgmap v448: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-21T02:44:02.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:01 smithi090 ceph-mon[34571]: pgmap v448: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-21T02:44:02.702 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 63% (8032/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T02:44:03.306 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T02:44:03.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:44:03.741 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:44:03.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:03 smithi084 ceph-mon[30747]: pgmap v449: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:44:03.763 INFO:tasks.workunit.client.0.smithi084.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T02:44:03.763 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T02:44:03.763 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T02:44:03.763 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T02:44:03.763 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T02:44:03.763 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T02:44:03.763 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr: git switch -c 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr:Or undo this operation with: 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr: git switch - 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T02:44:03.764 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T02:44:03.780 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T02:44:03.912 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T02:44:03.917 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T02:44:03.917 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T02:44:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:03 smithi172 ceph-mon[35067]: pgmap v449: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:44:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:03 smithi090 ceph-mon[34571]: pgmap v449: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T02:44:04.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.579+0000 7f1d0ca00640 1 -- 172.21.15.84:0/1884027342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081092d0 msgr2=0x7f1d081096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.579+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/1884027342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081092d0 0x7f1d081096e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4009900 tx=0x7f1cf402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.579+0000 7f1d0ca00640 1 -- 172.21.15.84:0/1884027342 shutdown_connections 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.579+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/1884027342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08109c20 0x7f1d08110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.579+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/1884027342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081092d0 0x7f1d081096e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.579+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/1884027342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d08103990 0x7f1d08103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.579+0000 7f1d0ca00640 1 -- 172.21.15.84:0/1884027342 >> 172.21.15.84:0/1884027342 conn(0x7f1d080ff3e0 msgr2=0x7f1d08101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.579+0000 7f1d0ca00640 1 -- 172.21.15.84:0/1884027342 shutdown_connections 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.580+0000 7f1d0ca00640 1 -- 172.21.15.84:0/1884027342 wait complete. 2024-09-21T02:44:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.580+0000 7f1d0ca00640 1 Processor -- start 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d0ca00640 1 -- start start 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d0ca00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08103990 0x7f1d08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d0ca00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081092d0 0x7f1d08075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d0ca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d08109c20 0x7f1d08076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d0ca00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08113a00 con 0x7f1d08109c20 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d0ca00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08113880 con 0x7f1d081092d0 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d0ca00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08113b80 con 0x7f1d08103990 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d06800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08103990 0x7f1d08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d07200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d08109c20 0x7f1d08076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d06800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08103990 0x7f1d08075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:45506/0 (socket says 172.21.15.84:45506) 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.581+0000 7f1d06800640 1 -- 172.21.15.84:0/2449844322 learned_addr learned my addr 172.21.15.84:0/2449844322 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.582+0000 7f1d05e00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081092d0 0x7f1d08075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.582+0000 7f1d06800640 1 -- 172.21.15.84:0/2449844322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081092d0 msgr2=0x7f1d08075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.582+0000 7f1d06800640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081092d0 0x7f1d08075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.582+0000 7f1d06800640 1 -- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d08109c20 msgr2=0x7f1d08076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.582+0000 7f1d06800640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d08109c20 0x7f1d08076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.582+0000 7f1d06800640 1 -- 172.21.15.84:0/2449844322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d081a8650 con 0x7f1d08103990 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.582+0000 7f1d06800640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08103990 0x7f1d08075710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800ea60 tx=0x7f1cf800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.582+0000 7f1cff400640 1 -- 172.21.15.84:0/2449844322 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800cde0 con 0x7f1d08103990 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.583+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d081a8940 con 0x7f1d08103990 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.583+0000 7f1cff400640 1 -- 172.21.15.84:0/2449844322 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1cf80035f0 con 0x7f1d08103990 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.583+0000 7f1cff400640 1 -- 172.21.15.84:0/2449844322 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8010690 con 0x7f1d08103990 2024-09-21T02:44:04.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.583+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d081a8e50 con 0x7f1d08103990 2024-09-21T02:44:04.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.584+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d08103da0 con 0x7f1d08103990 2024-09-21T02:44:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.586+0000 7f1cff400640 1 -- 172.21.15.84:0/2449844322 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f1cf80037a0 con 0x7f1d08103990 2024-09-21T02:44:04.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.588+0000 7f1cff400640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1cec0b6510 0x7f1cec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:04.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.588+0000 7f1cff400640 1 -- 172.21.15.84:0/2449844322 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f1cf80e7b70 con 0x7f1d08103990 2024-09-21T02:44:04.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.588+0000 7f1d05e00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1cec0b6510 0x7f1cec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.589+0000 7f1d05e00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1cec0b6510 0x7f1cec0b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4005940 tx=0x7f1cf40058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.590+0000 7f1cff400640 1 -- 172.21.15.84:0/2449844322 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1cf8056710 con 0x7f1d08103990 2024-09-21T02:44:04.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.820+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d08076a10 con 0x7f1d08103990 2024-09-21T02:44:04.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.821+0000 7f1cff400640 1 -- 172.21.15.84:0/2449844322 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7f1d08076a10 con 0x7f1d08103990 2024-09-21T02:44:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:44:04.824 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"btime":"2024-09-21T02:42:38:701523+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:42:38.113687+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24679,24703,24704]},"id":1}]} 2024-09-21T02:44:04.824 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1cec0b6510 msgr2=0x7f1cec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1cec0b6510 0x7f1cec0b8a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4005940 tx=0x7f1cf40058d0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08103990 msgr2=0x7f1d08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08103990 0x7f1d08075710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800ea60 tx=0x7f1cf800ef20 comp rx=0 tx=0).stop 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 shutdown_connections 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d08109c20 0x7f1d08076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d081092d0 0x7f1d08075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f1cec0b6510 0x7f1cec0b8a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 --2- 172.21.15.84:0/2449844322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d08103990 0x7f1d08075710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 >> 172.21.15.84:0/2449844322 conn(0x7f1d080ff3e0 msgr2=0x7f1d08101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 shutdown_connections 2024-09-21T02:44:04.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:04.825+0000 7f1d0ca00640 1 -- 172.21.15.84:0/2449844322 wait complete. 2024-09-21T02:44:05.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:04 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2449844322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:05.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:04 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2449844322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:05.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:04 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2449844322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:05.357 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T02:44:05.508 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T02:44:05.574 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T02:44:05.577 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T02:44:05.577 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T02:44:05.643 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T02:44:05.651 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:44:05.651 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T02:44:05.686 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-21T02:44:05.688 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-21T02:44:05.688 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-21T02:44:05.778 INFO:tasks.workunit.client.0.smithi084.stderr:+ KERNEL=linux-4.0.5 2024-09-21T02:44:05.779 INFO:tasks.workunit.client.0.smithi084.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-21T02:44:05.877 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T02:44:05.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T02:44:06.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:05 smithi172 ceph-mon[35067]: pgmap v450: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:44:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:44:06.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:05 smithi084 ceph-mon[30747]: pgmap v450: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:44:06.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:05 smithi090 ceph-mon[34571]: pgmap v450: 129 pgs: 129 active+clean; 677 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T02:44:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 -- 172.21.15.84:0/1121079922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8109c20 msgr2=0x7f05f8110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 --2- 172.21.15.84:0/1121079922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8109c20 0x7f05f8110450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009ca0 tx=0x7f05f002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 -- 172.21.15.84:0/1121079922 shutdown_connections 2024-09-21T02:44:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 --2- 172.21.15.84:0/1121079922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8109c20 0x7f05f8110450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 --2- 172.21.15.84:0/1121079922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05f81092d0 0x7f05f81096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 --2- 172.21.15.84:0/1121079922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f8103990 0x7f05f8103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 -- 172.21.15.84:0/1121079922 >> 172.21.15.84:0/1121079922 conn(0x7f05f80ff3e0 msgr2=0x7f05f8101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:06.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 -- 172.21.15.84:0/1121079922 shutdown_connections 2024-09-21T02:44:06.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.945+0000 7f05fde00640 1 -- 172.21.15.84:0/1121079922 wait complete. 2024-09-21T02:44:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fde00640 1 Processor -- start 2024-09-21T02:44:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fde00640 1 -- start start 2024-09-21T02:44:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8103990 0x7f05f819c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fde00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f81092d0 0x7f05f819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fde00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05f8109c20 0x7f05f81a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fde00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f05f8113a20 con 0x7f05f8103990 2024-09-21T02:44:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fde00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81138a0 con 0x7f05f8109c20 2024-09-21T02:44:06.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fde00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05f8113ba0 con 0x7f05f81092d0 2024-09-21T02:44:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8103990 0x7f05f819c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8103990 0x7f05f819c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46106/0 (socket says 172.21.15.84:46106) 2024-09-21T02:44:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.947+0000 7f05fca00640 1 -- 172.21.15.84:0/2438598233 learned_addr learned my addr 172.21.15.84:0/2438598233 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05f7e00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f81092d0 0x7f05f819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05fd400640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05f8109c20 0x7f05f81a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05fca00640 1 -- 172.21.15.84:0/2438598233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f81092d0 msgr2=0x7f05f819cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05fca00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f81092d0 0x7f05f819cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05fca00640 1 -- 172.21.15.84:0/2438598233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05f8109c20 msgr2=0x7f05f81a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05fca00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05f8109c20 0x7f05f81a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05fca00640 1 -- 172.21.15.84:0/2438598233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f81a24e0 con 0x7f05f8103990 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05f7e00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f81092d0 0x7f05f819cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.948+0000 7f05fca00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8103990 0x7f05f819c570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00e9f0 tx=0x7f05ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.949+0000 7f05f5600640 1 -- 172.21.15.84:0/2438598233 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00cd80 con 0x7f05f8103990 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.949+0000 7f05f5600640 1 -- 172.21.15.84:0/2438598233 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f05ec0054f0 con 0x7f05f8103990 2024-09-21T02:44:06.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.949+0000 7f05fde00640 1 -- 172.21.15.84:0/2438598233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f81a27d0 con 0x7f05f8103990 2024-09-21T02:44:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.949+0000 7f05f5600640 1 -- 172.21.15.84:0/2438598233 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec010690 con 0x7f05f8103990 2024-09-21T02:44:06.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.949+0000 7f05fde00640 1 -- 172.21.15.84:0/2438598233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f81a8f30 con 0x7f05f8103990 2024-09-21T02:44:06.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.952+0000 7f060606c740 1 Processor -- start 2024-09-21T02:44:06.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.952+0000 7f060606c740 1 -- start start 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f05f5600640 1 -- 172.21.15.84:0/2438598233 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f05ec0046c0 con 0x7f05f8103990 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f060606c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdcba840 0x555cce062510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f060606c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdc91980 0x555cce062a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f060606c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce062f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f060606c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555ccdfd7ca0 con 0x555ccdc91980 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f060606c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555ccdfc70d0 con 0x555ccdcba840 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f060606c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555ccdfcaee0 con 0x555ccdc99b60 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f05fca00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdc91980 0x555cce062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f05fd400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdcba840 0x555cce062510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f05fd400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdcba840 0x555cce062510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:49866/0 (socket says 172.21.15.84:49866) 2024-09-21T02:44:06.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f05fd400640 1 -- 172.21.15.84:0/1333399932 learned_addr learned my addr 172.21.15.84:0/1333399932 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:06.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.953+0000 7f05f7e00640 1 --2- 172.21.15.84:0/1333399932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce062f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.954+0000 7f05fd400640 1 -- 172.21.15.84:0/1333399932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 msgr2=0x555cce062f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:06.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.954+0000 7f05fd400640 1 --2- 172.21.15.84:0/1333399932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce062f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.954+0000 7f05fd400640 1 -- 172.21.15.84:0/1333399932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdc91980 msgr2=0x555cce062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:06.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.954+0000 7f05fd400640 1 --2- 172.21.15.84:0/1333399932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdc91980 0x555cce062a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.954+0000 7f05fd400640 1 -- 172.21.15.84:0/1333399932 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ccdf79400 con 0x555ccdcba840 2024-09-21T02:44:06.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.954+0000 7f05fd400640 1 --2- 172.21.15.84:0/1333399932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdcba840 0x555cce062510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f05f002f410 tx=0x7f05f002f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a505def6b4cd4d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:06.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.954+0000 7f05e9c00640 1 -- 172.21.15.84:0/1333399932 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0031d40 con 0x555ccdcba840 2024-09-21T02:44:06.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.955+0000 7f05e9c00640 1 -- 172.21.15.84:0/1333399932 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f05f0036030 con 0x555ccdcba840 2024-09-21T02:44:06.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.955+0000 7f05e9c00640 1 -- 172.21.15.84:0/1333399932 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f00042a0 con 0x555ccdcba840 2024-09-21T02:44:06.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.955+0000 7f05f5600640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f05e00b6500 0x7f05e00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.955+0000 7f060606c740 1 -- 172.21.15.84:0/1333399932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdcba840 msgr2=0x555cce062510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:06.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.955+0000 7f060606c740 1 --2- 172.21.15.84:0/1333399932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdcba840 0x555cce062510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f05f002f410 tx=0x7f05f002f440 comp rx=0 tx=0).stop 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f060606c740 1 -- 172.21.15.84:0/1333399932 shutdown_connections 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f05f5600640 1 -- 172.21.15.84:0/2438598233 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f05ec0e7a70 con 0x7f05f8103990 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f060606c740 1 --2- 172.21.15.84:0/1333399932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce062f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f060606c740 1 --2- 172.21.15.84:0/1333399932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdc91980 0x555cce062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f060606c740 1 --2- 172.21.15.84:0/1333399932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdcba840 0x555cce062510 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f05fca00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f05e00b6500 0x7f05e00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f060606c740 1 -- 172.21.15.84:0/1333399932 >> 172.21.15.84:0/1333399932 conn(0x555ccdcae990 msgr2=0x555cce060400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f060606c740 1 -- 172.21.15.84:0/1333399932 shutdown_connections 2024-09-21T02:44:06.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f060606c740 1 -- 172.21.15.84:0/1333399932 wait complete. 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f05fca00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f05e00b6500 0x7f05e00b8a10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0a9de0 tx=0x7f05ec0a9040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.956+0000 7f060606c740 1 -- start start 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f060606c740 1 Processor -- start 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f060606c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 0x555cce06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f060606c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f060606c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce079e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f060606c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555ccde287a0 con 0x555ccdcba840 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f060606c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x555ccdf6ca10 con 0x555ccdc91980 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f060606c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555cce070b10 con 0x555ccdc99b60 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f060606c740 10 client.0 _ll_register_callbacks cb 0x555ccdf7cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:06.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.957+0000 7f05fd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce079e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05fd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce079e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46124/0 (socket says 172.21.15.84:46124) 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05fd400640 1 -- 172.21.15.84:0/3885961691 learned_addr learned my addr 172.21.15.84:0/3885961691 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05fd400640 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 0x555cce06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05f7e00640 1 -- 172.21.15.84:0/3885961691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 msgr2=0x555cce06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05f7e00640 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 0x555cce06dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05f7e00640 1 -- 172.21.15.84:0/3885961691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 msgr2=0x555cce079e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05f7e00640 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce079e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05f7e00640 1 -- 172.21.15.84:0/3885961691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ccdd34b90 con 0x555ccdc99b60 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05fd400640 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce079e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:06.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05f7e00640 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06e190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05f806c560 tx=0x7f05e400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5baf6ce748f00e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.958+0000 7f05de000640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.959+0000 7f05de000640 1 -- 172.21.15.84:0/3885961691 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4012110 con 0x555ccdc99b60 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.959+0000 7f05de000640 1 -- 172.21.15.84:0/3885961691 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f05e4004050 con 0x555ccdc99b60 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.959+0000 7f060606c740 1 -- 172.21.15.84:0/3885961691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f0036030 con 0x555ccdc99b60 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.959+0000 7f05de000640 1 -- 172.21.15.84:0/3885961691 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05e4025050 con 0x555ccdc99b60 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.959+0000 7f060606c740 10 client.25612 fetch_fsmap learned FSMap version 27 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.959+0000 7f060606c740 1 -- 172.21.15.84:0/3885961691 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cce07c850 con 0x555ccdc99b60 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.959+0000 7f05de000640 1 -- 172.21.15.84:0/3885961691 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f05f0036030 con 0x555ccdc99b60 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.960+0000 7f05de000640 1 -- 172.21.15.84:0/3885961691 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f05e4010430 con 0x555ccdc99b60 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.960+0000 7f060606c740 10 client.25612 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.960+0000 7f060606c740 10 client.25612 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.960+0000 7f060606c740 20 client.25612 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.960+0000 7f060606c740 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x555ccdc791c0 0x555cce07fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.960+0000 7f060606c740 4 client.25612 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:06.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.960+0000 7f060606c740 1 -- 172.21.15.84:0/3885961691 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ccdfd9bf0 con 0x555ccdc791c0 2024-09-21T02:44:06.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.960+0000 7f05fd400640 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x555ccdc791c0 0x555cce07fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.961+0000 7f05fd400640 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x555ccdc791c0 0x555cce07fda0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=933181d0e1bfdbf1 server_cookie=dd2e747a350bce47 in_seq=0 out_seq=0 2024-09-21T02:44:06.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.961+0000 7f05de000640 10 client.25612 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.961+0000 7f05de000640 1 -- 172.21.15.84:0/3885961691 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ccdfd9bf0 con 0x555ccdc791c0 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.961+0000 7f05de000640 10 client.25612 handle_command_reply: tid=0 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 client.25612 shutdown 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 -- 172.21.15.84:0/3885961691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 msgr2=0x555cce06e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06e190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05f806c560 tx=0x7f05e400f790 comp rx=0 tx=0).stop 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 -- 172.21.15.84:0/3885961691 shutdown_connections 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06e190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x555ccdc791c0 0x555cce07fda0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce079e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 --2- 172.21.15.84:0/3885961691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 0x555cce06dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 -- 172.21.15.84:0/3885961691 >> 172.21.15.84:0/3885961691 conn(0x555ccdcae990 msgr2=0x555cce0656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:06.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f05de000640 0 client.25612 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:06.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 -- 172.21.15.84:0/3885961691 shutdown_connections 2024-09-21T02:44:06.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 1 -- 172.21.15.84:0/3885961691 wait complete. 2024-09-21T02:44:06.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.962+0000 7f060606c740 20 client.25612 trim_cache size 0 max 16384 2024-09-21T02:44:06.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.980+0000 7f060606c740 1 Processor -- start 2024-09-21T02:44:06.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.980+0000 7f060606c740 1 -- start start 2024-09-21T02:44:06.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f060606c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 0x555cce079d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f060606c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f060606c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce06b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f060606c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b5440 con 0x555ccdcba840 2024-09-21T02:44:06.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f060606c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b2d10 con 0x555ccdc91980 2024-09-21T02:44:06.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f060606c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b0b60 con 0x555ccdc99b60 2024-09-21T02:44:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f05fd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f05fd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce06b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46130/0 (socket says 172.21.15.84:46130) 2024-09-21T02:44:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f05fd400640 1 -- 172.21.15.84:0/3265825649 learned_addr learned my addr 172.21.15.84:0/3265825649 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f05fd400640 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 0x555cce079d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.981+0000 7f05f7e00640 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05fd400640 1 -- 172.21.15.84:0/3265825649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 msgr2=0x555cce06ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05fd400640 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05fd400640 1 -- 172.21.15.84:0/3265825649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 msgr2=0x555cce079d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05fd400640 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 0x555cce079d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05fd400640 1 -- 172.21.15.84:0/3265825649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cce06e4e0 con 0x555ccdcba840 2024-09-21T02:44:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05fd400640 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce06b380 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f05f002f410 tx=0x7f05f002f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b131db05bbd442 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05e9200640 1 -- 172.21.15.84:0/3265825649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0031b40 con 0x555ccdcba840 2024-09-21T02:44:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05e9200640 1 -- 172.21.15.84:0/3265825649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f05f0036070 con 0x555ccdcba840 2024-09-21T02:44:06.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.982+0000 7f05e9200640 1 -- 172.21.15.84:0/3265825649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0004640 con 0x555ccdcba840 2024-09-21T02:44:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.983+0000 7f060606c740 1 -- 172.21.15.84:0/3265825649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 msgr2=0x555cce06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.983+0000 7f060606c740 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce06b380 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f05f002f410 tx=0x7f05f002f3a0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.983+0000 7f060606c740 1 -- 172.21.15.84:0/3265825649 shutdown_connections 2024-09-21T02:44:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.983+0000 7f060606c740 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc99b60 0x555cce06ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.983+0000 7f060606c740 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce06b380 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.983+0000 7f060606c740 1 --2- 172.21.15.84:0/3265825649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc91980 0x555cce079d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.983+0000 7f060606c740 1 -- 172.21.15.84:0/3265825649 >> 172.21.15.84:0/3265825649 conn(0x555ccdcae990 msgr2=0x555cce065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:06.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.983+0000 7f060606c740 1 -- 172.21.15.84:0/3265825649 shutdown_connections 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.984+0000 7f060606c740 1 -- 172.21.15.84:0/3265825649 wait complete. 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.984+0000 7f060606c740 1 -- start start 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.984+0000 7f060606c740 1 Processor -- start 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f060606c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc91980 0x555cce0738a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f060606c740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc99b60 0x555cce073e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f060606c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce0e1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f060606c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b11d0 con 0x555ccdcba840 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f060606c740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b2640 con 0x555ccdc99b60 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f060606c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05f81b18a0 con 0x555ccdc91980 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f060606c740 10 client.0 _ll_register_callbacks cb 0x7f05e4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:06.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05fd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce0e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc99b60 0x555cce073e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05f7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc99b60 0x555cce073e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:49896/0 (socket says 172.21.15.84:49896) 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05f7e00640 1 -- 172.21.15.84:0/454872602 learned_addr learned my addr 172.21.15.84:0/454872602 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05fd400640 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc91980 0x555cce0738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05f7e00640 1 -- 172.21.15.84:0/454872602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc91980 msgr2=0x555cce0738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05f7e00640 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc91980 0x555cce0738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05f7e00640 1 -- 172.21.15.84:0/454872602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 msgr2=0x555cce0e1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05f7e00640 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce0e1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.985+0000 7f05f7e00640 1 -- 172.21.15.84:0/454872602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cce0e1e00 con 0x555ccdc99b60 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.986+0000 7f05f7e00640 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc99b60 0x555cce073e80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f05e4010880 tx=0x7f05e4012340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc9007b2b5cdca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:06.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.986+0000 7f05de000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:44:06.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.986+0000 7f05de000640 1 -- 172.21.15.84:0/454872602 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4022040 con 0x555ccdc99b60 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.986+0000 7f060606c740 1 -- 172.21.15.84:0/454872602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f0036070 con 0x555ccdc99b60 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.986+0000 7f05de000640 1 -- 172.21.15.84:0/454872602 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f05e4010a70 con 0x555ccdc99b60 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.986+0000 7f05de000640 1 -- 172.21.15.84:0/454872602 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05e4039050 con 0x555ccdc99b60 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.986+0000 7f060606c740 10 client.25601 fetch_fsmap learned FSMap version 27 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.986+0000 7f060606c740 1 -- 172.21.15.84:0/454872602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cce0ea2e0 con 0x555ccdc99b60 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f05de000640 1 -- 172.21.15.84:0/454872602 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f05f0036070 con 0x555ccdc99b60 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f05de000640 1 -- 172.21.15.84:0/454872602 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f05e4003800 con 0x555ccdc99b60 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f060606c740 10 client.25601 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f060606c740 10 client.25601 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f060606c740 20 client.25601 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f060606c740 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x555ccdc4e570 0x555cce0ecb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:06.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f060606c740 4 client.25601 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T02:44:06.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f060606c740 1 -- 172.21.15.84:0/454872602 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x555ccdfd56a0 con 0x555ccdc4e570 2024-09-21T02:44:06.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.987+0000 7f05fd400640 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x555ccdc4e570 0x555cce0ecb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:06.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.988+0000 7f05fd400640 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x555ccdc4e570 0x555cce0ecb10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bf9e99178c56418 server_cookie=a71c64005563a09a in_seq=0 out_seq=0 2024-09-21T02:44:06.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.988+0000 7f05de000640 10 client.25601 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:07.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.999+0000 7f05de000640 1 -- 172.21.15.84:0/454872602 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555ccdfd56a0 con 0x555ccdc4e570 2024-09-21T02:44:07.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.999+0000 7f05de000640 10 client.25601 handle_command_reply: tid=0 2024-09-21T02:44:07.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:06.999+0000 7f060606c740 1 client.25601 shutdown 2024-09-21T02:44:07.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 -- 172.21.15.84:0/454872602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc99b60 msgr2=0x555cce073e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:07.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc99b60 0x555cce073e80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f05e4010880 tx=0x7f05e4012340 comp rx=0 tx=0).stop 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 -- 172.21.15.84:0/454872602 shutdown_connections 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x555ccdc4e570 0x555cce0ecb10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555ccdcba840 0x555cce0e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x555ccdc99b60 0x555cce073e80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 --2- 172.21.15.84:0/454872602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555ccdc91980 0x555cce0738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f05de000640 0 client.25601 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 -- 172.21.15.84:0/454872602 >> 172.21.15.84:0/454872602 conn(0x555ccdcae990 msgr2=0x555cce065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 -- 172.21.15.84:0/454872602 shutdown_connections 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 1 -- 172.21.15.84:0/454872602 wait complete. 2024-09-21T02:44:07.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.000+0000 7f060606c740 20 client.25601 trim_cache size 0 max 16384 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 27, 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 6, 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "edc6bc30": { 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 6, 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:44:07.003 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 137.0, 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:07.004 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:07.005 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:44:07.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 -- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f05e00b6500 msgr2=0x7f05e00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:07.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f05e00b6500 0x7f05e00b8a10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0a9de0 tx=0x7f05ec0a9040 comp rx=0 tx=0).stop 2024-09-21T02:44:07.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 -- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8103990 msgr2=0x7f05f819c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:07.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8103990 0x7f05f819c570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00e9f0 tx=0x7f05ec00edf0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 -- 172.21.15.84:0/2438598233 shutdown_connections 2024-09-21T02:44:07.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f05e00b6500 0x7f05e00b8a10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05f81092d0 0x7f05f819cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05f8109c20 0x7f05f81a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 --2- 172.21.15.84:0/2438598233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05f8103990 0x7f05f819c570 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:07.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 -- 172.21.15.84:0/2438598233 >> 172.21.15.84:0/2438598233 conn(0x7f05f80ff3e0 msgr2=0x7f05f81088a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:07.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 -- 172.21.15.84:0/2438598233 shutdown_connections 2024-09-21T02:44:07.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:07.001+0000 7f05fde00640 1 -- 172.21.15.84:0/2438598233 wait complete. 2024-09-21T02:44:07.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:07 smithi084 ceph-mon[30747]: pgmap v451: 129 pgs: 129 active+clean; 696 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-21T02:44:07.899 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'edc6bc30', quiesce took 4.6 seconds. Will release after: 12.4 2024-09-21T02:44:08.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:07 smithi172 ceph-mon[35067]: pgmap v451: 129 pgs: 129 active+clean; 696 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-21T02:44:08.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:07 smithi090 ceph-mon[34571]: pgmap v451: 129 pgs: 129 active+clean; 696 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-21T02:44:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:09 smithi172 ceph-mon[35067]: pgmap v452: 129 pgs: 129 active+clean; 696 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T02:44:10.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:09 smithi084 ceph-mon[30747]: pgmap v452: 129 pgs: 129 active+clean; 696 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T02:44:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:09 smithi090 ceph-mon[34571]: pgmap v452: 129 pgs: 129 active+clean; 696 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-09-21T02:44:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:11 smithi172 ceph-mon[35067]: pgmap v453: 129 pgs: 129 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 344 KiB/s wr, 8 op/s 2024-09-21T02:44:12.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:11 smithi084 ceph-mon[30747]: pgmap v453: 129 pgs: 129 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 344 KiB/s wr, 8 op/s 2024-09-21T02:44:12.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:11 smithi090 ceph-mon[34571]: pgmap v453: 129 pgs: 129 active+clean; 4.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 344 KiB/s wr, 8 op/s 2024-09-21T02:44:12.126 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 -- 172.21.15.84:0/1661057558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb700770f0 msgr2=0x7fbb700757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 --2- 172.21.15.84:0/1661057558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb700770f0 0x7fbb700757b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009900 tx=0x7fbb6002a400 comp rx=0 tx=0).stop 2024-09-21T02:44:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 -- 172.21.15.84:0/1661057558 shutdown_connections 2024-09-21T02:44:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 --2- 172.21.15.84:0/1661057558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb7010fe50 0x7fbb70112270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 --2- 172.21.15.84:0/1661057558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb70075cf0 0x7fbb70076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 --2- 172.21.15.84:0/1661057558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb700770f0 0x7fbb700757b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 -- 172.21.15.84:0/1661057558 >> 172.21.15.84:0/1661057558 conn(0x7fbb700ff030 msgr2=0x7fbb701014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 -- 172.21.15.84:0/1661057558 shutdown_connections 2024-09-21T02:44:12.127 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.125+0000 7fbb75200640 1 -- 172.21.15.84:0/1661057558 wait complete. 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.126+0000 7fbb75200640 1 Processor -- start 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.126+0000 7fbb75200640 1 -- start start 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb75200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb70075cf0 0x7fbb701a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb75200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb700770f0 0x7fbb701a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb75200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb7010fe50 0x7fbb701a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb75200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70115a40 con 0x7fbb700770f0 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb75200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701158c0 con 0x7fbb70075cf0 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb75200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70115bc0 con 0x7fbb7010fe50 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb70075cf0 0x7fbb701a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6de00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb70075cf0 0x7fbb701a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:39560/0 (socket says 172.21.15.84:39560) 2024-09-21T02:44:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6de00640 1 -- 172.21.15.84:0/3738837472 learned_addr learned my addr 172.21.15.84:0/3738837472 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6d400640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb700770f0 0x7fbb701a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6e800640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb7010fe50 0x7fbb701a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6de00640 1 -- 172.21.15.84:0/3738837472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb7010fe50 msgr2=0x7fbb701a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6de00640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb7010fe50 0x7fbb701a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6de00640 1 -- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb700770f0 msgr2=0x7fbb701a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6de00640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb700770f0 0x7fbb701a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.127+0000 7fbb6de00640 1 -- 172.21.15.84:0/3738837472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb701a2040 con 0x7fbb70075cf0 2024-09-21T02:44:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.128+0000 7fbb6de00640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb70075cf0 0x7fbb701a0670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb60004770 tx=0x7fbb600042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:12.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.128+0000 7fbb66a00640 1 -- 172.21.15.84:0/3738837472 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6003f030 con 0x7fbb70075cf0 2024-09-21T02:44:12.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.128+0000 7fbb75200640 1 -- 172.21.15.84:0/3738837472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb701a22d0 con 0x7fbb70075cf0 2024-09-21T02:44:12.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.128+0000 7fbb66a00640 1 -- 172.21.15.84:0/3738837472 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb60003cd0 con 0x7fbb70075cf0 2024-09-21T02:44:12.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.128+0000 7fbb66a00640 1 -- 172.21.15.84:0/3738837472 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60035070 con 0x7fbb70075cf0 2024-09-21T02:44:12.131 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.128+0000 7fbb75200640 1 -- 172.21.15.84:0/3738837472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb701a8a20 con 0x7fbb70075cf0 2024-09-21T02:44:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.131+0000 7fbb7c1d8740 1 Processor -- start 2024-09-21T02:44:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.131+0000 7fbb7c1d8740 1 -- start start 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f45171b0 0x5584f48be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44ee2f0 0x5584f48be740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48bf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5584f48316b0 con 0x5584f44ee2f0 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584f4820ae0 con 0x5584f45171b0 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5584f48248f0 con 0x5584f44f64d0 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb66a00640 1 -- 172.21.15.84:0/3738837472 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fbb60042030 con 0x7fbb70075cf0 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f45171b0 0x5584f48be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f45171b0 0x5584f48be0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:39570/0 (socket says 172.21.15.84:39570) 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6e800640 1 -- 172.21.15.84:0/2329050959 learned_addr learned my addr 172.21.15.84:0/2329050959 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6de00640 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44ee2f0 0x5584f48be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6d400640 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6e800640 1 -- 172.21.15.84:0/2329050959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 msgr2=0x5584f48bf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6e800640 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48bf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6e800640 1 -- 172.21.15.84:0/2329050959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44ee2f0 msgr2=0x5584f48be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6e800640 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44ee2f0 0x5584f48be740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6e800640 1 -- 172.21.15.84:0/2329050959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584f47ed780 con 0x5584f45171b0 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.132+0000 7fbb6de00640 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44ee2f0 0x5584f48be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.133+0000 7fbb6e800640 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f45171b0 0x5584f48be0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009fd0 tx=0x7fbb680118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af9b0fca9be9f15a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.133+0000 7fbb5b400640 1 -- 172.21.15.84:0/2329050959 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68004d20 con 0x5584f45171b0 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.133+0000 7fbb5b400640 1 -- 172.21.15.84:0/2329050959 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb68004050 con 0x5584f45171b0 2024-09-21T02:44:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.133+0000 7fbb5b400640 1 -- 172.21.15.84:0/2329050959 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68005220 con 0x5584f45171b0 2024-09-21T02:44:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb66a00640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb540b6510 0x7fbb540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2329050959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f45171b0 msgr2=0x5584f48be0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f45171b0 0x5584f48be0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009fd0 tx=0x7fbb680118d0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb66a00640 1 -- 172.21.15.84:0/3738837472 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fbb60107b70 con 0x7fbb70075cf0 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb6de00640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb540b6510 0x7fbb540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2329050959 shutdown_connections 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48bf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44ee2f0 0x5584f48be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2329050959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f45171b0 0x5584f48be0d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2329050959 >> 172.21.15.84:0/2329050959 conn(0x5584f450b300 msgr2=0x5584f48b9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2329050959 shutdown_connections 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.134+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2329050959 wait complete. 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb6de00640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb540b6510 0x7fbb540b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbb60006010 tx=0x7fbb6002a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 1 -- start start 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 1 Processor -- start 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.139 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44f64d0 0x5584f48c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f45171b0 0x5584f48c8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5584f4758ab0 con 0x5584f44f64d0 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5584f47c7570 con 0x5584f44ee2f0 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5584f48bfdb0 con 0x5584f45171b0 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.135+0000 7fbb7c1d8740 10 client.0 _ll_register_callbacks cb 0x5584f47d6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44f64d0 0x5584f48c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:39574/0 (socket says 172.21.15.84:39574) 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44f64d0 0x5584f48c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47182/0 (socket says 172.21.15.84:47182) 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6e800640 1 -- 172.21.15.84:0/1611072710 learned_addr learned my addr 172.21.15.84:0/1611072710 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6e800640 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f45171b0 0x5584f48c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6d400640 1 -- 172.21.15.84:0/1611072710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f45171b0 msgr2=0x5584f48c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6d400640 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f45171b0 0x5584f48c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6d400640 1 -- 172.21.15.84:0/1611072710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 msgr2=0x5584f48c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6d400640 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6d400640 1 -- 172.21.15.84:0/1611072710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584f4582790 con 0x5584f44f64d0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6e800640 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb6d400640 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44f64d0 0x5584f48c7df0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c012700 tx=0x7fbb5c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f68ae3fa56e86f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb4fe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb4fe00640 1 -- 172.21.15.84:0/1611072710 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c004050 con 0x5584f44f64d0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb4fe00640 1 -- 172.21.15.84:0/1611072710 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fbb5c0041f0 con 0x5584f44f64d0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.136+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/1611072710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb68004050 con 0x5584f44f64d0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb4fe00640 1 -- 172.21.15.84:0/1611072710 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb5c025050 con 0x5584f44f64d0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb7c1d8740 10 client.15588 fetch_fsmap learned FSMap version 27 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/1611072710 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5584f45fb620 con 0x5584f44f64d0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb4fe00640 1 -- 172.21.15.84:0/1611072710 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb68004050 con 0x5584f44f64d0 2024-09-21T02:44:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb4fe00640 1 -- 172.21.15.84:0/1611072710 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbb5c0039e0 con 0x5584f44f64d0 2024-09-21T02:44:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb7c1d8740 10 client.15588 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:44:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb7c1d8740 10 client.15588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb7c1d8740 20 client.15588 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5584f44d5d80 0x5584f48d4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb7c1d8740 4 client.15588 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.137+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/1611072710 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584f4833600 con 0x5584f44d5d80 2024-09-21T02:44:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.138+0000 7fbb6e800640 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5584f44d5d80 0x5584f48d4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.138+0000 7fbb6e800640 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5584f44d5d80 0x5584f48d4e30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c95c5bec7adf4a server_cookie=f7648ea0f8116d70 in_seq=0 out_seq=0 2024-09-21T02:44:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.138+0000 7fbb4fe00640 10 client.15588 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb4fe00640 1 -- 172.21.15.84:0/1611072710 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584f4833600 con 0x5584f44d5d80 2024-09-21T02:44:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb4fe00640 10 client.15588 handle_command_reply: tid=0 2024-09-21T02:44:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 client.15588 shutdown 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/1611072710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44f64d0 msgr2=0x5584f48c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44f64d0 0x5584f48c7df0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c012700 tx=0x7fbb5c012bc0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/1611072710 shutdown_connections 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f45171b0 0x5584f48c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5584f44d5d80 0x5584f48d4e30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f44f64d0 0x5584f48c7df0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/1611072710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/1611072710 >> 172.21.15.84:0/1611072710 conn(0x5584f450b300 msgr2=0x5584f48bf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb4fe00640 0 client.15588 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/1611072710 shutdown_connections 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/1611072710 wait complete. 2024-09-21T02:44:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.139+0000 7fbb7c1d8740 20 client.15588 trim_cache size 0 max 16384 2024-09-21T02:44:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.154+0000 7fbb7c1d8740 1 Processor -- start 2024-09-21T02:44:12.155 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.154+0000 7fbb7c1d8740 1 -- start start 2024-09-21T02:44:12.156 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701b5640 con 0x5584f45171b0 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701b2f10 con 0x5584f44ee2f0 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701b0d60 con 0x5584f44f64d0 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48b99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47198/0 (socket says 172.21.15.84:47198) 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 -- 172.21.15.84:0/3823022187 learned_addr learned my addr 172.21.15.84:0/3823022187 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6d400640 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 -- 172.21.15.84:0/3823022187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 msgr2=0x5584f48b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.157 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 -- 172.21.15.84:0/3823022187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 msgr2=0x5584f48c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.155+0000 7fbb6e800640 1 -- 172.21.15.84:0/3823022187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584f48bf5d0 con 0x5584f45171b0 2024-09-21T02:44:12.158 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.156+0000 7fbb6e800640 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48b99e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009340 tx=0x7fbb68005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaaf7db32425b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.156+0000 7fbb5aa00640 1 -- 172.21.15.84:0/3823022187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68005bd0 con 0x5584f45171b0 2024-09-21T02:44:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.156+0000 7fbb5aa00640 1 -- 172.21.15.84:0/3823022187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb68004520 con 0x5584f45171b0 2024-09-21T02:44:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.156+0000 7fbb5aa00640 1 -- 172.21.15.84:0/3823022187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb680286b0 con 0x5584f45171b0 2024-09-21T02:44:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/3823022187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 msgr2=0x5584f48b99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48b99e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009340 tx=0x7fbb68005fd0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/3823022187 shutdown_connections 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48b99e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/3823022187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/3823022187 >> 172.21.15.84:0/3823022187 conn(0x5584f450b300 msgr2=0x5584f48c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/3823022187 shutdown_connections 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/3823022187 wait complete. 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 -- start start 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.157+0000 7fbb7c1d8740 1 Processor -- start 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb7c1d8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701b13d0 con 0x5584f45171b0 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701b2840 con 0x5584f44ee2f0 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb7c1d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701b1aa0 con 0x5584f44f64d0 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb7c1d8740 10 client.0 _ll_register_callbacks cb 0x7fbb5c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47204/0 (socket says 172.21.15.84:47204) 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6e800640 1 -- 172.21.15.84:0/2266104264 learned_addr learned my addr 172.21.15.84:0/2266104264 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6d400640 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6e800640 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6d400640 1 -- 172.21.15.84:0/2266104264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 msgr2=0x5584f48cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6d400640 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6d400640 1 -- 172.21.15.84:0/2266104264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 msgr2=0x5584f48cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6d400640 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6d400640 1 -- 172.21.15.84:0/2266104264 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584f48cf820 con 0x5584f44f64d0 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.158+0000 7fbb6e800640 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.159+0000 7fbb6d400640 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48cb4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c003e30 tx=0x7fbb5c00fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d9524be5f0c129 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.159+0000 7fbb4fe00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.159+0000 7fbb4fe00640 1 -- 172.21.15.84:0/2266104264 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c009cd0 con 0x5584f44f64d0 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.159+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2266104264 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb68004520 con 0x5584f44f64d0 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.159+0000 7fbb4fe00640 1 -- 172.21.15.84:0/2266104264 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fbb5c022070 con 0x5584f44f64d0 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.159+0000 7fbb4fe00640 1 -- 172.21.15.84:0/2266104264 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbb5c03a050 con 0x5584f44f64d0 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.159+0000 7fbb7c1d8740 10 client.25636 fetch_fsmap learned FSMap version 27 2024-09-21T02:44:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.159+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2266104264 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5584f48ccc40 con 0x5584f44f64d0 2024-09-21T02:44:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb4fe00640 1 -- 172.21.15.84:0/2266104264 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb68004520 con 0x5584f44f64d0 2024-09-21T02:44:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb4fe00640 1 -- 172.21.15.84:0/2266104264 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbb5c003a00 con 0x5584f44f64d0 2024-09-21T02:44:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb7c1d8740 10 client.25636 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:44:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb7c1d8740 10 client.25636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb7c1d8740 20 client.25636 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5584f44ab1c0 0x5584f4941ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb7c1d8740 4 client.25636 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:44:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2266104264 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584f482f0b0 con 0x5584f44ab1c0 2024-09-21T02:44:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.160+0000 7fbb6e800640 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5584f44ab1c0 0x5584f4941ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.161+0000 7fbb4fe00640 10 client.25636 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.161+0000 7fbb6e800640 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5584f44ab1c0 0x5584f4941ec0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dfd23ded4882def server_cookie=4eb578ff9d610fb0 in_seq=0 out_seq=0 2024-09-21T02:44:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.169+0000 7fbb4fe00640 1 -- 172.21.15.84:0/2266104264 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584f482f0b0 con 0x5584f44ab1c0 2024-09-21T02:44:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.169+0000 7fbb4fe00640 10 client.25636 handle_command_reply: tid=0 2024-09-21T02:44:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.169+0000 7fbb7c1d8740 1 client.25636 shutdown 2024-09-21T02:44:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2266104264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 msgr2=0x5584f48cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48cb4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c003e30 tx=0x7fbb5c00fbd0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2266104264 shutdown_connections 2024-09-21T02:44:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5584f44f64d0 0x5584f48cb4d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5584f44ab1c0 0x5584f4941ec0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5584f45171b0 0x5584f48cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 --2- 172.21.15.84:0/2266104264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5584f44ee2f0 0x5584f48cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb4fe00640 0 client.25636 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2266104264 >> 172.21.15.84:0/2266104264 conn(0x5584f450b300 msgr2=0x5584f48b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2266104264 shutdown_connections 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 1 -- 172.21.15.84:0/2266104264 wait complete. 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.170+0000 7fbb7c1d8740 20 client.25636 trim_cache size 0 max 16384 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:44:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:44:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:44:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 -- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb540b6510 msgr2=0x7fbb540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb540b6510 0x7fbb540b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbb60006010 tx=0x7fbb6002a400 comp rx=0 tx=0).stop 2024-09-21T02:44:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 -- 172.21.15.84:0/3738837472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb70075cf0 msgr2=0x7fbb701a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb70075cf0 0x7fbb701a0670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb60004770 tx=0x7fbb600042f0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 -- 172.21.15.84:0/3738837472 shutdown_connections 2024-09-21T02:44:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fbb540b6510 0x7fbb540b8a20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb7010fe50 0x7fbb701a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb700770f0 0x7fbb701a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 --2- 172.21.15.84:0/3738837472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb70075cf0 0x7fbb701a0670 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 -- 172.21.15.84:0/3738837472 >> 172.21.15.84:0/3738837472 conn(0x7fbb700ff030 msgr2=0x7fbb700ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 -- 172.21.15.84:0/3738837472 shutdown_connections 2024-09-21T02:44:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:12.171+0000 7fbb75200640 1 -- 172.21.15.84:0/3738837472 wait complete. 2024-09-21T02:44:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:13 smithi172 ceph-mon[35067]: pgmap v454: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-09-21T02:44:14.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:13 smithi084 ceph-mon[30747]: pgmap v454: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-09-21T02:44:14.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:13 smithi090 ceph-mon[34571]: pgmap v454: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-09-21T02:44:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:15 smithi172 ceph-mon[35067]: pgmap v455: 129 pgs: 129 active+clean; 30 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 MiB/s wr, 8 op/s 2024-09-21T02:44:16.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:15 smithi084 ceph-mon[30747]: pgmap v455: 129 pgs: 129 active+clean; 30 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 MiB/s wr, 8 op/s 2024-09-21T02:44:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:15 smithi090 ceph-mon[34571]: pgmap v455: 129 pgs: 129 active+clean; 30 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 MiB/s wr, 8 op/s 2024-09-21T02:44:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:17 smithi172 ceph-mon[35067]: pgmap v456: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-21T02:44:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:17 smithi084 ceph-mon[30747]: pgmap v456: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-21T02:44:18.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:17 smithi090 ceph-mon[34571]: pgmap v456: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-21T02:44:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:19 smithi172 ceph-mon[35067]: pgmap v457: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-21T02:44:20.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:19 smithi084 ceph-mon[30747]: pgmap v457: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-21T02:44:20.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:19 smithi090 ceph-mon[34571]: pgmap v457: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.4 MiB/s wr, 9 op/s 2024-09-21T02:44:20.300 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:44:20.681 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:44:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 -- 172.21.15.84:0/1497709142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 msgr2=0x7f259810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 --2- 172.21.15.84:0/1497709142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 0x7f259810d870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2584009860 tx=0x7f258402a340 comp rx=0 tx=0).stop 2024-09-21T02:44:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 -- 172.21.15.84:0/1497709142 shutdown_connections 2024-09-21T02:44:21.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 --2- 172.21.15.84:0/1497709142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f259810de30 0x7f2598110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 --2- 172.21.15.84:0/1497709142 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 0x7f259810d870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 --2- 172.21.15.84:0/1497709142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25981049d0 0x7f2598104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 -- 172.21.15.84:0/1497709142 >> 172.21.15.84:0/1497709142 conn(0x7f2598079740 msgr2=0x7f2598079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 -- 172.21.15.84:0/1497709142 shutdown_connections 2024-09-21T02:44:21.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.325+0000 7f25a0600640 1 -- 172.21.15.84:0/1497709142 wait complete. 2024-09-21T02:44:21.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.326+0000 7f25a0600640 1 Processor -- start 2024-09-21T02:44:21.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f25a0600640 1 -- start start 2024-09-21T02:44:21.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f25a0600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25981049d0 0x7f259819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f25a0600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 0x7f259819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f25a0600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f259810de30 0x7f259819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f25a0600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2598113bb0 con 0x7f25981049d0 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f25a0600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2598113a30 con 0x7f2598105320 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f25a0600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2598113d30 con 0x7f259810de30 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f259dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25981049d0 0x7f259819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f259dc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25981049d0 0x7f259819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37432/0 (socket says 172.21.15.84:37432) 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f259dc00640 1 -- 172.21.15.84:0/4219280931 learned_addr learned my addr 172.21.15.84:0/4219280931 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f259d200640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 0x7f259819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.327+0000 7f259e600640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f259810de30 0x7f259819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.328+0000 7f259dc00640 1 -- 172.21.15.84:0/4219280931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f259810de30 msgr2=0x7f259819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.328+0000 7f259dc00640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f259810de30 0x7f259819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.328+0000 7f259dc00640 1 -- 172.21.15.84:0/4219280931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 msgr2=0x7f259819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.328+0000 7f259dc00640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 0x7f259819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.328+0000 7f259dc00640 1 -- 172.21.15.84:0/4219280931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25981a04f0 con 0x7f25981049d0 2024-09-21T02:44:21.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.328+0000 7f259d200640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 0x7f259819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:21.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.328+0000 7f259dc00640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25981049d0 0x7f259819a580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f258c00e9a0 tx=0x7f258c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:21.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.329+0000 7f2596000640 1 -- 172.21.15.84:0/4219280931 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c00cd80 con 0x7f25981049d0 2024-09-21T02:44:21.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.329+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25981a07e0 con 0x7f25981049d0 2024-09-21T02:44:21.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.329+0000 7f2596000640 1 -- 172.21.15.84:0/4219280931 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f258c010900 con 0x7f25981049d0 2024-09-21T02:44:21.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.329+0000 7f2596000640 1 -- 172.21.15.84:0/4219280931 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c018a80 con 0x7f25981049d0 2024-09-21T02:44:21.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.329+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25981a6f40 con 0x7f25981049d0 2024-09-21T02:44:21.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.330+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259806c240 con 0x7f25981049d0 2024-09-21T02:44:21.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.332+0000 7f2596000640 1 -- 172.21.15.84:0/4219280931 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f258c010ab0 con 0x7f25981049d0 2024-09-21T02:44:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.334+0000 7f2596000640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f25800b6510 0x7f25800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.334+0000 7f2596000640 1 -- 172.21.15.84:0/4219280931 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f258c0e7dc0 con 0x7f25981049d0 2024-09-21T02:44:21.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.334+0000 7f259d200640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f25800b6510 0x7f25800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:21.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.335+0000 7f259d200640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f25800b6510 0x7f25800b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2584005940 tx=0x7f25840058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:21.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.336+0000 7f2596000640 1 -- 172.21.15.84:0/4219280931 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f258c026020 con 0x7f25981049d0 2024-09-21T02:44:21.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.560+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2598104de0 con 0x7f25981049d0 2024-09-21T02:44:21.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.561+0000 7f2596000640 1 -- 172.21.15.84:0/4219280931 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11909 (secure 0 0 0) 0x7f258c0ae260 con 0x7f25981049d0 2024-09-21T02:44:21.562 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:44:21.562 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"btime":"2024-09-21T02:42:38:701523+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:42:38.113687+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24679,24703,24704]},"id":1}]} 2024-09-21T02:44:21.563 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f25800b6510 msgr2=0x7f25800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f25800b6510 0x7f25800b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2584005940 tx=0x7f25840058d0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25981049d0 msgr2=0x7f259819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25981049d0 0x7f259819a580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f258c00e9a0 tx=0x7f258c00ee60 comp rx=0 tx=0).stop 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 shutdown_connections 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f25800b6510 0x7f25800b8a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f259810de30 0x7f259819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2598105320 0x7f259819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 --2- 172.21.15.84:0/4219280931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25981049d0 0x7f259819a580 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 >> 172.21.15.84:0/4219280931 conn(0x7f2598079740 msgr2=0x7f25980ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.563+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 shutdown_connections 2024-09-21T02:44:21.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:21.564+0000 7f25a0600640 1 -- 172.21.15.84:0/4219280931 wait complete. 2024-09-21T02:44:21.974 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:21 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4219280931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:21 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4219280931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:22.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:21 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4219280931' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:22.446 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id edc6bc30 --release --await' 2024-09-21T02:44:22.446 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id edc6bc30 --release --await 2024-09-21T02:44:22.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:22 smithi084 ceph-mon[30747]: pgmap v458: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-21T02:44:22.816 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:44:23.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:22 smithi172 ceph-mon[35067]: pgmap v458: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-21T02:44:23.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:22 smithi090 ceph-mon[34571]: pgmap v458: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 MiB/s wr, 11 op/s 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 -- 172.21.15.84:0/2695895151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 msgr2=0x7fa99c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/2695895151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 0x7fa99c104de0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa990009ca0 tx=0x7fa99002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 -- 172.21.15.84:0/2695895151 shutdown_connections 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/2695895151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c105320 0x7fa99c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/2695895151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa99c10de30 0x7fa99c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/2695895151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 0x7fa99c104de0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 -- 172.21.15.84:0/2695895151 >> 172.21.15.84:0/2695895151 conn(0x7fa99c079740 msgr2=0x7fa99c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 -- 172.21.15.84:0/2695895151 shutdown_connections 2024-09-21T02:44:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.481+0000 7fa9a3e00640 1 -- 172.21.15.84:0/2695895151 wait complete. 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.482+0000 7fa9a3e00640 1 Processor -- start 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a3e00640 1 -- start start 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 0x7fa99c19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa99c105320 0x7fa99c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c10de30 0x7fa99c1a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c113bf0 con 0x7fa99c1049d0 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c113a70 con 0x7fa99c105320 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a3e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c113d70 con 0x7fa99c10de30 2024-09-21T02:44:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 0x7fa99c19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 0x7fa99c19c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37444/0 (socket says 172.21.15.84:37444) 2024-09-21T02:44:23.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a1400640 1 -- 172.21.15.84:0/3954167914 learned_addr learned my addr 172.21.15.84:0/3954167914 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:23.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.483+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c10de30 0x7fa99c1a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.484+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa99c105320 0x7fa99c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.484+0000 7fa9a1400640 1 -- 172.21.15.84:0/3954167914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c10de30 msgr2=0x7fa99c1a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.484+0000 7fa9a1400640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c10de30 0x7fa99c1a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.484+0000 7fa9a1400640 1 -- 172.21.15.84:0/3954167914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa99c105320 msgr2=0x7fa99c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.484+0000 7fa9a1400640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa99c105320 0x7fa99c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.484+0000 7fa9a1400640 1 -- 172.21.15.84:0/3954167914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99c1a2710 con 0x7fa99c1049d0 2024-09-21T02:44:23.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.484+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa99c105320 0x7fa99c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:23.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.484+0000 7fa9a1400640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 0x7fa99c19c7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa99002ade0 tx=0x7fa990003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:23.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.485+0000 7fa99a000640 1 -- 172.21.15.84:0/3954167914 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990031650 con 0x7fa99c1049d0 2024-09-21T02:44:23.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.485+0000 7fa99a000640 1 -- 172.21.15.84:0/3954167914 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9900317f0 con 0x7fa99c1049d0 2024-09-21T02:44:23.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.485+0000 7fa9a3e00640 1 -- 172.21.15.84:0/3954167914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99c1a29a0 con 0x7fa99c1049d0 2024-09-21T02:44:23.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.485+0000 7fa99a000640 1 -- 172.21.15.84:0/3954167914 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99002fa80 con 0x7fa99c1049d0 2024-09-21T02:44:23.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.485+0000 7fa9a3e00640 1 -- 172.21.15.84:0/3954167914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99c1a9160 con 0x7fa99c1049d0 2024-09-21T02:44:23.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.488+0000 7fa9aaa80740 1 Processor -- start 2024-09-21T02:44:23.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.488+0000 7fa9aaa80740 1 -- start start 2024-09-21T02:44:23.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.488+0000 7fa99a000640 1 -- 172.21.15.84:0/3954167914 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fa99002fc20 con 0x7fa99c1049d0 2024-09-21T02:44:23.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9211c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f921700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f921c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d29f898290 con 0x55d29f551660 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d29f8876c0 con 0x55d29f57a520 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d29f88b4d0 con 0x55d29f559840 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f921700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:50002/0 (socket says 172.21.15.84:50002) 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1e00640 1 -- 172.21.15.84:0/3684669846 learned_addr learned my addr 172.21.15.84:0/3684669846 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3684669846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f921c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1e00640 1 -- 172.21.15.84:0/3684669846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 msgr2=0x55d29f921c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/3684669846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f921c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1e00640 1 -- 172.21.15.84:0/3684669846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 msgr2=0x55d29f921700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/3684669846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f921700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.489+0000 7fa9a1e00640 1 -- 172.21.15.84:0/3684669846 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29f814460 con 0x55d29f57a520 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.490+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/3684669846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9211c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa994009ca0 tx=0x7fa994011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c1962ef9cf7c7da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.490+0000 7fa98e600640 1 -- 172.21.15.84:0/3684669846 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99401e070 con 0x55d29f57a520 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.490+0000 7fa98e600640 1 -- 172.21.15.84:0/3684669846 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa994009e50 con 0x55d29f57a520 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.490+0000 7fa98e600640 1 -- 172.21.15.84:0/3684669846 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99400ea40 con 0x55d29f57a520 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.490+0000 7fa99a000640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9840b6510 0x7fa9840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa9a1400640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9840b6510 0x7fa9840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa99a000640 1 -- 172.21.15.84:0/3954167914 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa990108830 con 0x7fa99c1049d0 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3684669846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 msgr2=0x55d29f9211c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3684669846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9211c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa994009ca0 tx=0x7fa994011810 comp rx=0 tx=0).stop 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa9a1400640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9840b6510 0x7fa9840b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa990004af0 tx=0x7fa99010e530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:23.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3684669846 shutdown_connections 2024-09-21T02:44:23.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3684669846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f921c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3684669846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f921700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.491+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3684669846 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9211c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.492+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3684669846 >> 172.21.15.84:0/3684669846 conn(0x55d29f56e910 msgr2=0x55d29f91f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:23.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.492+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3684669846 shutdown_connections 2024-09-21T02:44:23.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.492+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3684669846 wait complete. 2024-09-21T02:44:23.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.492+0000 7fa9aaa80740 1 -- start start 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9aaa80740 1 Processor -- start 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 0x55d29f92cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f559840 0x55d29f92d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f57a520 0x55d29f938cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d29f6e8bb0 con 0x55d29f57a520 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d29f8226c0 con 0x55d29f559840 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d29f92f9a0 con 0x55d29f551660 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9aaa80740 10 client.0 _ll_register_callbacks cb 0x55d29f83d490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9a1e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 0x55d29f92cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9a1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f57a520 0x55d29f938cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9a1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f57a520 0x55d29f938cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37462/0 (socket says 172.21.15.84:37462) 2024-09-21T02:44:23.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9a1e00640 1 -- 172.21.15.84:0/1937755033 learned_addr learned my addr 172.21.15.84:0/1937755033 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.493+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f559840 0x55d29f92d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa9a1e00640 1 -- 172.21.15.84:0/1937755033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 msgr2=0x55d29f92cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 0x55d29f92cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa9a1e00640 1 -- 172.21.15.84:0/1937755033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f559840 msgr2=0x55d29f92d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f559840 0x55d29f92d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa9a1e00640 1 -- 172.21.15.84:0/1937755033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29f5e5b00 con 0x55d29f57a520 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f57a520 0x55d29f938cc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55d29f92f380 tx=0x7fa994000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c33883b05c4752 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa982a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa982a00640 1 -- 172.21.15.84:0/1937755033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99401e040 con 0x55d29f57a520 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa9aaa80740 1 -- 172.21.15.84:0/1937755033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa994009e50 con 0x55d29f57a520 2024-09-21T02:44:23.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.494+0000 7fa982a00640 1 -- 172.21.15.84:0/1937755033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa99400ee20 con 0x55d29f57a520 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa982a00640 1 -- 172.21.15.84:0/1937755033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa9940316d0 con 0x55d29f57a520 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa9aaa80740 10 client.15612 fetch_fsmap learned FSMap version 27 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa9aaa80740 1 -- 172.21.15.84:0/1937755033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d29f65c960 con 0x55d29f57a520 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa982a00640 1 -- 172.21.15.84:0/1937755033 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa994009e50 con 0x55d29f57a520 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa982a00640 1 -- 172.21.15.84:0/1937755033 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa9940194c0 con 0x55d29f57a520 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa9aaa80740 10 client.15612 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa9aaa80740 10 client.15612 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa9aaa80740 20 client.15612 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d29f538ea0 0x55d29f93eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa9aaa80740 4 client.15612 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.495+0000 7fa9aaa80740 1 -- 172.21.15.84:0/1937755033 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d29f89a1e0 con 0x55d29f538ea0 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.496+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d29f538ea0 0x55d29f93eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.496+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d29f538ea0 0x55d29f93eb20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c1a545938c69d43 server_cookie=7bf85ad96c4956c7 in_seq=0 out_seq=0 2024-09-21T02:44:23.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.496+0000 7fa982a00640 10 client.15612 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:23.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.497+0000 7fa982a00640 1 -- 172.21.15.84:0/1937755033 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d29f89a1e0 con 0x55d29f538ea0 2024-09-21T02:44:23.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.497+0000 7fa982a00640 10 client.15612 handle_command_reply: tid=0 2024-09-21T02:44:23.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.497+0000 7fa9aaa80740 1 client.15612 shutdown 2024-09-21T02:44:23.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 -- 172.21.15.84:0/1937755033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f57a520 msgr2=0x55d29f938cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f57a520 0x55d29f938cc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55d29f92f380 tx=0x7fa994000bc0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 -- 172.21.15.84:0/1937755033 shutdown_connections 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d29f538ea0 0x55d29f93eb20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f57a520 0x55d29f938cc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f559840 0x55d29f92d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/1937755033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 0x55d29f92cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 -- 172.21.15.84:0/1937755033 >> 172.21.15.84:0/1937755033 conn(0x55d29f56e910 msgr2=0x55d29f924350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa982a00640 0 client.15612 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 -- 172.21.15.84:0/1937755033 shutdown_connections 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 1 -- 172.21.15.84:0/1937755033 wait complete. 2024-09-21T02:44:23.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.498+0000 7fa9aaa80740 20 client.15612 trim_cache size 0 max 16384 2024-09-21T02:44:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.516+0000 7fa9aaa80740 1 Processor -- start 2024-09-21T02:44:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.516+0000 7fa9aaa80740 1 -- start start 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.516+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f924930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.516+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f922bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.516+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f92e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.516+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c1b5750 con 0x55d29f551660 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.516+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c1b3020 con 0x55d29f57a520 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.516+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c1b0e70 con 0x55d29f559840 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f924930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a0a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f922bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f924930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37478/0 (socket says 172.21.15.84:37478) 2024-09-21T02:44:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a1e00640 1 -- 172.21.15.84:0/3696739002 learned_addr learned my addr 172.21.15.84:0/3696739002 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/3696739002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f92e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a0a00640 1 -- 172.21.15.84:0/3696739002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 msgr2=0x55d29f92e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3696739002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f92e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a0a00640 1 -- 172.21.15.84:0/3696739002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 msgr2=0x55d29f924930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3696739002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f924930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a0a00640 1 -- 172.21.15.84:0/3696739002 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29f9234b0 con 0x55d29f559840 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.517+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3696739002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f922bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55d29f93f0c0 tx=0x7fa988005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2aa95bb901d6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.518+0000 7fa98dc00640 1 -- 172.21.15.84:0/3696739002 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988003ca0 con 0x55d29f559840 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.518+0000 7fa98dc00640 1 -- 172.21.15.84:0/3696739002 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa988003e40 con 0x55d29f559840 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.518+0000 7fa98dc00640 1 -- 172.21.15.84:0/3696739002 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9880124f0 con 0x55d29f559840 2024-09-21T02:44:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.518+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3696739002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 msgr2=0x55d29f922bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.518+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3696739002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f922bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55d29f93f0c0 tx=0x7fa988005f90 comp rx=0 tx=0).stop 2024-09-21T02:44:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3696739002 shutdown_connections 2024-09-21T02:44:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3696739002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f559840 0x55d29f922bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3696739002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f92e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3696739002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f551660 0x55d29f924930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3696739002 >> 172.21.15.84:0/3696739002 conn(0x55d29f56e910 msgr2=0x55d29f92e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3696739002 shutdown_connections 2024-09-21T02:44:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3696739002 wait complete. 2024-09-21T02:44:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 -- start start 2024-09-21T02:44:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.519+0000 7fa9aaa80740 1 Processor -- start 2024-09-21T02:44:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 0x55d29f931390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f559840 0x55d29f9318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9aaa80740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9a8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c1b14e0 con 0x55d29f559840 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c1b2950 con 0x55d29f57a520 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9aaa80740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c1b1bb0 con 0x55d29f551660 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9aaa80740 10 client.0 _ll_register_callbacks cb 0x7fa99401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9a0a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f559840 0x55d29f9318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9a1e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9a0a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f559840 0x55d29f9318d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37494/0 (socket says 172.21.15.84:37494) 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9a0a00640 1 -- 172.21.15.84:0/3019435013 learned_addr learned my addr 172.21.15.84:0/3019435013 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.520+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 0x55d29f931390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa9a0a00640 1 -- 172.21.15.84:0/3019435013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 msgr2=0x55d29f931390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 0x55d29f931390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa9a0a00640 1 -- 172.21.15.84:0/3019435013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 msgr2=0x55d29f9a8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9a8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa9a0a00640 1 -- 172.21.15.84:0/3019435013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29f9a8910 con 0x55d29f559840 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa9a0a00640 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f559840 0x55d29f9318d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa9880096e0 tx=0x7fa988003bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17900346814e5fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa982a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa982a00640 1 -- 172.21.15.84:0/3019435013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988034060 con 0x55d29f559840 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa982a00640 1 -- 172.21.15.84:0/3019435013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa988004d70 con 0x55d29f559840 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.521+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3019435013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d29f895c90 con 0x55d29f559840 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa982a00640 1 -- 172.21.15.84:0/3019435013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa98803b050 con 0x55d29f559840 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa9aaa80740 10 client.15618 fetch_fsmap learned FSMap version 27 2024-09-21T02:44:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3019435013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d29f9a9bd0 con 0x55d29f559840 2024-09-21T02:44:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa982a00640 1 -- 172.21.15.84:0/3019435013 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55d29f895c90 con 0x55d29f559840 2024-09-21T02:44:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa982a00640 1 -- 172.21.15.84:0/3019435013 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa988023070 con 0x55d29f559840 2024-09-21T02:44:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa9aaa80740 10 client.15618 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:44:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa9aaa80740 10 client.15618 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:44:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa9aaa80740 20 client.15618 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d29f50e250 0x55d29f9ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa9aaa80740 4 client.15618 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "edc6bc30", "release": true, "await": true}] 2024-09-21T02:44:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.522+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3019435013 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "set_id": "edc6bc30", "release": true, "await": true}) -- 0x55d29f8930c0 con 0x55d29f50e250 2024-09-21T02:44:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.523+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d29f50e250 0x55d29f9ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.523+0000 7fa9a1e00640 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d29f50e250 0x55d29f9ac2e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faf3226474e53219 server_cookie=13397eca7a809b68 in_seq=0 out_seq=0 2024-09-21T02:44:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.523+0000 7fa982a00640 10 client.15618 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa982a00640 1 -- 172.21.15.84:0/3019435013 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d29f8930c0 con 0x55d29f50e250 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa982a00640 10 client.15618 handle_command_reply: tid=0 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 client.15618 shutdown 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3019435013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f559840 msgr2=0x55d29f9318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f559840 0x55d29f9318d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa9880096e0 tx=0x7fa988003bf0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3019435013 shutdown_connections 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d29f50e250 0x55d29f9ac2e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d29f57a520 0x55d29f9a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d29f559840 0x55d29f9318d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa982a00640 0 client.15618 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 --2- 172.21.15.84:0/3019435013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d29f551660 0x55d29f931390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.525+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3019435013 >> 172.21.15.84:0/3019435013 conn(0x55d29f56e910 msgr2=0x55d29f922920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.526+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3019435013 shutdown_connections 2024-09-21T02:44:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.526+0000 7fa9aaa80740 1 -- 172.21.15.84:0/3019435013 wait complete. 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.526+0000 7fa9aaa80740 20 client.15618 trim_cache size 0 max 16384 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 27, 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 8, 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stdout: "edc6bc30": { 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 8, 2024-09-21T02:44:23.530 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 137.0, 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:44:23.531 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:23.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:23.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:23.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:23.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:44:23.532 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:44:23.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.526+0000 7fa9a3e00640 1 -- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9840b6510 msgr2=0x7fa9840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.526+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9840b6510 0x7fa9840b8a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa990004af0 tx=0x7fa99010e530 comp rx=0 tx=0).stop 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.526+0000 7fa9a3e00640 1 -- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 msgr2=0x7fa99c19c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.526+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 0x7fa99c19c7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa99002ade0 tx=0x7fa990003c10 comp rx=0 tx=0).stop 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.527+0000 7fa9a3e00640 1 -- 172.21.15.84:0/3954167914 shutdown_connections 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.527+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9840b6510 0x7fa9840b8a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.527+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa99c10de30 0x7fa99c1a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.527+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa99c105320 0x7fa99c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.527+0000 7fa9a3e00640 1 --2- 172.21.15.84:0/3954167914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa99c1049d0 0x7fa99c19c7a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.527+0000 7fa9a3e00640 1 -- 172.21.15.84:0/3954167914 >> 172.21.15.84:0/3954167914 conn(0x7fa99c079740 msgr2=0x7fa99c1036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.527+0000 7fa9a3e00640 1 -- 172.21.15.84:0/3954167914 shutdown_connections 2024-09-21T02:44:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:23.527+0000 7fa9a3e00640 1 -- 172.21.15.84:0/3954167914 wait complete. 2024-09-21T02:44:24.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:23 smithi172 ceph-mon[35067]: pgmap v459: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 MiB/s wr, 8 op/s 2024-09-21T02:44:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:23 smithi084 ceph-mon[30747]: pgmap v459: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 MiB/s wr, 8 op/s 2024-09-21T02:44:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:23 smithi090 ceph-mon[34571]: pgmap v459: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 MiB/s wr, 8 op/s 2024-09-21T02:44:24.445 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'edc6bc30', total seconds elapsed: 21.1 2024-09-21T02:44:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 -- 172.21.15.84:0/4000265974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c104560 msgr2=0x7f914c104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 --2- 172.21.15.84:0/4000265974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c104560 0x7f914c104970 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f913c009860 tx=0x7f913c02a340 comp rx=0 tx=0).stop 2024-09-21T02:44:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 -- 172.21.15.84:0/4000265974 shutdown_connections 2024-09-21T02:44:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 --2- 172.21.15.84:0/4000265974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c104f00 0x7f914c10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 --2- 172.21.15.84:0/4000265974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c104560 0x7f914c104970 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 --2- 172.21.15.84:0/4000265974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f914c1034e0 0x7f914c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 -- 172.21.15.84:0/4000265974 >> 172.21.15.84:0/4000265974 conn(0x7f914c0fee20 msgr2=0x7f914c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 -- 172.21.15.84:0/4000265974 shutdown_connections 2024-09-21T02:44:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.363+0000 7f9153200640 1 -- 172.21.15.84:0/4000265974 wait complete. 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.364+0000 7f9153200640 1 Processor -- start 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.364+0000 7f9153200640 1 -- start start 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9153200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c1034e0 0x7f914c076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9153200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f914c104560 0x7f914c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9153200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c104f00 0x7f914c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9153200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f914c10f280 con 0x7f914c1034e0 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9153200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f914c10f100 con 0x7f914c104560 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9153200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f914c10f400 con 0x7f914c104f00 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c1034e0 0x7f914c076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c1034e0 0x7f914c076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37520/0 (socket says 172.21.15.84:37520) 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151e00640 1 -- 172.21.15.84:0/274184545 learned_addr learned my addr 172.21.15.84:0/274184545 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151400640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f914c104560 0x7f914c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9152800640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c104f00 0x7f914c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151e00640 1 -- 172.21.15.84:0/274184545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c104f00 msgr2=0x7f914c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151e00640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c104f00 0x7f914c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151e00640 1 -- 172.21.15.84:0/274184545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f914c104560 msgr2=0x7f914c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151e00640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f914c104560 0x7f914c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151e00640 1 -- 172.21.15.84:0/274184545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914c076380 con 0x7f914c1034e0 2024-09-21T02:44:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9151400640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f914c104560 0x7f914c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.365+0000 7f9152800640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c104f00 0x7f914c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:44:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.366+0000 7f9151e00640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c1034e0 0x7f914c076e50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f914000e9c0 tx=0x7f914000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.366+0000 7f9146a00640 1 -- 172.21.15.84:0/274184545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914000ccc0 con 0x7f914c1034e0 2024-09-21T02:44:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.366+0000 7f9146a00640 1 -- 172.21.15.84:0/274184545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91400054f0 con 0x7f914c1034e0 2024-09-21T02:44:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.366+0000 7f9153200640 1 -- 172.21.15.84:0/274184545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914c1a3eb0 con 0x7f914c1034e0 2024-09-21T02:44:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.366+0000 7f9146a00640 1 -- 172.21.15.84:0/274184545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9140010430 con 0x7f914c1034e0 2024-09-21T02:44:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.366+0000 7f9153200640 1 -- 172.21.15.84:0/274184545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f914c1a42c0 con 0x7f914c1034e0 2024-09-21T02:44:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.369+0000 7f915b9f1740 1 Processor -- start 2024-09-21T02:44:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.369+0000 7f915b9f1740 1 -- start start 2024-09-21T02:44:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.369+0000 7f9146a00640 1 -- 172.21.15.84:0/274184545 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f91400046c0 con 0x7f914c1034e0 2024-09-21T02:44:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.369+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735551b0 0x562f738fc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 0x562f738fc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f915b9f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562f7386f6b0 con 0x562f735344d0 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f915b9f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562f7385eae0 con 0x562f735551b0 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f915b9f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562f738628f0 con 0x562f7352c2f0 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9152800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735551b0 0x562f738fc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9152800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735551b0 0x562f738fc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:50044/0 (socket says 172.21.15.84:50044) 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9151400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9152800640 1 -- 172.21.15.84:0/4144536488 learned_addr learned my addr 172.21.15.84:0/4144536488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9151e00640 1 --2- 172.21.15.84:0/4144536488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 0x562f738fc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9152800640 1 -- 172.21.15.84:0/4144536488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 msgr2=0x562f738fc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9152800640 1 --2- 172.21.15.84:0/4144536488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 0x562f738fc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9152800640 1 -- 172.21.15.84:0/4144536488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 msgr2=0x562f738fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9152800640 1 --2- 172.21.15.84:0/4144536488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.373 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.370+0000 7f9152800640 1 -- 172.21.15.84:0/4144536488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f7382b780 con 0x562f735551b0 2024-09-21T02:44:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.371+0000 7f9152800640 1 --2- 172.21.15.84:0/4144536488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735551b0 0x562f738fc2b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9148009fd0 tx=0x7f91480108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=560018f368cd2fb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.371+0000 7f913b000640 1 -- 172.21.15.84:0/4144536488 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148011760 con 0x562f735551b0 2024-09-21T02:44:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.371+0000 7f913b000640 1 -- 172.21.15.84:0/4144536488 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9148011dd0 con 0x562f735551b0 2024-09-21T02:44:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.371+0000 7f913b000640 1 -- 172.21.15.84:0/4144536488 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914800e3c0 con 0x562f735551b0 2024-09-21T02:44:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.371+0000 7f9146a00640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f91340b6510 0x7f91340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.371+0000 7f9151e00640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f91340b6510 0x7f91340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f9146a00640 1 -- 172.21.15.84:0/274184545 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f91400e7ba0 con 0x7f914c1034e0 2024-09-21T02:44:25.375 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 -- 172.21.15.84:0/4144536488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735551b0 msgr2=0x562f738fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 --2- 172.21.15.84:0/4144536488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735551b0 0x562f738fc2b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9148009fd0 tx=0x7f91480108e0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f9151e00640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f91340b6510 0x7f91340b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91400ad640 tx=0x7f91400a9040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 -- 172.21.15.84:0/4144536488 shutdown_connections 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 --2- 172.21.15.84:0/4144536488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 0x562f738fc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 --2- 172.21.15.84:0/4144536488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 --2- 172.21.15.84:0/4144536488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735551b0 0x562f738fc2b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 -- 172.21.15.84:0/4144536488 >> 172.21.15.84:0/4144536488 conn(0x562f73549300 msgr2=0x562f738f7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 -- 172.21.15.84:0/4144536488 shutdown_connections 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.372+0000 7f915b9f1740 1 -- 172.21.15.84:0/4144536488 wait complete. 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.373+0000 7f915b9f1740 1 -- start start 2024-09-21T02:44:25.376 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.373+0000 7f915b9f1740 1 Processor -- start 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.373+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 0x562f73905950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.373+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735344d0 0x562f73906010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f73906b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f915b9f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562f73796ab0 con 0x562f735551b0 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f915b9f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x562f73805570 con 0x562f7352c2f0 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f915b9f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562f738fdf90 con 0x562f735344d0 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f915b9f1740 10 client.0 _ll_register_callbacks cb 0x562f73814100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9152800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f73906b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9151400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735344d0 0x562f73906010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9152800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f73906b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37538/0 (socket says 172.21.15.84:37538) 2024-09-21T02:44:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9152800640 1 -- 172.21.15.84:0/2785388516 learned_addr learned my addr 172.21.15.84:0/2785388516 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9152800640 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 0x562f73905950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9151400640 1 -- 172.21.15.84:0/2785388516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 msgr2=0x562f73905950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9151400640 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 0x562f73905950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9151400640 1 -- 172.21.15.84:0/2785388516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 msgr2=0x562f73906b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9151400640 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f73906b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9151400640 1 -- 172.21.15.84:0/2785388516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f735c0790 con 0x562f735344d0 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.374+0000 7f9152800640 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f73906b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.375+0000 7f9151400640 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735344d0 0x562f73906010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f913c005940 tx=0x7f913c005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b7f088dd4634c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.375+0000 7f912f400640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.375+0000 7f912f400640 1 -- 172.21.15.84:0/2785388516 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c037040 con 0x562f735344d0 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.375+0000 7f915b9f1740 1 -- 172.21.15.84:0/2785388516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9148011dd0 con 0x562f735344d0 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.375+0000 7f912f400640 1 -- 172.21.15.84:0/2785388516 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f913c004240 con 0x562f735344d0 2024-09-21T02:44:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.375+0000 7f912f400640 1 -- 172.21.15.84:0/2785388516 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f913c04b050 con 0x562f735344d0 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.375+0000 7f915b9f1740 10 client.25672 fetch_fsmap learned FSMap version 27 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.375+0000 7f915b9f1740 1 -- 172.21.15.84:0/2785388516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562f73639620 con 0x562f735344d0 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f912f400640 1 -- 172.21.15.84:0/2785388516 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9148011dd0 con 0x562f735344d0 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f912f400640 1 -- 172.21.15.84:0/2785388516 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f913c004990 con 0x562f735344d0 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f915b9f1740 10 client.25672 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f915b9f1740 10 client.25672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f915b9f1740 20 client.25672 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562f73513d80 0x562f739130c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f915b9f1740 4 client.25672 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f915b9f1740 1 -- 172.21.15.84:0/2785388516 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f73871600 con 0x562f73513d80 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.376+0000 7f9152800640 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562f73513d80 0x562f739130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.377+0000 7f9152800640 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562f73513d80 0x562f739130c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2274cddbbb1b7a97 server_cookie=7e909350912ed27c in_seq=0 out_seq=0 2024-09-21T02:44:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.377+0000 7f912f400640 10 client.25672 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f912f400640 1 -- 172.21.15.84:0/2785388516 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f73871600 con 0x562f73513d80 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f912f400640 10 client.25672 handle_command_reply: tid=0 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 client.25672 shutdown 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 -- 172.21.15.84:0/2785388516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735344d0 msgr2=0x562f73906010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735344d0 0x562f73906010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f913c005940 tx=0x7f913c005dd0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 -- 172.21.15.84:0/2785388516 shutdown_connections 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735344d0 0x562f73906010 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562f73513d80 0x562f739130c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f73906b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2785388516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 0x562f73905950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f912f400640 0 client.25672 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 -- 172.21.15.84:0/2785388516 >> 172.21.15.84:0/2785388516 conn(0x562f73549300 msgr2=0x562f738f6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 -- 172.21.15.84:0/2785388516 shutdown_connections 2024-09-21T02:44:25.383 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 1 -- 172.21.15.84:0/2785388516 wait complete. 2024-09-21T02:44:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.378+0000 7f915b9f1740 20 client.25672 trim_cache size 0 max 16384 2024-09-21T02:44:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f915b9f1740 1 Processor -- start 2024-09-21T02:44:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f915b9f1740 1 -- start start 2024-09-21T02:44:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 0x562f73906060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735551b0 0x562f738fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f915b9f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f914c1b1090 con 0x562f735344d0 2024-09-21T02:44:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f915b9f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f914c1ae960 con 0x562f7352c2f0 2024-09-21T02:44:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f915b9f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f914c1ac7b0 con 0x562f735551b0 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f9151400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f9151400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37542/0 (socket says 172.21.15.84:37542) 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f9151400640 1 -- 172.21.15.84:0/3204155028 learned_addr learned my addr 172.21.15.84:0/3204155028 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.394+0000 7f9152800640 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735551b0 0x562f738fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f9152800640 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 0x562f73906060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f9151400640 1 -- 172.21.15.84:0/3204155028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735551b0 msgr2=0x562f738fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f9151400640 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735551b0 0x562f738fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f9151400640 1 -- 172.21.15.84:0/3204155028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 msgr2=0x562f73906060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f9151400640 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 0x562f73906060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f9151400640 1 -- 172.21.15.84:0/3204155028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f73903ae0 con 0x562f735344d0 2024-09-21T02:44:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f9151400640 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fbea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f913c02d020 tx=0x7f913c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c1230c88c4322a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f913a600640 1 -- 172.21.15.84:0/3204155028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c054070 con 0x562f735344d0 2024-09-21T02:44:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f913a600640 1 -- 172.21.15.84:0/3204155028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f913c004fd0 con 0x562f735344d0 2024-09-21T02:44:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.395+0000 7f913a600640 1 -- 172.21.15.84:0/3204155028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c037040 con 0x562f735344d0 2024-09-21T02:44:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 -- 172.21.15.84:0/3204155028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 msgr2=0x562f738fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fbea0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f913c02d020 tx=0x7f913c001e70 comp rx=0 tx=0).stop 2024-09-21T02:44:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 -- 172.21.15.84:0/3204155028 shutdown_connections 2024-09-21T02:44:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f735551b0 0x562f738fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735344d0 0x562f738fbea0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 --2- 172.21.15.84:0/3204155028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f7352c2f0 0x562f73906060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 -- 172.21.15.84:0/3204155028 >> 172.21.15.84:0/3204155028 conn(0x562f73549300 msgr2=0x562f73905950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 -- 172.21.15.84:0/3204155028 shutdown_connections 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.396+0000 7f915b9f1740 1 -- 172.21.15.84:0/3204155028 wait complete. 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 1 -- start start 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 1 Processor -- start 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 0x562f7390d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735344d0 0x562f7390bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f7390c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f914c1ace20 con 0x562f735551b0 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f914c1ae290 con 0x562f735344d0 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f914c1ad4f0 con 0x562f7352c2f0 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.397+0000 7f915b9f1740 10 client.0 _ll_register_callbacks cb 0x7f91480093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 0x562f7390d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f7390c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9151400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735344d0 0x562f7390bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f7390c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37556/0 (socket says 172.21.15.84:37556) 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 -- 172.21.15.84:0/2159377401 learned_addr learned my addr 172.21.15.84:0/2159377401 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 -- 172.21.15.84:0/2159377401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 msgr2=0x562f7390d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 0x562f7390d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 -- 172.21.15.84:0/2159377401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735344d0 msgr2=0x562f7390bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735344d0 0x562f7390bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 -- 172.21.15.84:0/2159377401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f7390c810 con 0x562f735551b0 2024-09-21T02:44:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f9152800640 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f7390c250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9148006010 tx=0x7f9148005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32d9e42032e39a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f912f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:44:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.398+0000 7f912f400640 1 -- 172.21.15.84:0/2159377401 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148024040 con 0x562f735551b0 2024-09-21T02:44:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f912f400640 1 -- 172.21.15.84:0/2159377401 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f9148011a70 con 0x562f735551b0 2024-09-21T02:44:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 1 -- 172.21.15.84:0/2159377401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f913c004fd0 con 0x562f735551b0 2024-09-21T02:44:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f912f400640 1 -- 172.21.15.84:0/2159377401 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9148011c70 con 0x562f735551b0 2024-09-21T02:44:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 10 client.15636 fetch_fsmap learned FSMap version 27 2024-09-21T02:44:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 1 -- 172.21.15.84:0/2159377401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562f7390b6b0 con 0x562f735551b0 2024-09-21T02:44:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f912f400640 1 -- 172.21.15.84:0/2159377401 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f913c004fd0 con 0x562f735551b0 2024-09-21T02:44:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f912f400640 1 -- 172.21.15.84:0/2159377401 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f914802a040 con 0x562f735551b0 2024-09-21T02:44:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 10 client.15636 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T02:44:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 10 client.15636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 20 client.15636 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562f734e91c0 0x562f73980120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 4 client.15636 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:44:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.399+0000 7f915b9f1740 1 -- 172.21.15.84:0/2159377401 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f7386d0b0 con 0x562f734e91c0 2024-09-21T02:44:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.400+0000 7f9151400640 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562f734e91c0 0x562f73980120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.400+0000 7f912f400640 10 client.15636 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.400+0000 7f9151400640 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562f734e91c0 0x562f73980120 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=938a347d5ed1c7a9 server_cookie=6bdb87df03fe1a57 in_seq=0 out_seq=0 2024-09-21T02:44:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f912f400640 1 -- 172.21.15.84:0/2159377401 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f7386d0b0 con 0x562f734e91c0 2024-09-21T02:44:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f912f400640 10 client.15636 handle_command_reply: tid=0 2024-09-21T02:44:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 client.15636 shutdown 2024-09-21T02:44:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 -- 172.21.15.84:0/2159377401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 msgr2=0x562f7390c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f7390c250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9148006010 tx=0x7f9148005c30 comp rx=0 tx=0).stop 2024-09-21T02:44:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 -- 172.21.15.84:0/2159377401 shutdown_connections 2024-09-21T02:44:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x562f734e91c0 0x562f73980120 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f735551b0 0x562f7390c250 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x562f735344d0 0x562f7390bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f912f400640 0 client.15636 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 --2- 172.21.15.84:0/2159377401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f7352c2f0 0x562f7390d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.408+0000 7f915b9f1740 1 -- 172.21.15.84:0/2159377401 >> 172.21.15.84:0/2159377401 conn(0x562f73549300 msgr2=0x562f739003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f915b9f1740 1 -- 172.21.15.84:0/2159377401 shutdown_connections 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f915b9f1740 1 -- 172.21.15.84:0/2159377401 wait complete. 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f915b9f1740 20 client.15636 trim_cache size 0 max 16384 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:44:25.412 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:44:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:44:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 -- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f91340b6510 msgr2=0x7f91340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f91340b6510 0x7f91340b8a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f91400ad640 tx=0x7f91400a9040 comp rx=0 tx=0).stop 2024-09-21T02:44:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 -- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c1034e0 msgr2=0x7f914c076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c1034e0 0x7f914c076e50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f914000e9c0 tx=0x7f914000ee80 comp rx=0 tx=0).stop 2024-09-21T02:44:25.413 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 -- 172.21.15.84:0/274184545 shutdown_connections 2024-09-21T02:44:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f91340b6510 0x7f91340b8a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f914c104f00 0x7f914c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f914c104560 0x7f914c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 --2- 172.21.15.84:0/274184545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f914c1034e0 0x7f914c076e50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.409+0000 7f9153200640 1 -- 172.21.15.84:0/274184545 >> 172.21.15.84:0/274184545 conn(0x7f914c0fee20 msgr2=0x7f914c107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.410+0000 7f9153200640 1 -- 172.21.15.84:0/274184545 shutdown_connections 2024-09-21T02:44:25.414 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:25.410+0000 7f9153200640 1 -- 172.21.15.84:0/274184545 wait complete. 2024-09-21T02:44:26.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:25 smithi172 ceph-mon[35067]: pgmap v460: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-09-21T02:44:26.012 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:25 smithi084 ceph-mon[30747]: pgmap v460: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-09-21T02:44:26.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:25 smithi090 ceph-mon[34571]: pgmap v460: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 MiB/s wr, 8 op/s 2024-09-21T02:44:26.234 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir untar_tar 2024-09-21T02:44:26.237 INFO:tasks.workunit.client.0.smithi084.stderr:+ cd untar_tar 2024-09-21T02:44:26.239 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-21T02:44:26.265 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ 2024-09-21T02:44:26.268 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-21T02:44:26.269 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-21T02:44:26.270 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-21T02:44:26.272 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-21T02:44:26.273 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-21T02:44:26.274 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-21T02:44:26.276 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-21T02:44:26.277 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-21T02:44:26.278 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-21T02:44:26.280 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-21T02:44:26.281 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-21T02:44:26.282 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-21T02:44:26.284 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-21T02:44:26.285 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-21T02:44:26.287 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-21T02:44:26.288 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-21T02:44:26.289 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-21T02:44:26.291 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-21T02:44:26.292 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-21T02:44:26.294 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-21T02:44:26.295 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-21T02:44:26.296 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-21T02:44:26.298 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-21T02:44:26.299 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-21T02:44:26.301 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-21T02:44:26.302 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-21T02:44:26.303 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-21T02:44:26.304 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-21T02:44:26.306 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-21T02:44:26.307 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-21T02:44:26.309 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-21T02:44:26.310 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-21T02:44:26.311 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-21T02:44:26.312 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-21T02:44:26.314 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-21T02:44:26.315 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-21T02:44:26.316 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-21T02:44:26.318 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-21T02:44:26.319 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-21T02:44:26.320 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-21T02:44:26.322 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-21T02:44:26.323 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-21T02:44:26.324 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-21T02:44:26.326 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-21T02:44:26.327 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-21T02:44:26.328 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-21T02:44:26.330 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-21T02:44:26.331 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-21T02:44:26.333 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-21T02:44:26.334 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-21T02:44:26.335 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-21T02:44:26.336 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-21T02:44:26.338 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-21T02:44:26.339 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-21T02:44:26.340 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-21T02:44:26.341 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-21T02:44:26.343 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-21T02:44:26.344 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-21T02:44:26.345 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-21T02:44:26.347 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-21T02:44:26.348 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-21T02:44:26.349 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-21T02:44:26.350 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-21T02:44:26.352 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-21T02:44:26.353 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-21T02:44:26.354 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-21T02:44:26.355 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-21T02:44:26.357 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-21T02:44:26.358 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-21T02:44:26.359 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-21T02:44:26.360 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-21T02:44:26.362 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-21T02:44:26.363 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-21T02:44:26.364 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-21T02:44:26.366 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-21T02:44:26.367 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-21T02:44:26.368 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-21T02:44:26.369 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-21T02:44:26.371 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-21T02:44:26.372 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-21T02:44:26.373 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-21T02:44:26.374 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-21T02:44:26.375 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-21T02:44:26.377 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-21T02:44:26.378 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-21T02:44:26.379 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-21T02:44:26.380 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-21T02:44:26.381 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-21T02:44:26.382 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-21T02:44:26.384 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-21T02:44:26.385 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-21T02:44:26.386 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-21T02:44:26.387 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-21T02:44:26.388 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-21T02:44:26.390 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-21T02:44:26.391 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-21T02:44:26.392 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-21T02:44:26.393 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-21T02:44:26.395 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-21T02:44:26.396 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-21T02:44:26.397 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-21T02:44:26.399 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-21T02:44:26.400 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-21T02:44:26.402 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-21T02:44:26.403 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-21T02:44:26.404 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-21T02:44:26.405 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-21T02:44:26.406 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-21T02:44:26.408 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-21T02:44:26.409 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-21T02:44:26.410 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-21T02:44:26.412 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-21T02:44:26.413 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-21T02:44:26.414 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-21T02:44:26.415 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-21T02:44:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-21T02:44:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-21T02:44:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-21T02:44:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-21T02:44:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-21T02:44:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-21T02:44:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-21T02:44:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-21T02:44:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-21T02:44:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-21T02:44:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-21T02:44:26.430 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-21T02:44:26.431 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-21T02:44:26.432 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-21T02:44:26.434 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-21T02:44:26.435 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-21T02:44:26.436 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-21T02:44:26.437 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-21T02:44:26.439 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-21T02:44:26.440 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-21T02:44:26.441 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-21T02:44:26.442 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-21T02:44:26.443 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-21T02:44:26.445 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-21T02:44:26.446 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-21T02:44:26.447 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-21T02:44:26.448 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-21T02:44:26.449 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-21T02:44:26.450 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-21T02:44:26.451 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-21T02:44:26.452 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-21T02:44:26.454 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-21T02:44:26.455 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-21T02:44:26.456 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-21T02:44:26.457 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-21T02:44:26.458 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-21T02:44:26.459 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-21T02:44:26.461 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-21T02:44:26.462 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-21T02:44:26.463 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-21T02:44:26.464 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-21T02:44:26.465 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-21T02:44:26.467 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-21T02:44:26.468 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-21T02:44:26.469 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-21T02:44:26.470 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-21T02:44:26.471 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-21T02:44:26.473 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-21T02:44:26.474 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-21T02:44:26.475 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-21T02:44:26.476 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-21T02:44:26.478 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-21T02:44:26.479 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-21T02:44:26.480 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-21T02:44:26.481 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-21T02:44:26.483 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-21T02:44:26.484 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-21T02:44:26.485 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-21T02:44:26.487 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-21T02:44:26.488 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-21T02:44:26.489 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-21T02:44:26.490 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-21T02:44:26.492 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-21T02:44:26.493 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-21T02:44:26.494 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-21T02:44:26.496 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-21T02:44:26.497 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-21T02:44:26.498 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-21T02:44:26.499 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-21T02:44:26.501 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-21T02:44:26.502 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-21T02:44:26.503 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-21T02:44:26.504 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-21T02:44:26.506 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-21T02:44:26.507 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-21T02:44:26.508 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-21T02:44:26.510 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-21T02:44:26.511 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-21T02:44:26.513 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-21T02:44:26.514 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-21T02:44:26.514 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-21T02:44:26.516 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-21T02:44:26.517 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-21T02:44:28.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:27 smithi172 ceph-mon[35067]: pgmap v461: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T02:44:28.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:27 smithi084 ceph-mon[30747]: pgmap v461: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T02:44:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:27 smithi090 ceph-mon[34571]: pgmap v461: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T02:44:29.401 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-21T02:44:29.402 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-21T02:44:29.403 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-21T02:44:29.405 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-21T02:44:29.407 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-21T02:44:29.408 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-21T02:44:29.409 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-21T02:44:29.411 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-21T02:44:29.413 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-21T02:44:29.414 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-21T02:44:29.416 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-21T02:44:29.417 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-21T02:44:29.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-21T02:44:29.420 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-21T02:44:29.421 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-21T02:44:29.423 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-21T02:44:29.424 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-21T02:44:29.426 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-21T02:44:29.427 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-21T02:44:29.429 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-21T02:44:29.430 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-21T02:44:29.432 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-21T02:44:29.433 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-21T02:44:29.435 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-21T02:44:29.436 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-21T02:44:29.438 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-21T02:44:29.439 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-21T02:44:29.441 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-21T02:44:29.443 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-21T02:44:29.445 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-21T02:44:29.447 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-21T02:44:29.449 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-21T02:44:29.450 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-21T02:44:29.452 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-21T02:44:29.453 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-21T02:44:29.454 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-21T02:44:29.456 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-21T02:44:29.457 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-21T02:44:29.459 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-21T02:44:29.460 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-21T02:44:29.462 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-21T02:44:29.463 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-21T02:44:29.465 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-21T02:44:29.466 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-21T02:44:29.467 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-21T02:44:29.469 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-21T02:44:29.470 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-21T02:44:29.472 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-21T02:44:29.473 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-21T02:44:29.474 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-21T02:44:29.476 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-21T02:44:29.477 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-21T02:44:29.478 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-21T02:44:29.480 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-21T02:44:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-21T02:44:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-21T02:44:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-21T02:44:29.486 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-21T02:44:29.488 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-21T02:44:29.489 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-21T02:44:29.491 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-21T02:44:29.493 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-21T02:44:29.495 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-21T02:44:29.496 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/Changes 2024-09-21T02:44:29.498 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-21T02:44:29.500 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-21T02:44:29.502 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-21T02:44:29.504 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-21T02:44:29.506 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-21T02:44:29.508 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-21T02:44:29.509 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-21T02:44:29.511 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-21T02:44:29.513 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-21T02:44:29.514 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-21T02:44:29.516 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-21T02:44:29.518 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-21T02:44:29.520 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-21T02:44:29.522 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-21T02:44:29.524 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-21T02:44:29.526 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-21T02:44:29.529 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-21T02:44:29.530 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-21T02:44:29.532 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-21T02:44:29.534 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-21T02:44:29.536 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-21T02:44:29.538 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-21T02:44:29.539 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-21T02:44:29.541 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-21T02:44:29.543 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-21T02:44:29.545 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-21T02:44:29.547 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-21T02:44:29.548 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-21T02:44:29.550 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-21T02:44:29.552 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-21T02:44:29.553 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-21T02:44:29.555 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-21T02:44:29.557 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-21T02:44:29.559 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-21T02:44:29.560 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-21T02:44:29.562 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-21T02:44:29.564 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-21T02:44:29.566 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-21T02:44:29.567 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-21T02:44:29.569 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-21T02:44:29.571 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-21T02:44:29.573 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-21T02:44:29.575 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-21T02:44:29.577 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-21T02:44:29.579 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-21T02:44:29.581 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-21T02:44:29.582 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-21T02:44:29.584 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-21T02:44:29.586 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-21T02:44:29.587 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-21T02:44:29.589 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-21T02:44:29.591 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-21T02:44:29.593 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-21T02:44:29.594 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-21T02:44:29.596 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-21T02:44:29.598 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-21T02:44:29.600 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-21T02:44:29.602 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-21T02:44:29.604 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-21T02:44:29.608 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-21T02:44:29.609 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-21T02:44:29.611 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-21T02:44:29.613 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-21T02:44:29.615 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-21T02:44:29.616 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-21T02:44:29.618 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-21T02:44:29.620 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-21T02:44:29.622 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-21T02:44:29.624 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-21T02:44:29.626 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-21T02:44:29.628 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-21T02:44:29.629 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-21T02:44:29.631 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-21T02:44:29.633 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-21T02:44:29.635 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-21T02:44:29.637 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-21T02:44:29.638 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-21T02:44:29.640 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-21T02:44:29.642 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-21T02:44:29.644 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-21T02:44:29.645 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-21T02:44:29.647 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-21T02:44:29.649 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-21T02:44:29.651 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-21T02:44:29.653 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-21T02:44:29.654 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-21T02:44:29.656 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-21T02:44:29.657 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-21T02:44:29.658 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-21T02:44:29.660 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-21T02:44:29.661 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-21T02:44:29.662 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-21T02:44:29.664 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-21T02:44:29.665 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-21T02:44:29.666 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-21T02:44:29.667 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-21T02:44:29.669 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-21T02:44:29.670 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-21T02:44:29.671 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-21T02:44:29.673 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-21T02:44:29.674 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-21T02:44:29.675 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-21T02:44:29.677 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-21T02:44:29.678 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-21T02:44:29.679 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-21T02:44:29.681 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-21T02:44:29.683 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-21T02:44:29.684 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-21T02:44:29.685 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-21T02:44:29.686 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-21T02:44:29.688 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-21T02:44:29.689 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-21T02:44:29.691 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-21T02:44:29.692 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-21T02:44:29.693 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-21T02:44:29.694 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-21T02:44:29.696 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-21T02:44:29.697 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-21T02:44:29.698 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-21T02:44:29.700 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-21T02:44:29.701 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-21T02:44:29.702 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-21T02:44:29.703 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-21T02:44:29.704 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-21T02:44:29.706 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-21T02:44:29.707 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-21T02:44:29.708 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-21T02:44:29.710 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-21T02:44:29.711 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-21T02:44:29.712 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-21T02:44:29.714 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-21T02:44:29.715 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-21T02:44:29.716 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-21T02:44:29.717 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-21T02:44:29.718 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-21T02:44:29.720 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-21T02:44:29.722 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-21T02:44:29.723 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-21T02:44:29.725 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-21T02:44:29.727 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-21T02:44:29.728 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-21T02:44:29.730 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-21T02:44:29.731 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-21T02:44:29.732 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-21T02:44:29.733 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-21T02:44:29.734 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-21T02:44:29.736 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-21T02:44:29.737 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-21T02:44:29.738 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-21T02:44:29.739 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-21T02:44:29.740 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-21T02:44:29.742 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-21T02:44:29.743 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-21T02:44:29.745 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-21T02:44:29.746 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-21T02:44:29.747 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-21T02:44:29.749 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-21T02:44:29.750 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-21T02:44:29.751 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-21T02:44:29.753 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-21T02:44:29.754 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-21T02:44:29.755 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-21T02:44:29.756 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-21T02:44:29.758 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-21T02:44:29.759 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-21T02:44:29.761 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-21T02:44:29.762 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-21T02:44:29.763 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-21T02:44:29.765 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-21T02:44:29.766 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-21T02:44:29.767 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-21T02:44:29.769 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-21T02:44:29.770 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-21T02:44:29.771 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-21T02:44:29.773 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-21T02:44:29.774 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-21T02:44:29.775 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-21T02:44:29.777 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-21T02:44:29.778 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-21T02:44:29.779 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-21T02:44:29.780 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-21T02:44:29.782 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-21T02:44:29.783 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-21T02:44:29.784 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-21T02:44:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-21T02:44:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-21T02:44:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-21T02:44:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-21T02:44:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-21T02:44:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-21T02:44:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-21T02:44:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-21T02:44:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-21T02:44:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-21T02:44:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-21T02:44:29.799 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-21T02:44:29.802 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-21T02:44:29.802 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-21T02:44:29.803 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-21T02:44:29.804 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-21T02:44:29.806 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-21T02:44:29.807 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-21T02:44:29.808 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-21T02:44:29.809 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-21T02:44:29.811 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-21T02:44:30.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:29 smithi172 ceph-mon[35067]: pgmap v462: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T02:44:30.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:29 smithi084 ceph-mon[30747]: pgmap v462: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T02:44:30.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:29 smithi090 ceph-mon[34571]: pgmap v462: 129 pgs: 129 active+clean; 30 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-21T02:44:33.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:32 smithi172 ceph-mon[35067]: pgmap v463: 129 pgs: 129 active+clean; 30 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 KiB/s wr, 11 op/s 2024-09-21T02:44:33.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:32 smithi084 ceph-mon[30747]: pgmap v463: 129 pgs: 129 active+clean; 30 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 KiB/s wr, 11 op/s 2024-09-21T02:44:33.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:32 smithi090 ceph-mon[34571]: pgmap v463: 129 pgs: 129 active+clean; 30 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 KiB/s wr, 11 op/s 2024-09-21T02:44:34.452 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-21T02:44:34.453 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-21T02:44:34.454 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-21T02:44:34.456 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-21T02:44:34.457 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-21T02:44:34.458 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-21T02:44:34.460 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-21T02:44:34.461 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-21T02:44:34.462 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-21T02:44:34.463 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-21T02:44:34.464 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-21T02:44:34.466 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-21T02:44:34.467 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-21T02:44:34.468 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-21T02:44:34.469 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-21T02:44:34.471 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-21T02:44:34.472 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-21T02:44:34.473 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-21T02:44:34.475 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-21T02:44:34.477 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-21T02:44:34.478 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-21T02:44:34.479 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-21T02:44:34.480 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-21T02:44:34.481 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-21T02:44:34.483 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-21T02:44:34.484 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-21T02:44:34.485 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-21T02:44:34.486 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-21T02:44:34.488 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-21T02:44:34.489 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-21T02:44:34.490 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-21T02:44:34.494 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-21T02:44:34.495 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-21T02:44:34.497 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-21T02:44:34.498 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-21T02:44:34.500 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-21T02:44:34.501 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-21T02:44:34.502 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-21T02:44:34.505 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-21T02:44:34.505 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-21T02:44:34.506 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-21T02:44:34.507 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-21T02:44:34.508 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-21T02:44:34.509 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-21T02:44:34.510 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-21T02:44:34.511 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-21T02:44:34.513 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-21T02:44:34.514 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-21T02:44:34.515 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-21T02:44:34.517 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-21T02:44:34.518 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-21T02:44:34.519 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/Makefile 2024-09-21T02:44:34.520 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-21T02:44:34.522 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-21T02:44:34.523 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-21T02:44:34.524 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-21T02:44:34.525 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-21T02:44:34.527 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-21T02:44:34.528 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-21T02:44:34.529 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-21T02:44:34.530 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-21T02:44:34.531 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-21T02:44:34.533 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-21T02:44:34.534 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-21T02:44:34.535 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-21T02:44:34.536 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-21T02:44:34.537 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-21T02:44:34.539 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-21T02:44:34.540 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-21T02:44:34.541 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-21T02:44:34.542 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-21T02:44:34.546 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-21T02:44:34.547 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-21T02:44:34.548 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-21T02:44:34.549 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-21T02:44:34.550 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-21T02:44:34.551 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-21T02:44:34.552 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-21T02:44:34.554 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-21T02:44:34.555 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-21T02:44:34.556 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-21T02:44:34.557 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-21T02:44:34.558 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-21T02:44:34.559 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-21T02:44:34.560 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-21T02:44:34.562 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-21T02:44:34.563 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-21T02:44:34.564 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-21T02:44:34.566 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-21T02:44:34.567 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-21T02:44:34.568 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-21T02:44:34.569 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-21T02:44:34.570 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-21T02:44:34.571 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-21T02:44:34.572 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-21T02:44:34.573 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-21T02:44:34.575 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-21T02:44:34.576 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-21T02:44:34.577 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-21T02:44:34.578 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-21T02:44:34.579 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-21T02:44:34.580 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-21T02:44:34.581 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-21T02:44:34.582 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-21T02:44:34.584 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-21T02:44:34.585 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-21T02:44:34.586 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-21T02:44:34.587 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-21T02:44:34.588 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-21T02:44:34.589 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-21T02:44:34.591 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-21T02:44:34.592 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-21T02:44:34.593 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-21T02:44:34.594 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-21T02:44:34.596 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-21T02:44:34.597 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-21T02:44:34.598 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-21T02:44:34.599 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/ 2024-09-21T02:44:34.600 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-21T02:44:34.602 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-21T02:44:34.603 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-21T02:44:34.604 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-21T02:44:34.605 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-21T02:44:34.606 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-21T02:44:34.608 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-21T02:44:34.609 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-21T02:44:34.610 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-21T02:44:34.611 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-21T02:44:34.612 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-21T02:44:34.614 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-21T02:44:34.615 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-21T02:44:34.616 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-21T02:44:34.618 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-21T02:44:34.619 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/README 2024-09-21T02:44:34.620 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-21T02:44:34.622 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-21T02:44:34.623 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-21T02:44:34.624 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-21T02:44:34.625 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-21T02:44:34.626 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-21T02:44:34.628 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-21T02:44:34.629 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-21T02:44:34.631 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-21T02:44:34.632 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-21T02:44:34.633 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-21T02:44:34.635 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-21T02:44:34.636 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-21T02:44:34.637 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-21T02:44:34.638 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-21T02:44:34.640 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-21T02:44:34.641 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-21T02:44:34.642 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-21T02:44:34.644 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-21T02:44:34.645 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-21T02:44:34.646 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-21T02:44:34.647 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-21T02:44:34.648 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-21T02:44:34.649 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-21T02:44:34.651 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-21T02:44:34.652 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-21T02:44:34.653 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-21T02:44:34.654 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-21T02:44:34.655 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-21T02:44:34.656 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-21T02:44:34.657 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-21T02:44:34.658 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-21T02:44:34.659 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-21T02:44:34.660 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-21T02:44:34.662 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-21T02:44:34.663 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-21T02:44:34.664 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-21T02:44:34.666 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-21T02:44:34.667 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-21T02:44:34.668 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-21T02:44:34.670 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-21T02:44:34.672 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-21T02:44:34.673 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-21T02:44:34.675 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-21T02:44:34.677 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-21T02:44:34.678 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-21T02:44:34.679 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-21T02:44:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-21T02:44:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-21T02:44:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-21T02:44:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-21T02:44:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-21T02:44:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-21T02:44:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-21T02:44:34.689 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-21T02:44:34.690 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-21T02:44:34.691 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-21T02:44:34.692 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-21T02:44:34.693 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-21T02:44:34.694 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-21T02:44:34.695 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-21T02:44:34.697 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-21T02:44:34.698 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-21T02:44:34.699 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-21T02:44:34.700 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-21T02:44:34.701 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-21T02:44:34.702 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-21T02:44:34.703 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-21T02:44:34.704 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-21T02:44:34.705 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-21T02:44:34.706 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-21T02:44:34.707 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-21T02:44:34.708 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-21T02:44:34.709 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-21T02:44:34.710 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-21T02:44:34.712 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-21T02:44:34.713 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-21T02:44:34.714 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-21T02:44:34.715 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-21T02:44:34.716 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-21T02:44:34.718 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-21T02:44:34.719 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-21T02:44:34.721 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-21T02:44:34.722 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-21T02:44:34.723 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-21T02:44:34.724 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-21T02:44:34.725 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-21T02:44:34.726 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-21T02:44:35.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:34 smithi172 ceph-mon[35067]: pgmap v464: 129 pgs: 129 active+clean; 30 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 9 op/s 2024-09-21T02:44:35.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:34 smithi084 ceph-mon[30747]: pgmap v464: 129 pgs: 129 active+clean; 30 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 9 op/s 2024-09-21T02:44:35.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:34 smithi090 ceph-mon[34571]: pgmap v464: 129 pgs: 129 active+clean; 30 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 9 op/s 2024-09-21T02:44:36.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:35 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:36.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:35 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:36.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:35 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:37.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:36 smithi172 ceph-mon[35067]: pgmap v465: 129 pgs: 129 active+clean; 30 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 11 op/s 2024-09-21T02:44:37.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:36 smithi084 ceph-mon[30747]: pgmap v465: 129 pgs: 129 active+clean; 30 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 11 op/s 2024-09-21T02:44:37.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:36 smithi090 ceph-mon[34571]: pgmap v465: 129 pgs: 129 active+clean; 30 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 11 op/s 2024-09-21T02:44:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 -- 172.21.15.84:0/2725124801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3764104570 msgr2=0x7f3764104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 --2- 172.21.15.84:0/2725124801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3764104570 0x7f3764104980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3750009860 tx=0x7f375002a340 comp rx=0 tx=0).stop 2024-09-21T02:44:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 -- 172.21.15.84:0/2725124801 shutdown_connections 2024-09-21T02:44:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 --2- 172.21.15.84:0/2725124801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3764104f10 0x7f376410b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 --2- 172.21.15.84:0/2725124801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3764104570 0x7f3764104980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 --2- 172.21.15.84:0/2725124801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37641034f0 0x7f3764103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 -- 172.21.15.84:0/2725124801 >> 172.21.15.84:0/2725124801 conn(0x7f37640fee30 msgr2=0x7f37641012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 -- 172.21.15.84:0/2725124801 shutdown_connections 2024-09-21T02:44:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.608+0000 7f3763e00640 1 -- 172.21.15.84:0/2725124801 wait complete. 2024-09-21T02:44:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.609+0000 7f3763e00640 1 Processor -- start 2024-09-21T02:44:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.609+0000 7f3763e00640 1 -- start start 2024-09-21T02:44:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.609+0000 7f3763e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37641034f0 0x7f376419c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.609+0000 7f3763e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3764104570 0x7f376419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.609+0000 7f3763e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3764104f10 0x7f376419d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.609+0000 7f3763e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f376410f290 con 0x7f3764104570 2024-09-21T02:44:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.609+0000 7f3763e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f376410f110 con 0x7f3764104f10 2024-09-21T02:44:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.609+0000 7f3763e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f376410f410 con 0x7f37641034f0 2024-09-21T02:44:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3764104570 0x7f376419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.612 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3764104570 0x7f376419c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48112/0 (socket says 172.21.15.84:48112) 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 -- 172.21.15.84:0/3704898036 learned_addr learned my addr 172.21.15.84:0/3704898036 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762a00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37641034f0 0x7f376419c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3763400640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3764104f10 0x7f376419d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 -- 172.21.15.84:0/3704898036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37641034f0 msgr2=0x7f376419c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37641034f0 0x7f376419c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 -- 172.21.15.84:0/3704898036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3764104f10 msgr2=0x7f376419d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3764104f10 0x7f376419d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 -- 172.21.15.84:0/3704898036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376419daa0 con 0x7f3764104570 2024-09-21T02:44:38.614 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.610+0000 7f3762000640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3764104570 0x7f376419c6d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3750009980 tx=0x7f3750032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.611+0000 7f3768a00640 1 -- 172.21.15.84:0/3704898036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750037040 con 0x7f3764104570 2024-09-21T02:44:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.611+0000 7f3763e00640 1 -- 172.21.15.84:0/3704898036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376419dd30 con 0x7f3764104570 2024-09-21T02:44:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.611+0000 7f3768a00640 1 -- 172.21.15.84:0/3704898036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3750040070 con 0x7f3764104570 2024-09-21T02:44:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.611+0000 7f3763e00640 1 -- 172.21.15.84:0/3704898036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376419e040 con 0x7f3764104570 2024-09-21T02:44:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.611+0000 7f3768a00640 1 -- 172.21.15.84:0/3704898036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500037f0 con 0x7f3764104570 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.614+0000 7f3770ebc740 1 Processor -- start 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.614+0000 7f3770ebc740 1 -- start start 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e0f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e0f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a474d0 0x564d14e10470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3770ebc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564d14d826b0 con 0x564d14a3f2f0 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3770ebc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564d14d71ae0 con 0x564d14a681b0 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3770ebc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564d14d758f0 con 0x564d14a474d0 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3763400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e0f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3762a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e0f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3763400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e0f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:38890/0 (socket says 172.21.15.84:38890) 2024-09-21T02:44:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3763400640 1 -- 172.21.15.84:0/4073783997 learned_addr learned my addr 172.21.15.84:0/4073783997 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3768a00640 1 -- 172.21.15.84:0/3704898036 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f3750003990 con 0x7f3764104570 2024-09-21T02:44:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3763400640 1 -- 172.21.15.84:0/4073783997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a474d0 msgr2=0x564d14e10470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3763400640 1 --2- 172.21.15.84:0/4073783997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a474d0 0x564d14e10470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3763400640 1 -- 172.21.15.84:0/4073783997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 msgr2=0x564d14e0f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3763400640 1 --2- 172.21.15.84:0/4073783997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e0f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.615+0000 7f3763400640 1 -- 172.21.15.84:0/4073783997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d14d3e780 con 0x564d14a681b0 2024-09-21T02:44:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.616+0000 7f3763400640 1 --2- 172.21.15.84:0/4073783997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e0f2b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f375c009ca0 tx=0x7f375c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483538ea1b83824e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.616+0000 7f374fe00640 1 -- 172.21.15.84:0/4073783997 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c01e070 con 0x564d14a681b0 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.616+0000 7f374fe00640 1 -- 172.21.15.84:0/4073783997 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f375c009e50 con 0x564d14a681b0 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.616+0000 7f374fe00640 1 -- 172.21.15.84:0/4073783997 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c00ea50 con 0x564d14a681b0 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3768a00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37480b6510 0x7f37480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 -- 172.21.15.84:0/4073783997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 msgr2=0x564d14e0f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4073783997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e0f2b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f375c009ca0 tx=0x7f375c011810 comp rx=0 tx=0).stop 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 -- 172.21.15.84:0/4073783997 shutdown_connections 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4073783997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a474d0 0x564d14e10470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4073783997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e0f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4073783997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e0f2b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 -- 172.21.15.84:0/4073783997 >> 172.21.15.84:0/4073783997 conn(0x564d14a5c300 msgr2=0x564d14e0ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 -- 172.21.15.84:0/4073783997 shutdown_connections 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3768a00640 1 -- 172.21.15.84:0/3704898036 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f3750107240 con 0x7f3764104570 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 -- 172.21.15.84:0/4073783997 wait complete. 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3762a00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37480b6510 0x7f37480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.617+0000 7f3770ebc740 1 -- start start 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3762a00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37480b6510 0x7f37480b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3754005fd0 tx=0x7f3754010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3770ebc740 1 Processor -- start 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e18a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e190d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a681b0 0x564d14e19c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.622 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3770ebc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564d14ca9ab0 con 0x564d14a3f2f0 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3770ebc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x564d14d18570 con 0x564d14a474d0 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3770ebc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564d14e10f90 con 0x564d14a681b0 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3770ebc740 10 client.0 _ll_register_callbacks cb 0x564d14d27100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3762a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e18a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3762a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e18a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48120/0 (socket says 172.21.15.84:48120) 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3762a00640 1 -- 172.21.15.84:0/1205409851 learned_addr learned my addr 172.21.15.84:0/1205409851 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3763400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a681b0 0x564d14e19c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.618+0000 7f3762000640 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3762a00640 1 -- 172.21.15.84:0/1205409851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a681b0 msgr2=0x564d14e19c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3762a00640 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a681b0 0x564d14e19c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3762a00640 1 -- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 msgr2=0x564d14e190d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3762a00640 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e190d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3762a00640 1 -- 172.21.15.84:0/1205409851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d14ad3790 con 0x564d14a3f2f0 2024-09-21T02:44:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3763400640 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a681b0 0x564d14e19c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3762000640 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3762a00640 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e18a10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f375400dec0 tx=0x7f3754004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45daaac6969a3f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f374cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f374cc00640 1 -- 172.21.15.84:0/1205409851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754020040 con 0x564d14a3f2f0 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f3770ebc740 1 -- 172.21.15.84:0/1205409851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f375c009e50 con 0x564d14a3f2f0 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.619+0000 7f374cc00640 1 -- 172.21.15.84:0/1205409851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f3754024620 con 0x564d14a3f2f0 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f374cc00640 1 -- 172.21.15.84:0/1205409851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3754032050 con 0x564d14a3f2f0 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f3770ebc740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f3770ebc740 1 -- 172.21.15.84:0/1205409851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d14b4c620 con 0x564d14a3f2f0 2024-09-21T02:44:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f374cc00640 1 -- 172.21.15.84:0/1205409851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f375c009e50 con 0x564d14a3f2f0 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f374cc00640 1 -- 172.21.15.84:0/1205409851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f375400b040 con 0x564d14a3f2f0 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f3770ebc740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f3770ebc740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f3770ebc740 20 client.15648 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564d14a26d80 0x564d14e26250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f3770ebc740 4 client.15648 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.620+0000 7f3770ebc740 1 -- 172.21.15.84:0/1205409851 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d14d84600 con 0x564d14a26d80 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.621+0000 7f3762000640 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564d14a26d80 0x564d14e26250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.621+0000 7f374cc00640 10 client.15648 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.621+0000 7f3762000640 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564d14a26d80 0x564d14e26250 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36b057080b82fbb5 server_cookie=30139b8fee465c3d in_seq=0 out_seq=0 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.622+0000 7f374cc00640 1 -- 172.21.15.84:0/1205409851 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d14d84600 con 0x564d14a26d80 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.622+0000 7f374cc00640 10 client.15648 handle_command_reply: tid=0 2024-09-21T02:44:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.622+0000 7f3770ebc740 1 client.15648 shutdown 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 -- 172.21.15.84:0/1205409851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 msgr2=0x564d14e18a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e18a10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f375400dec0 tx=0x7f3754004a40 comp rx=0 tx=0).stop 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 -- 172.21.15.84:0/1205409851 shutdown_connections 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a681b0 0x564d14e19c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564d14a26d80 0x564d14e26250 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1205409851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a3f2f0 0x564d14e18a10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f374cc00640 0 client.15648 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 -- 172.21.15.84:0/1205409851 >> 172.21.15.84:0/1205409851 conn(0x564d14a5c300 msgr2=0x564d14e0ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 -- 172.21.15.84:0/1205409851 shutdown_connections 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 1 -- 172.21.15.84:0/1205409851 wait complete. 2024-09-21T02:44:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.623+0000 7f3770ebc740 20 client.15648 trim_cache size 0 max 16384 2024-09-21T02:44:38.641 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3770ebc740 1 Processor -- start 2024-09-21T02:44:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3770ebc740 1 -- start start 2024-09-21T02:44:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e17630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a474d0 0x564d14e17c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e09360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3770ebc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f37641b0fe0 con 0x564d14a474d0 2024-09-21T02:44:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3770ebc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37641ae8b0 con 0x564d14a681b0 2024-09-21T02:44:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3770ebc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37641ac700 con 0x564d14a3f2f0 2024-09-21T02:44:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3762000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a474d0 0x564d14e17c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3762000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a474d0 0x564d14e17c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48122/0 (socket says 172.21.15.84:48122) 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3762000640 1 -- 172.21.15.84:0/1090582745 learned_addr learned my addr 172.21.15.84:0/1090582745 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3763400640 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e09360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.638+0000 7f3762a00640 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e17630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f3762000640 1 -- 172.21.15.84:0/1090582745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 msgr2=0x564d14e17630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f3762000640 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e17630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f3762000640 1 -- 172.21.15.84:0/1090582745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 msgr2=0x564d14e09360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f3762000640 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e09360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f3762000640 1 -- 172.21.15.84:0/1090582745 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d14e16ba0 con 0x564d14a474d0 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f3762a00640 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e17630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f3763400640 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e09360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f3762000640 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a474d0 0x564d14e17c30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f37500ca250 tx=0x7f3750032860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc33022380d996ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f374f400640 1 -- 172.21.15.84:0/1090582745 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500cc750 con 0x564d14a474d0 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f374f400640 1 -- 172.21.15.84:0/1090582745 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3750030940 con 0x564d14a474d0 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.639+0000 7f374f400640 1 -- 172.21.15.84:0/1090582745 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500d6a00 con 0x564d14a474d0 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 -- 172.21.15.84:0/1090582745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a474d0 msgr2=0x564d14e17c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a474d0 0x564d14e17c30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f37500ca250 tx=0x7f3750032860 comp rx=0 tx=0).stop 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 -- 172.21.15.84:0/1090582745 shutdown_connections 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a681b0 0x564d14e09360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a474d0 0x564d14e17c30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.644 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 --2- 172.21.15.84:0/1090582745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e17630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 -- 172.21.15.84:0/1090582745 >> 172.21.15.84:0/1090582745 conn(0x564d14a5c300 msgr2=0x564d14e16f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 -- 172.21.15.84:0/1090582745 shutdown_connections 2024-09-21T02:44:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 -- 172.21.15.84:0/1090582745 wait complete. 2024-09-21T02:44:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.640+0000 7f3770ebc740 1 -- start start 2024-09-21T02:44:38.645 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3770ebc740 1 Processor -- start 2024-09-21T02:44:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e1f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e1fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3770ebc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a681b0 0x564d14e1e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3770ebc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f37641acd70 con 0x564d14a681b0 2024-09-21T02:44:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3770ebc740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37641ae1e0 con 0x564d14a474d0 2024-09-21T02:44:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3770ebc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37641ad440 con 0x564d14a3f2f0 2024-09-21T02:44:38.647 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3770ebc740 10 client.0 _ll_register_callbacks cb 0x7f375401d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3762000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e1fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3762000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e1fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:38922/0 (socket says 172.21.15.84:38922) 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3763400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a681b0 0x564d14e1e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3762000640 1 -- 172.21.15.84:0/4042502318 learned_addr learned my addr 172.21.15.84:0/4042502318 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.641+0000 7f3762a00640 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e1f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3762000640 1 -- 172.21.15.84:0/4042502318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 msgr2=0x564d14e1f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3762000640 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e1f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3762000640 1 -- 172.21.15.84:0/4042502318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a681b0 msgr2=0x564d14e1e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3762000640 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a681b0 0x564d14e1e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3762000640 1 -- 172.21.15.84:0/4042502318 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d14e1e840 con 0x564d14a474d0 2024-09-21T02:44:38.648 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3762000640 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e1fca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3750035040 tx=0x7f37500cceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd18e622e715b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f374cc00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f374cc00640 1 -- 172.21.15.84:0/4042502318 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750004040 con 0x564d14a474d0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3770ebc740 1 -- 172.21.15.84:0/4042502318 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d14d800b0 con 0x564d14a474d0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f374cc00640 1 -- 172.21.15.84:0/4042502318 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f37500b8170 con 0x564d14a474d0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f374cc00640 1 -- 172.21.15.84:0/4042502318 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37500d6a00 con 0x564d14a474d0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3770ebc740 10 client.25679 fetch_fsmap learned FSMap version 28 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.642+0000 7f3770ebc740 1 -- 172.21.15.84:0/4042502318 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564d14e913d0 con 0x564d14a474d0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f374cc00640 1 -- 172.21.15.84:0/4042502318 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x564d14d800b0 con 0x564d14a474d0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f374cc00640 1 -- 172.21.15.84:0/4042502318 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f375003a070 con 0x564d14a474d0 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f3770ebc740 10 client.25679 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f3770ebc740 10 client.25679 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f3770ebc740 20 client.25679 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:38.649 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564d149fc1c0 0x564d14e93d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f3770ebc740 4 client.25679 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:44:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f3770ebc740 1 -- 172.21.15.84:0/4042502318 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d14d7d4e0 con 0x564d149fc1c0 2024-09-21T02:44:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.643+0000 7f3762a00640 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564d149fc1c0 0x564d14e93d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.644+0000 7f374cc00640 10 client.25679 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:38.650 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:38.644+0000 7f3762a00640 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564d149fc1c0 0x564d14e93d40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8642bca0f5d33ecd server_cookie=661efb875fac7b04 in_seq=0 out_seq=0 2024-09-21T02:44:38.807 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-21T02:44:38.809 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-21T02:44:38.811 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-21T02:44:38.812 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-21T02:44:38.815 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-21T02:44:38.817 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-21T02:44:38.858 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-21T02:44:38.861 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-21T02:44:38.865 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-21T02:44:38.867 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-21T02:44:38.874 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-21T02:44:38.884 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/ 2024-09-21T02:44:38.887 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-21T02:44:38.889 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-21T02:44:38.893 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-21T02:44:38.900 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-21T02:44:38.904 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-21T02:44:38.913 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-21T02:44:38.917 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-21T02:44:38.920 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-21T02:44:38.923 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-21T02:44:38.926 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-21T02:44:38.928 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-21T02:44:38.930 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-21T02:44:38.934 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-21T02:44:38.936 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-21T02:44:38.939 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-21T02:44:38.947 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-21T02:44:38.950 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-21T02:44:38.952 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-21T02:44:38.957 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-21T02:44:38.959 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-21T02:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-21T02:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-21T02:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-21T02:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-21T02:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-21T02:44:38.981 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-21T02:44:38.983 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-21T02:44:38.986 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-21T02:44:38.989 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-21T02:44:38.990 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-21T02:44:38.992 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-21T02:44:38.994 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-21T02:44:38.996 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-21T02:44:38.997 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-21T02:44:38.999 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-21T02:44:39.001 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-21T02:44:39.003 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-21T02:44:39.005 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-21T02:44:39.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:38 smithi172 ceph-mon[35067]: pgmap v466: 129 pgs: 129 active+clean; 31 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 108 KiB/s wr, 13 op/s 2024-09-21T02:44:39.006 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-21T02:44:39.009 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-21T02:44:39.011 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-21T02:44:39.013 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-21T02:44:39.014 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-21T02:44:39.016 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-21T02:44:39.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:38 smithi090 ceph-mon[34571]: pgmap v466: 129 pgs: 129 active+clean; 31 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 108 KiB/s wr, 13 op/s 2024-09-21T02:44:39.018 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-21T02:44:39.019 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-21T02:44:39.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:38 smithi084 ceph-mon[30747]: pgmap v466: 129 pgs: 129 active+clean; 31 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 108 KiB/s wr, 13 op/s 2024-09-21T02:44:39.020 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-21T02:44:39.022 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-21T02:44:39.023 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-21T02:44:39.026 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-21T02:44:39.027 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-21T02:44:39.029 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-21T02:44:39.030 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-21T02:44:39.031 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-21T02:44:39.033 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-21T02:44:39.034 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-21T02:44:39.035 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-21T02:44:39.036 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-21T02:44:39.038 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-21T02:44:39.040 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-21T02:44:39.041 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-21T02:44:39.042 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-21T02:44:39.044 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-21T02:44:39.046 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-21T02:44:39.047 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-21T02:44:39.049 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/connector/ 2024-09-21T02:44:39.051 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-21T02:44:39.052 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-21T02:44:39.055 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-21T02:44:39.056 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-21T02:44:39.059 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-21T02:44:39.060 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/console/ 2024-09-21T02:44:39.075 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-21T02:44:39.086 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-21T02:44:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.086+0000 7f374cc00640 1 -- 172.21.15.84:0/4042502318 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d14d7d4e0 con 0x564d149fc1c0 2024-09-21T02:44:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.086+0000 7f374cc00640 10 client.25679 handle_command_reply: tid=0 2024-09-21T02:44:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.086+0000 7f3770ebc740 1 client.25679 shutdown 2024-09-21T02:44:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f3770ebc740 1 -- 172.21.15.84:0/4042502318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 msgr2=0x564d14e1fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e1fca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3750035040 tx=0x7f37500cceb0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f3770ebc740 1 -- 172.21.15.84:0/4042502318 shutdown_connections 2024-09-21T02:44:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x564d149fc1c0 0x564d14e93d40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564d14a681b0 0x564d14e1e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x564d14a474d0 0x564d14e1fca0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f3770ebc740 1 --2- 172.21.15.84:0/4042502318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d14a3f2f0 0x564d14e1f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f3770ebc740 1 -- 172.21.15.84:0/4042502318 >> 172.21.15.84:0/4042502318 conn(0x564d14a5c300 msgr2=0x564d14e133c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.087+0000 7f374cc00640 0 client.25679 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.088+0000 7f3770ebc740 1 -- 172.21.15.84:0/4042502318 shutdown_connections 2024-09-21T02:44:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.088+0000 7f3770ebc740 1 -- 172.21.15.84:0/4042502318 wait complete. 2024-09-21T02:44:39.090 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-21T02:44:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.088+0000 7f3770ebc740 20 client.25679 trim_cache size 0 max 16384 2024-09-21T02:44:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:44:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:44:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:44:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:44:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.090+0000 7f3763e00640 1 -- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37480b6510 msgr2=0x7f37480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.090+0000 7f3763e00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37480b6510 0x7f37480b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3754005fd0 tx=0x7f3754010040 comp rx=0 tx=0).stop 2024-09-21T02:44:39.091 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-21T02:44:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.090+0000 7f3763e00640 1 -- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3764104570 msgr2=0x7f376419c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.090+0000 7f3763e00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3764104570 0x7f376419c6d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3750009980 tx=0x7f3750032670 comp rx=0 tx=0).stop 2024-09-21T02:44:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.090+0000 7f3763e00640 1 -- 172.21.15.84:0/3704898036 shutdown_connections 2024-09-21T02:44:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.091+0000 7f3763e00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3764104f10 0x7f376419d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.091+0000 7f3763e00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3764104570 0x7f376419c6d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.091+0000 7f3763e00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f37480b6510 0x7f37480b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.091+0000 7f3763e00640 1 --2- 172.21.15.84:0/3704898036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37641034f0 0x7f376419c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.091+0000 7f3763e00640 1 -- 172.21.15.84:0/3704898036 >> 172.21.15.84:0/3704898036 conn(0x7f37640fee30 msgr2=0x7f37640755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.091+0000 7f3763e00640 1 -- 172.21.15.84:0/3704898036 shutdown_connections 2024-09-21T02:44:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:39.091+0000 7f3763e00640 1 -- 172.21.15.84:0/3704898036 wait complete. 2024-09-21T02:44:39.093 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-21T02:44:39.096 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-21T02:44:39.100 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-21T02:44:39.106 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-21T02:44:39.108 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-21T02:44:39.109 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-21T02:44:39.111 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-21T02:44:39.113 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-21T02:44:39.114 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-21T02:44:39.116 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-21T02:44:39.118 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-21T02:44:39.120 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-21T02:44:39.131 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-21T02:44:39.133 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-21T02:44:39.134 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-21T02:44:39.135 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-21T02:44:39.137 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-21T02:44:39.139 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-21T02:44:39.141 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cris/ 2024-09-21T02:44:39.147 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/cris/README 2024-09-21T02:44:39.151 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-21T02:44:39.168 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-21T02:44:39.171 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-21T02:44:39.175 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-21T02:44:39.178 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-21T02:44:39.188 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-21T02:44:39.214 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-21T02:44:39.260 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-21T02:44:39.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-21T02:44:39.571 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-21T02:44:39.577 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-21T02:44:39.583 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-21T02:44:39.585 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-21T02:44:39.587 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-21T02:44:39.589 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-21T02:44:39.590 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-21T02:44:39.592 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-21T02:44:39.594 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-21T02:44:39.597 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-21T02:44:39.600 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-21T02:44:39.605 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-21T02:44:39.607 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-21T02:44:39.610 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-21T02:44:39.613 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-21T02:44:39.616 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-21T02:44:39.618 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-21T02:44:39.620 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-21T02:44:39.622 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-21T02:44:39.624 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-21T02:44:39.626 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-21T02:44:39.628 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-21T02:44:39.630 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-21T02:44:39.631 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-21T02:44:39.632 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-21T02:44:39.633 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-21T02:44:39.637 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-21T02:44:39.638 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-21T02:44:39.638 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-21T02:44:39.639 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-21T02:44:39.641 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-21T02:44:39.642 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-21T02:44:39.644 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-21T02:44:39.645 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-21T02:44:39.647 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-21T02:44:39.650 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-21T02:44:39.651 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-21T02:44:39.652 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-21T02:44:39.654 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-21T02:44:39.655 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-21T02:44:39.656 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-21T02:44:39.657 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-21T02:44:39.659 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-21T02:44:39.660 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-21T02:44:39.662 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-21T02:44:39.664 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-21T02:44:39.669 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-21T02:44:39.672 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-21T02:44:39.676 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-21T02:44:39.677 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-21T02:44:39.679 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-21T02:44:39.680 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-21T02:44:39.681 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-21T02:44:39.683 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-21T02:44:39.685 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-21T02:44:39.687 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-21T02:44:39.689 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-21T02:44:39.693 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-21T02:44:39.698 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-21T02:44:39.700 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-21T02:44:39.704 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-21T02:44:39.716 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-21T02:44:39.718 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-21T02:44:39.722 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-21T02:44:39.724 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-21T02:44:39.727 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-21T02:44:39.730 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-21T02:44:39.733 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-21T02:44:39.736 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-21T02:44:39.737 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-21T02:44:39.740 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-21T02:44:39.742 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-21T02:44:39.743 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-21T02:44:39.745 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-21T02:44:39.747 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-21T02:44:39.750 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-21T02:44:39.752 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-21T02:44:39.753 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-21T02:44:39.755 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-21T02:44:39.757 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-21T02:44:39.759 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-21T02:44:39.762 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-21T02:44:39.764 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-21T02:44:39.766 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-21T02:44:39.768 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-21T02:44:39.769 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-21T02:44:39.774 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-21T02:44:39.776 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-21T02:44:39.778 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-21T02:44:39.780 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-21T02:44:39.782 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-21T02:44:39.783 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-21T02:44:39.787 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-21T02:44:39.788 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-21T02:44:39.791 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-21T02:44:39.792 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-21T02:44:39.794 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-21T02:44:39.798 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-21T02:44:39.798 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-21T02:44:39.800 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-21T02:44:39.802 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-21T02:44:39.804 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-21T02:44:39.805 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-21T02:44:39.807 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-21T02:44:39.810 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-21T02:44:39.811 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-21T02:44:39.813 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-21T02:44:39.814 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-21T02:44:39.830 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-21T02:44:39.852 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-21T02:44:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:40 smithi172 ceph-mon[35067]: pgmap v467: 129 pgs: 129 active+clean; 31 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 107 KiB/s wr, 10 op/s 2024-09-21T02:44:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:40 smithi084 ceph-mon[30747]: pgmap v467: 129 pgs: 129 active+clean; 31 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 107 KiB/s wr, 10 op/s 2024-09-21T02:44:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:40 smithi090 ceph-mon[34571]: pgmap v467: 129 pgs: 129 active+clean; 31 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 107 KiB/s wr, 10 op/s 2024-09-21T02:44:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:42 smithi172 ceph-mon[35067]: pgmap v468: 129 pgs: 129 active+clean; 82 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 4.4 MiB/s wr, 180 op/s 2024-09-21T02:44:43.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:42 smithi084 ceph-mon[30747]: pgmap v468: 129 pgs: 129 active+clean; 82 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 4.4 MiB/s wr, 180 op/s 2024-09-21T02:44:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:42 smithi090 ceph-mon[34571]: pgmap v468: 129 pgs: 129 active+clean; 82 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 4.4 MiB/s wr, 180 op/s 2024-09-21T02:44:44.385 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-21T02:44:44.386 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-21T02:44:44.388 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-21T02:44:44.389 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-21T02:44:44.391 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-21T02:44:44.392 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-21T02:44:44.393 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-21T02:44:44.395 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-21T02:44:44.396 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-21T02:44:44.397 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-21T02:44:44.399 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-21T02:44:44.400 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-21T02:44:44.402 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-21T02:44:44.403 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-21T02:44:44.405 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-21T02:44:44.406 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-21T02:44:44.407 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-21T02:44:44.409 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-21T02:44:44.410 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-21T02:44:44.412 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-21T02:44:44.413 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-21T02:44:44.415 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-21T02:44:44.416 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-21T02:44:44.417 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-21T02:44:44.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-21T02:44:44.420 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-21T02:44:44.421 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-21T02:44:44.423 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-21T02:44:44.424 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-21T02:44:44.426 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-21T02:44:44.427 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-21T02:44:44.429 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-21T02:44:44.431 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-21T02:44:44.434 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-21T02:44:44.435 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-21T02:44:44.437 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-21T02:44:44.439 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-21T02:44:44.441 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-21T02:44:44.443 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-21T02:44:44.444 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-21T02:44:44.447 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-21T02:44:44.448 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-21T02:44:44.450 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-21T02:44:44.452 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-21T02:44:44.454 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-21T02:44:44.455 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-21T02:44:44.457 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-21T02:44:44.458 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-21T02:44:44.459 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-21T02:44:44.461 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-21T02:44:44.462 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-21T02:44:44.464 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-21T02:44:44.465 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-21T02:44:44.467 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-21T02:44:44.469 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-21T02:44:44.470 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-21T02:44:44.471 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-21T02:44:44.473 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-21T02:44:44.474 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-21T02:44:44.476 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-21T02:44:44.477 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-21T02:44:44.479 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-21T02:44:44.480 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-21T02:44:44.482 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-21T02:44:44.483 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-21T02:44:44.484 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-21T02:44:44.486 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-21T02:44:44.487 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-21T02:44:44.488 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-21T02:44:44.490 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-21T02:44:44.491 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-21T02:44:44.493 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-21T02:44:44.494 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-21T02:44:44.495 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-21T02:44:44.497 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-21T02:44:44.498 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-21T02:44:44.500 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-21T02:44:44.501 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-21T02:44:44.503 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-21T02:44:44.504 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-21T02:44:44.506 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-21T02:44:44.507 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-21T02:44:44.508 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-21T02:44:44.510 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-21T02:44:44.511 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-21T02:44:44.512 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-21T02:44:44.514 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-21T02:44:44.515 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-21T02:44:44.517 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-21T02:44:44.518 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-21T02:44:44.519 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-21T02:44:44.520 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-21T02:44:44.522 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-21T02:44:44.523 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-21T02:44:44.524 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-21T02:44:44.525 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-21T02:44:44.527 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-21T02:44:44.528 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-21T02:44:44.529 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-21T02:44:44.530 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-21T02:44:44.532 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-21T02:44:44.533 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-21T02:44:44.535 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-21T02:44:44.536 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-21T02:44:44.538 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-21T02:44:44.539 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-21T02:44:44.540 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-21T02:44:44.541 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-21T02:44:44.543 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-21T02:44:44.544 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-21T02:44:44.546 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-21T02:44:44.547 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-21T02:44:44.548 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-21T02:44:44.549 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-21T02:44:44.550 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-21T02:44:44.551 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-21T02:44:44.553 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-21T02:44:44.554 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-21T02:44:44.555 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-21T02:44:44.556 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-21T02:44:44.557 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-21T02:44:44.559 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-21T02:44:44.560 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-21T02:44:44.561 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-21T02:44:44.562 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-21T02:44:44.563 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-21T02:44:44.565 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-21T02:44:44.566 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-21T02:44:44.567 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-21T02:44:44.568 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-21T02:44:44.569 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-21T02:44:44.570 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-21T02:44:44.572 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-21T02:44:44.573 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-21T02:44:44.575 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-21T02:44:44.576 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-21T02:44:44.577 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-21T02:44:44.578 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-21T02:44:44.579 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-21T02:44:44.580 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-21T02:44:44.582 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-21T02:44:44.583 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-21T02:44:44.584 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-21T02:44:44.585 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-21T02:44:44.586 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-21T02:44:44.587 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-21T02:44:44.588 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-21T02:44:44.589 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-21T02:44:44.591 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-21T02:44:44.592 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-21T02:44:44.593 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-21T02:44:44.594 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-21T02:44:44.595 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-21T02:44:44.596 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-21T02:44:44.597 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-21T02:44:44.598 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-21T02:44:44.600 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-21T02:44:44.601 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-21T02:44:44.602 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-21T02:44:44.603 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-21T02:44:44.604 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-21T02:44:44.634 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-21T02:44:44.653 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-21T02:44:44.680 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-21T02:44:44.725 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-21T02:44:44.726 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-21T02:44:44.728 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-21T02:44:44.729 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-21T02:44:44.730 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-21T02:44:44.731 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-21T02:44:44.732 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-21T02:44:44.733 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-21T02:44:44.735 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-21T02:44:44.736 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-21T02:44:44.737 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-21T02:44:44.738 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-21T02:44:44.740 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-21T02:44:44.741 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-21T02:44:44.742 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-21T02:44:44.743 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-21T02:44:44.745 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-21T02:44:44.746 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-21T02:44:44.747 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-21T02:44:44.748 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-21T02:44:44.750 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-21T02:44:44.751 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-21T02:44:44.752 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-21T02:44:44.754 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-21T02:44:44.755 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-21T02:44:44.756 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-21T02:44:44.757 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-21T02:44:44.758 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-21T02:44:44.759 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-21T02:44:44.760 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-21T02:44:44.761 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-21T02:44:44.763 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-21T02:44:44.764 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-21T02:44:44.765 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-21T02:44:44.766 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-21T02:44:44.768 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-21T02:44:44.769 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-21T02:44:44.771 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-21T02:44:44.772 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-21T02:44:44.774 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-21T02:44:44.775 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-21T02:44:44.777 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-21T02:44:44.778 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-21T02:44:44.779 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-21T02:44:44.780 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-21T02:44:44.782 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-21T02:44:44.783 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-21T02:44:44.785 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-21T02:44:44.786 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-21T02:44:44.787 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-21T02:44:44.788 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-21T02:44:44.790 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-21T02:44:44.791 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-21T02:44:44.792 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-21T02:44:44.793 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-21T02:44:44.794 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-21T02:44:44.795 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-21T02:44:44.797 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-21T02:44:44.798 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-21T02:44:44.800 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-21T02:44:44.801 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-21T02:44:44.803 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-21T02:44:44.804 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-21T02:44:44.806 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-21T02:44:44.807 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-21T02:44:44.808 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-21T02:44:44.810 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-21T02:44:44.811 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-21T02:44:44.812 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-21T02:44:44.813 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-21T02:44:44.815 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-21T02:44:44.817 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-21T02:44:44.819 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-21T02:44:44.821 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-21T02:44:44.823 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-21T02:44:44.825 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-21T02:44:44.827 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-21T02:44:44.829 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-21T02:44:44.831 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-21T02:44:44.833 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-21T02:44:44.834 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-21T02:44:44.836 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-21T02:44:44.838 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-21T02:44:44.840 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-21T02:44:44.842 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-21T02:44:44.843 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-21T02:44:44.845 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-21T02:44:44.847 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-21T02:44:44.849 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-21T02:44:44.851 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-21T02:44:44.853 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-21T02:44:44.854 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-21T02:44:44.856 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-21T02:44:44.858 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-21T02:44:44.860 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-21T02:44:44.862 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-21T02:44:44.863 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-21T02:44:44.864 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-21T02:44:44.866 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-21T02:44:44.867 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-21T02:44:44.868 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-21T02:44:44.869 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-21T02:44:44.871 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-21T02:44:44.872 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-21T02:44:44.874 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-21T02:44:44.875 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-21T02:44:44.877 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-21T02:44:44.878 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-21T02:44:44.880 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-21T02:44:44.881 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-21T02:44:44.883 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-21T02:44:44.885 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-21T02:44:44.886 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-21T02:44:44.888 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-21T02:44:44.890 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-21T02:44:44.891 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-21T02:44:44.893 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-21T02:44:44.894 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-21T02:44:44.896 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-21T02:44:44.898 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-21T02:44:44.899 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-21T02:44:44.901 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-21T02:44:44.902 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-21T02:44:44.904 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-21T02:44:44.906 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-21T02:44:44.908 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-21T02:44:44.910 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-21T02:44:44.912 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-21T02:44:44.913 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-21T02:44:44.915 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-21T02:44:44.917 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-21T02:44:44.919 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-21T02:44:44.921 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-21T02:44:44.922 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-21T02:44:44.924 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-21T02:44:44.925 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-21T02:44:44.927 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-21T02:44:44.929 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-21T02:44:44.930 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-21T02:44:44.932 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-21T02:44:44.933 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-21T02:44:44.934 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-21T02:44:44.935 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-21T02:44:44.936 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-21T02:44:44.938 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-21T02:44:44.939 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-21T02:44:44.941 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-21T02:44:44.942 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-21T02:44:44.943 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-21T02:44:44.944 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-21T02:44:44.946 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-21T02:44:44.947 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-21T02:44:44.948 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-21T02:44:44.950 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-21T02:44:44.951 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-21T02:44:44.952 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-21T02:44:44.953 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-21T02:44:44.954 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-21T02:44:44.956 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-21T02:44:44.957 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-21T02:44:44.958 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-21T02:44:44.960 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-21T02:44:44.962 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-21T02:44:44.963 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-21T02:44:44.964 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-21T02:44:44.966 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-21T02:44:44.967 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-21T02:44:44.968 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-21T02:44:44.970 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-21T02:44:44.971 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-21T02:44:44.972 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-21T02:44:44.974 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-21T02:44:44.976 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-21T02:44:44.977 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-21T02:44:44.978 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-21T02:44:44.981 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-21T02:44:44.983 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-21T02:44:44.984 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-21T02:44:44.986 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-21T02:44:44.988 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-21T02:44:44.990 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-21T02:44:44.992 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-21T02:44:44.993 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-21T02:44:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-21T02:44:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-21T02:44:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-21T02:44:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-21T02:44:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-21T02:44:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-21T02:44:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-21T02:44:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-21T02:44:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-21T02:44:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-21T02:44:45.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:44 smithi172 ceph-mon[35067]: pgmap v469: 129 pgs: 129 active+clean; 87 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 4.8 MiB/s wr, 244 op/s 2024-09-21T02:44:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-21T02:44:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-21T02:44:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-21T02:44:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-21T02:44:45.011 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-21T02:44:45.013 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-21T02:44:45.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:44 smithi084 ceph-mon[30747]: pgmap v469: 129 pgs: 129 active+clean; 87 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 4.8 MiB/s wr, 244 op/s 2024-09-21T02:44:45.014 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-21T02:44:45.015 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-21T02:44:45.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:44 smithi090 ceph-mon[34571]: pgmap v469: 129 pgs: 129 active+clean; 87 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 4.8 MiB/s wr, 244 op/s 2024-09-21T02:44:45.017 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-21T02:44:45.018 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-21T02:44:45.020 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-21T02:44:45.021 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-21T02:44:45.022 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-21T02:44:45.024 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-21T02:44:45.025 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-21T02:44:45.027 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-21T02:44:45.028 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-21T02:44:45.029 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-21T02:44:45.031 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-21T02:44:45.032 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-21T02:44:45.034 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-21T02:44:45.035 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-21T02:44:45.037 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-21T02:44:45.038 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-21T02:44:45.040 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-21T02:44:45.042 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-21T02:44:45.043 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-21T02:44:45.045 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-21T02:44:45.047 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-21T02:44:45.049 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-21T02:44:45.050 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-21T02:44:45.052 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-21T02:44:45.054 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-21T02:44:45.055 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-21T02:44:45.057 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-21T02:44:45.059 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-21T02:44:45.060 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-21T02:44:45.062 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-21T02:44:45.064 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-21T02:44:45.066 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-21T02:44:45.068 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-21T02:44:45.069 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-21T02:44:45.071 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-21T02:44:45.073 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-21T02:44:45.075 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-21T02:44:45.077 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-21T02:44:45.078 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-21T02:44:45.081 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-21T02:44:45.082 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-21T02:44:45.084 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-21T02:44:45.085 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-21T02:44:45.087 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-21T02:44:45.089 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-21T02:44:45.091 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-21T02:44:45.092 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-21T02:44:45.094 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-21T02:44:45.096 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-21T02:44:45.098 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-21T02:44:45.100 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-21T02:44:45.102 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-21T02:44:45.104 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-21T02:44:45.105 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-21T02:44:45.107 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-21T02:44:45.109 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-21T02:44:45.110 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-21T02:44:45.112 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-21T02:44:45.114 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-21T02:44:45.115 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-21T02:44:45.117 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-21T02:44:45.119 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-21T02:44:45.121 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-21T02:44:45.123 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-21T02:44:45.124 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-21T02:44:45.126 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-21T02:44:45.128 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-21T02:44:45.129 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-21T02:44:45.131 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-21T02:44:45.133 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-21T02:44:45.135 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-21T02:44:45.137 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-21T02:44:45.138 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-21T02:44:45.140 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-21T02:44:45.142 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-21T02:44:45.144 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-21T02:44:45.146 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-21T02:44:45.148 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-21T02:44:45.150 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-21T02:44:45.152 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-21T02:44:45.154 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-21T02:44:45.156 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-21T02:44:45.158 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-21T02:44:45.160 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-21T02:44:45.162 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-21T02:44:45.164 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-21T02:44:45.165 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-21T02:44:45.167 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-21T02:44:45.168 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-21T02:44:45.170 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-21T02:44:45.172 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-21T02:44:45.174 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-21T02:44:45.176 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-21T02:44:45.178 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-21T02:44:45.179 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-21T02:44:45.181 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-21T02:44:45.182 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-21T02:44:45.184 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-21T02:44:45.186 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-21T02:44:45.188 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-21T02:44:45.190 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-21T02:44:45.192 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-21T02:44:45.193 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-21T02:44:45.195 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-21T02:44:45.197 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-21T02:44:45.199 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-21T02:44:45.201 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-21T02:44:45.203 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-21T02:44:45.204 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-21T02:44:45.206 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-21T02:44:45.208 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-21T02:44:45.210 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-21T02:44:45.211 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-21T02:44:45.213 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-21T02:44:45.214 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-21T02:44:45.216 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-21T02:44:45.217 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-21T02:44:45.219 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-21T02:44:45.221 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-21T02:44:45.222 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-21T02:44:45.223 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-21T02:44:45.224 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-21T02:44:45.226 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-21T02:44:45.227 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-21T02:44:45.229 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-21T02:44:45.231 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-21T02:44:45.233 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-21T02:44:45.235 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-21T02:44:45.237 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-21T02:44:45.238 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-21T02:44:45.240 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-21T02:44:45.242 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-21T02:44:45.244 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-21T02:44:45.246 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-21T02:44:45.248 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-21T02:44:45.250 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-21T02:44:45.251 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-21T02:44:45.253 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-21T02:44:45.255 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-21T02:44:45.257 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-21T02:44:45.258 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-21T02:44:45.260 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-21T02:44:45.262 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-21T02:44:45.263 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-21T02:44:45.265 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-21T02:44:45.267 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-21T02:44:45.268 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-21T02:44:45.270 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-21T02:44:45.272 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-21T02:44:45.274 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-21T02:44:45.276 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-21T02:44:45.277 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-21T02:44:45.279 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-21T02:44:45.281 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-21T02:44:45.283 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-21T02:44:45.285 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-21T02:44:45.286 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-21T02:44:45.288 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-21T02:44:45.290 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-21T02:44:45.291 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-21T02:44:45.293 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-21T02:44:45.295 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-21T02:44:45.297 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-21T02:44:45.298 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-21T02:44:45.300 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-21T02:44:45.301 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-21T02:44:45.303 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-21T02:44:45.305 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-21T02:44:45.307 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-21T02:44:45.308 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-21T02:44:45.310 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-21T02:44:45.312 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-21T02:44:45.313 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-21T02:44:45.315 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-21T02:44:45.317 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-21T02:44:45.318 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-21T02:44:45.320 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-21T02:44:45.321 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-21T02:44:45.323 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-21T02:44:45.325 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-21T02:44:45.327 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-21T02:44:45.328 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-21T02:44:45.330 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-21T02:44:45.332 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-21T02:44:45.334 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-21T02:44:45.335 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-21T02:44:45.337 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-21T02:44:45.338 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-21T02:44:45.340 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-21T02:44:45.342 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-21T02:44:45.343 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-21T02:44:45.345 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-21T02:44:45.347 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-21T02:44:45.349 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-21T02:44:45.351 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-21T02:44:45.352 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-21T02:44:45.354 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-21T02:44:45.355 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-21T02:44:45.357 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-21T02:44:45.358 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-21T02:44:45.360 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-21T02:44:45.362 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-21T02:44:45.364 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-21T02:44:45.365 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-21T02:44:45.367 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-21T02:44:45.369 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-21T02:44:45.370 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-21T02:44:45.372 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-21T02:44:45.373 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-21T02:44:45.375 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-21T02:44:45.376 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-21T02:44:45.378 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-21T02:44:45.380 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-21T02:44:45.381 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-21T02:44:45.383 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-21T02:44:45.384 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-21T02:44:45.386 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-21T02:44:45.388 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-21T02:44:45.389 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-21T02:44:45.391 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-21T02:44:45.392 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-21T02:44:45.393 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-21T02:44:45.395 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-21T02:44:45.396 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-21T02:44:45.397 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-21T02:44:45.398 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-21T02:44:45.399 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-21T02:44:45.400 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-21T02:44:45.401 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-21T02:44:45.403 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-21T02:44:45.404 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-21T02:44:45.405 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-21T02:44:45.406 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-21T02:44:45.407 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-21T02:44:45.408 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-21T02:44:45.410 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-21T02:44:45.411 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-21T02:44:45.412 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-21T02:44:45.413 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-21T02:44:45.414 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-21T02:44:45.415 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-21T02:44:45.416 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-21T02:44:45.418 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-21T02:44:45.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-21T02:44:45.420 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-21T02:44:45.421 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-21T02:44:45.422 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-21T02:44:45.423 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-21T02:44:45.424 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-21T02:44:45.427 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-21T02:44:45.429 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-21T02:44:45.430 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-21T02:44:45.431 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-21T02:44:45.433 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-21T02:44:45.434 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-21T02:44:45.435 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-21T02:44:45.436 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-21T02:44:45.437 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-21T02:44:45.438 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-21T02:44:45.440 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-21T02:44:45.441 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-21T02:44:45.442 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-21T02:44:45.444 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-21T02:44:45.445 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-21T02:44:45.446 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-21T02:44:45.447 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-21T02:44:45.448 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-21T02:44:45.450 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-21T02:44:45.451 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-21T02:44:45.452 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-21T02:44:45.453 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-21T02:44:45.454 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-21T02:44:45.455 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-21T02:44:45.456 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-21T02:44:45.458 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-21T02:44:45.459 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-21T02:44:45.460 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-21T02:44:45.461 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-21T02:44:45.462 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-21T02:44:45.463 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-21T02:44:45.464 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-21T02:44:45.465 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-21T02:44:45.467 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-21T02:44:45.468 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-21T02:44:45.469 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-21T02:44:45.470 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-21T02:44:45.472 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-21T02:44:45.473 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-21T02:44:45.474 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-21T02:44:45.475 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-21T02:44:45.476 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-21T02:44:45.477 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-21T02:44:45.478 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-21T02:44:45.479 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-21T02:44:45.480 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-21T02:44:45.481 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-21T02:44:45.483 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-21T02:44:45.484 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-21T02:44:45.485 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-21T02:44:45.486 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-21T02:44:45.488 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-21T02:44:45.489 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-21T02:44:45.490 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-21T02:44:45.491 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-21T02:44:45.492 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-21T02:44:45.493 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-21T02:44:45.496 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-21T02:44:45.496 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-21T02:44:45.497 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-21T02:44:45.498 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-21T02:44:45.499 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-21T02:44:45.500 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-21T02:44:45.502 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-21T02:44:45.503 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-21T02:44:45.504 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-21T02:44:45.505 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-21T02:44:45.506 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-21T02:44:45.507 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-21T02:44:45.508 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-21T02:44:45.509 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-21T02:44:45.511 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-21T02:44:45.512 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-21T02:44:45.513 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-21T02:44:45.514 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-21T02:44:45.516 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-21T02:44:45.517 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-21T02:44:45.518 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-21T02:44:45.519 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-21T02:44:45.520 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-21T02:44:45.521 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-21T02:44:45.522 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-21T02:44:45.523 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-21T02:44:45.525 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-21T02:44:45.526 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-21T02:44:45.527 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-21T02:44:45.528 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-21T02:44:45.529 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-21T02:44:45.531 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-21T02:44:45.532 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-21T02:44:45.533 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-21T02:44:45.534 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-21T02:44:45.535 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-21T02:44:45.536 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-21T02:44:45.538 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-21T02:44:45.539 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-21T02:44:45.540 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-21T02:44:45.541 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-21T02:44:45.543 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-21T02:44:45.544 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-21T02:44:45.545 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-21T02:44:45.546 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-21T02:44:45.547 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-21T02:44:45.548 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-21T02:44:45.550 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-21T02:44:45.551 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-21T02:44:45.553 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-21T02:44:45.554 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-21T02:44:45.555 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-21T02:44:45.556 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-21T02:44:45.557 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-21T02:44:45.559 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-21T02:44:45.560 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-21T02:44:45.561 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-21T02:44:45.562 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-21T02:44:45.563 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-21T02:44:45.564 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-21T02:44:45.565 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-21T02:44:45.566 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-21T02:44:45.568 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-21T02:44:45.569 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-21T02:44:45.570 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-21T02:44:45.574 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-21T02:44:45.574 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-21T02:44:45.574 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-21T02:44:45.574 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-21T02:44:45.575 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-21T02:44:45.577 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-21T02:44:45.578 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-21T02:44:45.579 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-21T02:44:45.580 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-21T02:44:45.581 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-21T02:44:45.582 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-21T02:44:45.584 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-21T02:44:45.585 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-21T02:44:45.586 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-21T02:44:45.587 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-21T02:44:45.588 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-21T02:44:45.590 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-21T02:44:45.591 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-21T02:44:45.592 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-21T02:44:45.594 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-21T02:44:45.595 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-21T02:44:45.596 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-21T02:44:45.597 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-21T02:44:45.599 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-21T02:44:45.600 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-21T02:44:45.601 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-21T02:44:45.602 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-21T02:44:45.603 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-21T02:44:45.604 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-21T02:44:45.605 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-21T02:44:45.607 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-21T02:44:45.608 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-21T02:44:45.609 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-21T02:44:45.610 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-21T02:44:45.612 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-21T02:44:45.613 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-21T02:44:45.614 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-21T02:44:45.615 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-21T02:44:45.616 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-21T02:44:45.618 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-21T02:44:45.619 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-21T02:44:45.620 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-21T02:44:45.621 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-21T02:44:45.622 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-21T02:44:45.623 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-21T02:44:45.625 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-21T02:44:45.626 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-21T02:44:45.627 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-21T02:44:45.628 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-21T02:44:45.629 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-21T02:44:45.630 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-21T02:44:45.631 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-21T02:44:45.632 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-21T02:44:45.633 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-21T02:44:45.635 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-21T02:44:45.636 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-21T02:44:45.637 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-21T02:44:45.639 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-21T02:44:45.640 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-21T02:44:45.642 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-21T02:44:45.643 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-21T02:44:45.644 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-21T02:44:45.645 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-21T02:44:45.646 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-21T02:44:45.647 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-21T02:44:45.648 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-21T02:44:45.650 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-21T02:44:45.651 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-21T02:44:45.652 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-21T02:44:45.653 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-21T02:44:45.654 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-21T02:44:45.655 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-21T02:44:45.656 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-21T02:44:45.658 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-21T02:44:45.659 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-21T02:44:45.660 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-21T02:44:45.661 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-21T02:44:45.662 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-21T02:44:45.664 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-21T02:44:45.665 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-21T02:44:45.666 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-21T02:44:45.667 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-21T02:44:45.668 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-21T02:44:45.670 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-21T02:44:45.671 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-21T02:44:45.672 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-21T02:44:45.673 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-21T02:44:45.674 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-21T02:44:45.676 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-21T02:44:45.677 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-21T02:44:45.678 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-21T02:44:45.679 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-21T02:44:45.681 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-21T02:44:45.682 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-21T02:44:45.684 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-21T02:44:45.685 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-21T02:44:45.686 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-21T02:44:45.687 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-21T02:44:45.689 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-21T02:44:45.690 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-21T02:44:45.691 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-21T02:44:45.692 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-21T02:44:45.693 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-21T02:44:45.694 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-21T02:44:45.695 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-21T02:44:45.696 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-21T02:44:45.698 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-21T02:44:45.699 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-21T02:44:45.700 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-21T02:44:45.702 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-21T02:44:45.703 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-21T02:44:45.704 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-21T02:44:45.705 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-21T02:44:45.706 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-21T02:44:45.707 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-21T02:44:45.708 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-21T02:44:45.709 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-21T02:44:45.710 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-21T02:44:45.712 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-21T02:44:45.713 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-21T02:44:45.714 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-21T02:44:45.715 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-21T02:44:45.716 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-21T02:44:45.717 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-21T02:44:45.718 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-21T02:44:45.719 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-21T02:44:45.720 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-21T02:44:45.721 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-21T02:44:45.722 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-21T02:44:45.724 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-21T02:44:45.725 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-21T02:44:45.726 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-21T02:44:45.727 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-21T02:44:45.728 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-21T02:44:45.729 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-21T02:44:45.730 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-21T02:44:45.731 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-21T02:44:45.733 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-21T02:44:45.734 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-21T02:44:45.735 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-21T02:44:45.736 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-21T02:44:45.737 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-21T02:44:45.738 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-21T02:44:45.740 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-21T02:44:45.740 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-21T02:44:45.742 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-21T02:44:45.743 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-21T02:44:45.744 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-21T02:44:45.745 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-21T02:44:45.746 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-21T02:44:45.747 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-21T02:44:45.748 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-21T02:44:45.750 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-21T02:44:45.751 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-21T02:44:45.752 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-21T02:44:45.753 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-21T02:44:45.755 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-21T02:44:45.756 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-21T02:44:45.757 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-21T02:44:45.758 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-21T02:44:45.759 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-21T02:44:45.760 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-21T02:44:45.761 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-21T02:44:45.762 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-21T02:44:45.763 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-21T02:44:45.764 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-21T02:44:45.765 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-21T02:44:45.766 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-21T02:44:45.767 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-21T02:44:45.768 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-21T02:44:45.769 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-21T02:44:45.771 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-21T02:44:45.772 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-21T02:44:45.773 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-21T02:44:45.774 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-21T02:44:45.775 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-21T02:44:45.776 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-21T02:44:45.777 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-21T02:44:45.779 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-21T02:44:45.780 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-21T02:44:45.781 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-21T02:44:45.782 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-21T02:44:45.783 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-21T02:44:45.784 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-21T02:44:45.786 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-21T02:44:45.787 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-21T02:44:45.788 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-21T02:44:45.790 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-21T02:44:45.791 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-21T02:44:45.792 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-21T02:44:45.794 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-21T02:44:45.795 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-21T02:44:45.796 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-21T02:44:45.798 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-21T02:44:45.799 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-21T02:44:45.800 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-21T02:44:45.801 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-21T02:44:45.802 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-21T02:44:45.803 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-21T02:44:45.805 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-21T02:44:45.806 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-21T02:44:45.807 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-21T02:44:45.808 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-21T02:44:45.809 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-21T02:44:45.810 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-21T02:44:45.812 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-21T02:44:45.813 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-21T02:44:45.814 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-21T02:44:45.815 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-21T02:44:45.816 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-21T02:44:45.817 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-21T02:44:45.819 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-21T02:44:45.820 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-21T02:44:45.821 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-21T02:44:45.823 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-21T02:44:45.824 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-21T02:44:45.825 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-21T02:44:45.826 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-21T02:44:45.827 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-21T02:44:45.828 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-21T02:44:45.829 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-21T02:44:45.830 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-21T02:44:45.832 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-21T02:44:45.833 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-21T02:44:45.834 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-21T02:44:45.835 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-21T02:44:45.836 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-21T02:44:45.837 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-21T02:44:45.838 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-21T02:44:45.839 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-21T02:44:45.840 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-21T02:44:45.842 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-21T02:44:45.843 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-21T02:44:45.844 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-21T02:44:45.845 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-21T02:44:45.847 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-21T02:44:45.848 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-21T02:44:45.849 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-21T02:44:45.850 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-21T02:44:45.851 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-21T02:44:45.852 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-21T02:44:45.853 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-21T02:44:45.855 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-21T02:44:45.856 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-21T02:44:45.857 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-21T02:44:45.858 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-21T02:44:45.859 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-21T02:44:45.860 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-21T02:44:45.861 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-21T02:44:45.863 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-21T02:44:45.864 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-21T02:44:45.865 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-21T02:44:45.866 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-21T02:44:45.867 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-21T02:44:45.868 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-21T02:44:45.869 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-21T02:44:45.870 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-21T02:44:45.871 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-21T02:44:45.873 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-21T02:44:45.874 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-21T02:44:45.875 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-21T02:44:45.876 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-21T02:44:45.877 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-21T02:44:45.878 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-21T02:44:45.879 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-21T02:44:45.880 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-21T02:44:45.882 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-21T02:44:46.118 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-21T02:44:46.119 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-21T02:44:46.120 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-21T02:44:46.122 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-21T02:44:46.123 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-21T02:44:46.125 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-21T02:44:46.126 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-21T02:44:46.127 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-21T02:44:46.128 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-21T02:44:46.130 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-21T02:44:46.131 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-21T02:44:46.133 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-21T02:44:46.134 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-21T02:44:46.135 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-21T02:44:46.137 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-21T02:44:46.138 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-21T02:44:46.139 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-21T02:44:46.140 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-21T02:44:46.141 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-21T02:44:46.142 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-21T02:44:46.143 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-21T02:44:46.145 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-21T02:44:46.147 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-21T02:44:46.148 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-21T02:44:46.149 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-21T02:44:46.151 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-21T02:44:46.152 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-21T02:44:46.154 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-21T02:44:46.155 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-21T02:44:46.156 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-21T02:44:46.157 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-21T02:44:46.158 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-21T02:44:46.159 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-21T02:44:46.160 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-21T02:44:46.162 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-21T02:44:46.163 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-21T02:44:46.164 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-21T02:44:46.166 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-21T02:44:46.167 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-21T02:44:46.168 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-21T02:44:46.169 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-21T02:44:46.170 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-21T02:44:46.172 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-21T02:44:46.173 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-21T02:44:46.175 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-21T02:44:46.176 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-21T02:44:46.177 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-21T02:44:46.178 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-21T02:44:46.180 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-21T02:44:46.181 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-21T02:44:46.182 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-21T02:44:46.186 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-21T02:44:46.186 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-21T02:44:46.186 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-21T02:44:46.187 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-21T02:44:46.189 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-21T02:44:46.191 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-21T02:44:46.192 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-21T02:44:46.193 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-21T02:44:46.194 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-21T02:44:46.196 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-21T02:44:46.197 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-21T02:44:46.198 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-21T02:44:46.199 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-21T02:44:46.200 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-21T02:44:46.202 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-21T02:44:46.203 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-21T02:44:46.204 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-21T02:44:46.205 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-21T02:44:46.207 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-21T02:44:46.208 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-21T02:44:46.209 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-21T02:44:46.211 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-21T02:44:46.212 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-21T02:44:46.213 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-21T02:44:46.214 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-21T02:44:46.216 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-21T02:44:46.217 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-21T02:44:46.218 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-21T02:44:46.220 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-21T02:44:46.221 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-21T02:44:46.223 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-21T02:44:46.224 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-21T02:44:46.225 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-21T02:44:46.226 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-21T02:44:46.228 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-21T02:44:46.229 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-21T02:44:46.230 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-21T02:44:46.232 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-21T02:44:46.233 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-21T02:44:46.234 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-21T02:44:46.236 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-21T02:44:46.237 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-21T02:44:46.238 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-21T02:44:46.239 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-21T02:44:46.241 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-21T02:44:46.242 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-21T02:44:46.243 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-21T02:44:46.245 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-21T02:44:46.246 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-21T02:44:46.247 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-21T02:44:46.249 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-21T02:44:46.250 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-21T02:44:46.251 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-21T02:44:46.252 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-21T02:44:46.254 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-21T02:44:46.255 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-21T02:44:46.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:45 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:46.256 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-21T02:44:46.258 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-21T02:44:46.259 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-21T02:44:46.260 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-21T02:44:46.261 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-21T02:44:46.262 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-21T02:44:46.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:45 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:46.263 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-21T02:44:46.264 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-21T02:44:46.266 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-21T02:44:46.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:45 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:46.267 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-21T02:44:46.268 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-21T02:44:46.270 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-21T02:44:46.271 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-21T02:44:46.272 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-21T02:44:46.274 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-21T02:44:46.275 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-21T02:44:46.277 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-21T02:44:46.278 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-21T02:44:46.279 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-21T02:44:46.281 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-21T02:44:46.282 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-21T02:44:46.283 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-21T02:44:46.285 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-21T02:44:46.286 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-21T02:44:46.287 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-21T02:44:46.289 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-21T02:44:46.290 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-21T02:44:46.291 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-21T02:44:46.292 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-21T02:44:46.293 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-21T02:44:46.295 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-21T02:44:46.296 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-21T02:44:46.297 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-21T02:44:46.298 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-21T02:44:46.299 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-21T02:44:46.300 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-21T02:44:46.302 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-21T02:44:46.303 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-21T02:44:46.304 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-21T02:44:46.306 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-21T02:44:46.307 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-21T02:44:46.308 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-21T02:44:46.310 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-21T02:44:46.311 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-21T02:44:46.312 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-21T02:44:46.314 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-21T02:44:46.315 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-21T02:44:46.316 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-21T02:44:46.317 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-21T02:44:46.318 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-21T02:44:46.320 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-21T02:44:46.321 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-21T02:44:46.322 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-21T02:44:46.324 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-21T02:44:46.325 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-21T02:44:46.326 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-21T02:44:46.327 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-21T02:44:46.329 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-21T02:44:46.330 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-21T02:44:46.331 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-21T02:44:46.333 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-21T02:44:46.334 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-21T02:44:46.335 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-21T02:44:46.336 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-21T02:44:46.338 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-21T02:44:46.339 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-21T02:44:46.340 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-21T02:44:46.341 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-21T02:44:46.343 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-21T02:44:46.344 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-21T02:44:46.345 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-21T02:44:46.346 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-21T02:44:46.347 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-21T02:44:46.348 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-21T02:44:46.350 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-21T02:44:46.351 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-21T02:44:46.352 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-21T02:44:46.353 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-21T02:44:46.355 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-21T02:44:46.356 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-21T02:44:46.357 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-21T02:44:46.359 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-21T02:44:46.360 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-21T02:44:46.361 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-21T02:44:46.363 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-21T02:44:46.364 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-21T02:44:46.365 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-21T02:44:46.366 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-21T02:44:46.367 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-21T02:44:46.369 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-21T02:44:46.370 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-21T02:44:46.371 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-21T02:44:46.372 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-21T02:44:46.374 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-21T02:44:46.375 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-21T02:44:46.376 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-21T02:44:46.378 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-21T02:44:46.379 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-21T02:44:46.380 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-21T02:44:46.382 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-21T02:44:46.383 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-21T02:44:46.384 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-21T02:44:46.386 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-21T02:44:46.387 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-21T02:44:46.388 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-21T02:44:46.390 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-21T02:44:46.391 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-21T02:44:46.392 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-21T02:44:46.393 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-21T02:44:46.394 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-21T02:44:46.395 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-21T02:44:46.396 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-21T02:44:46.397 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-21T02:44:46.398 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-21T02:44:46.400 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-21T02:44:46.401 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-21T02:44:46.402 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-21T02:44:46.403 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-21T02:44:46.404 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-21T02:44:46.405 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-21T02:44:46.406 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-21T02:44:46.408 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-21T02:44:46.409 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-21T02:44:46.410 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-21T02:44:46.411 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-21T02:44:46.412 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-21T02:44:46.413 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-21T02:44:46.415 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-21T02:44:46.416 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-21T02:44:46.417 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-21T02:44:46.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-21T02:44:46.420 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-21T02:44:46.421 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-21T02:44:46.422 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-21T02:44:46.423 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-21T02:44:46.424 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-21T02:44:46.426 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-21T02:44:46.428 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-21T02:44:46.429 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-21T02:44:46.431 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-21T02:44:46.432 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-21T02:44:46.433 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-21T02:44:46.435 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-21T02:44:46.436 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-21T02:44:46.437 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-21T02:44:46.438 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-21T02:44:46.439 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-21T02:44:46.441 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-21T02:44:46.442 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-21T02:44:46.443 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-21T02:44:46.445 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-21T02:44:46.446 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-21T02:44:46.447 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-21T02:44:46.448 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-21T02:44:46.449 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-21T02:44:46.450 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-21T02:44:46.452 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-21T02:44:46.453 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-21T02:44:46.454 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-21T02:44:46.455 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-21T02:44:46.456 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-21T02:44:46.458 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-21T02:44:46.459 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-21T02:44:46.460 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-21T02:44:46.462 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-21T02:44:46.463 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-21T02:44:46.464 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-21T02:44:46.466 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-21T02:44:46.467 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-21T02:44:46.468 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-21T02:44:46.470 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-21T02:44:46.471 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-21T02:44:46.472 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-21T02:44:46.474 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-21T02:44:46.475 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-21T02:44:46.476 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-21T02:44:46.477 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-21T02:44:46.478 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-21T02:44:46.479 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-21T02:44:46.480 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-21T02:44:46.482 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-21T02:44:46.483 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-21T02:44:46.484 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-21T02:44:46.485 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-21T02:44:46.487 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-21T02:44:46.488 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-21T02:44:46.490 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-21T02:44:46.491 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-21T02:44:46.492 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-21T02:44:46.494 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-21T02:44:46.495 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-21T02:44:46.496 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-21T02:44:46.497 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-21T02:44:46.499 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-21T02:44:46.500 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-21T02:44:46.501 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-21T02:44:46.502 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-21T02:44:46.504 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-21T02:44:46.505 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-21T02:44:46.506 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-21T02:44:46.507 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-21T02:44:46.508 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-21T02:44:46.509 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-21T02:44:46.511 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-21T02:44:46.512 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-21T02:44:46.513 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-21T02:44:46.514 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-21T02:44:46.516 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-21T02:44:46.517 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-21T02:44:46.518 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-21T02:44:46.519 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-21T02:44:46.520 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-21T02:44:46.521 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-21T02:44:46.523 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-21T02:44:46.524 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-21T02:44:46.525 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-21T02:44:46.526 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-21T02:44:46.528 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-21T02:44:46.529 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-21T02:44:46.530 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-21T02:44:46.531 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-21T02:44:46.533 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-21T02:44:46.534 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-21T02:44:46.536 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-21T02:44:46.536 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-21T02:44:46.538 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-21T02:44:46.539 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-21T02:44:46.541 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-21T02:44:46.542 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-21T02:44:46.543 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-21T02:44:46.544 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-21T02:44:46.545 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-21T02:44:46.547 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-21T02:44:46.548 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-21T02:44:46.550 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-21T02:44:46.551 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-21T02:44:46.552 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-21T02:44:46.554 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-21T02:44:46.555 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-21T02:44:46.556 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-21T02:44:46.557 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-21T02:44:46.559 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-21T02:44:46.561 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-21T02:44:46.562 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-21T02:44:46.564 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-21T02:44:46.565 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-21T02:44:46.566 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-21T02:44:46.567 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-21T02:44:46.569 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-21T02:44:46.570 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-21T02:44:46.571 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-21T02:44:46.573 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-21T02:44:46.574 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-21T02:44:46.576 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-21T02:44:46.577 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-21T02:44:46.579 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-21T02:44:46.580 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-21T02:44:46.581 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-21T02:44:46.582 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-21T02:44:46.583 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-21T02:44:46.585 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-21T02:44:46.586 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-21T02:44:46.587 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-21T02:44:46.589 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-21T02:44:46.590 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-21T02:44:46.592 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-21T02:44:46.593 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-21T02:44:46.595 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-21T02:44:46.596 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-21T02:44:46.597 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-21T02:44:46.599 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-21T02:44:46.600 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-21T02:44:46.601 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-21T02:44:46.603 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-21T02:44:46.605 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-21T02:44:46.606 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-21T02:44:46.607 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-21T02:44:46.609 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-21T02:44:46.610 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-21T02:44:46.612 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-21T02:44:46.613 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-21T02:44:46.615 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-21T02:44:46.616 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-21T02:44:46.618 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-21T02:44:46.619 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-21T02:44:46.621 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-21T02:44:46.622 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-21T02:44:46.624 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-21T02:44:46.625 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-21T02:44:46.626 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-21T02:44:46.628 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-21T02:44:46.629 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-21T02:44:46.630 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-21T02:44:46.631 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-21T02:44:46.633 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-21T02:44:46.634 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-21T02:44:46.636 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-21T02:44:46.637 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-21T02:44:46.639 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-21T02:44:46.640 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-21T02:44:46.642 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-21T02:44:46.644 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-21T02:44:46.645 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-21T02:44:46.646 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-21T02:44:46.648 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-21T02:44:46.649 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-21T02:44:46.651 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-21T02:44:46.652 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-21T02:44:46.654 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-21T02:44:46.655 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-21T02:44:46.656 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-21T02:44:46.658 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-21T02:44:46.659 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-21T02:44:46.660 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-21T02:44:46.662 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-21T02:44:46.663 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-21T02:44:46.665 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-21T02:44:46.666 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-21T02:44:46.668 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-21T02:44:46.669 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-21T02:44:46.670 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-21T02:44:46.672 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-21T02:44:46.673 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-21T02:44:46.674 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-21T02:44:46.676 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-21T02:44:46.677 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-21T02:44:46.679 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-21T02:44:46.680 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-21T02:44:46.682 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-21T02:44:46.683 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-21T02:44:46.684 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-21T02:44:46.685 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-21T02:44:46.687 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-21T02:44:46.688 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-21T02:44:46.690 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-21T02:44:46.691 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-21T02:44:46.692 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-21T02:44:46.694 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-21T02:44:46.695 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-21T02:44:46.696 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-21T02:44:46.697 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-21T02:44:46.699 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-21T02:44:46.700 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-21T02:44:46.702 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-21T02:44:46.703 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-21T02:44:46.705 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-21T02:44:46.706 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-21T02:44:46.707 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-21T02:44:46.708 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-21T02:44:46.710 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-21T02:44:46.711 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-21T02:44:46.712 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-21T02:44:46.714 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-21T02:44:46.715 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-21T02:44:46.717 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-21T02:44:46.718 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-21T02:44:46.719 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-21T02:44:46.721 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-21T02:44:46.722 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-21T02:44:46.723 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-21T02:44:46.725 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-21T02:44:46.726 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-21T02:44:46.728 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-21T02:44:46.729 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-21T02:44:46.731 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-21T02:44:46.732 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-21T02:44:46.733 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-21T02:44:46.735 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-21T02:44:46.736 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-21T02:44:46.738 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-21T02:44:46.739 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-21T02:44:46.740 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-21T02:44:46.741 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-21T02:44:46.742 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-21T02:44:46.744 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-21T02:44:46.745 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-21T02:44:46.747 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-21T02:44:46.748 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-21T02:44:46.749 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-21T02:44:46.751 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-21T02:44:46.752 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-21T02:44:46.754 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-21T02:44:46.755 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-21T02:44:46.756 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-21T02:44:46.757 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-21T02:44:46.758 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-21T02:44:46.759 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-21T02:44:46.761 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-21T02:44:46.762 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-21T02:44:46.764 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-21T02:44:46.766 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-21T02:44:46.767 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-21T02:44:46.768 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-21T02:44:46.770 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-21T02:44:46.771 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-21T02:44:46.772 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-21T02:44:46.773 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-21T02:44:46.774 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-21T02:44:46.776 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-21T02:44:46.777 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-21T02:44:46.778 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-21T02:44:46.780 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-21T02:44:46.781 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-21T02:44:46.782 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-21T02:44:46.784 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-21T02:44:46.785 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-21T02:44:46.831 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-21T02:44:46.832 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-21T02:44:46.834 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-21T02:44:46.835 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-21T02:44:46.836 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-21T02:44:46.837 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-21T02:44:46.839 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-21T02:44:46.840 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-21T02:44:46.842 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-21T02:44:46.843 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-21T02:44:46.844 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-21T02:44:46.846 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-21T02:44:46.847 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-21T02:44:46.848 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-21T02:44:46.850 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-21T02:44:46.851 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-21T02:44:46.852 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-21T02:44:46.853 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-21T02:44:46.855 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-21T02:44:46.856 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-21T02:44:46.857 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-21T02:44:46.859 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-21T02:44:46.860 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-21T02:44:46.862 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-21T02:44:46.863 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-21T02:44:46.865 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-21T02:44:46.866 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-21T02:44:46.867 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-21T02:44:46.869 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-21T02:44:46.870 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-21T02:44:46.871 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-21T02:44:46.873 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-21T02:44:46.874 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-21T02:44:46.875 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-21T02:44:46.876 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-21T02:44:46.878 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-21T02:44:46.879 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-21T02:44:46.881 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-21T02:44:46.882 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-21T02:44:46.883 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-21T02:44:46.885 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-21T02:44:46.886 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-21T02:44:46.888 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-21T02:44:46.889 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-21T02:44:46.890 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-21T02:44:46.891 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-21T02:44:46.892 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-21T02:44:46.894 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-21T02:44:46.895 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-21T02:44:46.896 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-21T02:44:46.897 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-21T02:44:46.899 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-21T02:44:46.900 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-21T02:44:46.901 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-21T02:44:46.902 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-21T02:44:46.903 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-21T02:44:46.905 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-21T02:44:46.906 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-21T02:44:46.907 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-21T02:44:46.909 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-21T02:44:46.910 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-21T02:44:46.911 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-21T02:44:46.912 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-21T02:44:46.914 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-21T02:44:46.915 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-21T02:44:46.916 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-21T02:44:46.917 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-21T02:44:46.918 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-21T02:44:46.919 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-21T02:44:46.921 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-21T02:44:46.922 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-21T02:44:46.923 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-21T02:44:46.924 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-21T02:44:46.926 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-21T02:44:46.927 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-21T02:44:46.928 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-21T02:44:46.929 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-21T02:44:46.930 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-21T02:44:46.932 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-21T02:44:46.933 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-21T02:44:46.934 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-21T02:44:46.935 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-21T02:44:46.936 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-21T02:44:46.937 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-21T02:44:46.939 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-21T02:44:46.940 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-21T02:44:46.941 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-21T02:44:46.942 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-21T02:44:46.944 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-21T02:44:46.945 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-21T02:44:46.946 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-21T02:44:46.947 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-21T02:44:46.948 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-21T02:44:46.950 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-21T02:44:46.951 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-21T02:44:46.952 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-21T02:44:46.953 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-21T02:44:46.954 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-21T02:44:46.956 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-21T02:44:46.957 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-21T02:44:46.958 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-21T02:44:46.959 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-21T02:44:46.961 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-21T02:44:46.962 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-21T02:44:46.963 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-21T02:44:46.965 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-21T02:44:46.966 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-21T02:44:46.967 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-21T02:44:46.969 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-21T02:44:46.970 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-21T02:44:46.971 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-21T02:44:46.972 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-21T02:44:46.974 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-21T02:44:46.975 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-21T02:44:46.977 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-21T02:44:46.978 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-21T02:44:46.979 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-21T02:44:46.980 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-21T02:44:46.981 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-21T02:44:46.983 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-21T02:44:46.984 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-21T02:44:46.985 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-21T02:44:46.986 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-21T02:44:46.988 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-21T02:44:46.989 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-21T02:44:46.991 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-21T02:44:46.992 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-21T02:44:46.993 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-21T02:44:46.995 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-21T02:44:46.996 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-21T02:44:46.997 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-21T02:44:46.999 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-21T02:44:47.001 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-21T02:44:47.002 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-21T02:44:47.003 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-21T02:44:47.005 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-21T02:44:47.006 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-21T02:44:47.007 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-21T02:44:47.008 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-21T02:44:47.009 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-21T02:44:47.011 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-21T02:44:47.012 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-21T02:44:47.014 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-21T02:44:47.015 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-21T02:44:47.016 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-21T02:44:47.017 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-21T02:44:47.018 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-21T02:44:47.019 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-21T02:44:47.021 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-21T02:44:47.022 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-21T02:44:47.023 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-21T02:44:47.025 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-21T02:44:47.026 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-21T02:44:47.027 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-21T02:44:47.028 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-21T02:44:47.029 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-21T02:44:47.031 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-21T02:44:47.032 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-21T02:44:47.033 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-21T02:44:47.034 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-21T02:44:47.036 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-21T02:44:47.037 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-21T02:44:47.039 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-21T02:44:47.040 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-21T02:44:47.041 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-21T02:44:47.042 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-21T02:44:47.043 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-21T02:44:47.045 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-21T02:44:47.046 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-21T02:44:47.047 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-21T02:44:47.048 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-21T02:44:47.050 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-21T02:44:47.051 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-21T02:44:47.052 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-21T02:44:47.053 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-21T02:44:47.054 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-21T02:44:47.056 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-21T02:44:47.057 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-21T02:44:47.059 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-21T02:44:47.060 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-21T02:44:47.061 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-21T02:44:47.062 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-21T02:44:47.064 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-21T02:44:47.065 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-21T02:44:47.066 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-21T02:44:47.068 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-21T02:44:47.069 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-21T02:44:47.071 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-21T02:44:47.072 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-21T02:44:47.073 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-21T02:44:47.074 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/ 2024-09-21T02:44:47.076 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-21T02:44:47.077 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-21T02:44:47.078 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-21T02:44:47.079 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-21T02:44:47.081 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-21T02:44:47.082 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-21T02:44:47.083 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-21T02:44:47.084 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-21T02:44:47.085 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-21T02:44:47.086 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-21T02:44:47.087 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-21T02:44:47.089 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-21T02:44:47.090 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-21T02:44:47.091 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-21T02:44:47.092 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-21T02:44:47.094 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-21T02:44:47.095 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-21T02:44:47.096 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-21T02:44:47.097 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-21T02:44:47.098 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-21T02:44:47.099 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-21T02:44:47.100 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-21T02:44:47.101 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-21T02:44:47.102 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-21T02:44:47.103 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-21T02:44:47.104 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-21T02:44:47.106 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-21T02:44:47.107 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-21T02:44:47.108 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-21T02:44:47.109 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-21T02:44:47.110 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-21T02:44:47.112 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-21T02:44:47.113 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-21T02:44:47.114 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-21T02:44:47.115 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-21T02:44:47.116 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-21T02:44:47.118 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-21T02:44:47.119 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-21T02:44:47.120 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-21T02:44:47.121 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-21T02:44:47.123 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-21T02:44:47.124 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-21T02:44:47.125 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-21T02:44:47.126 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-21T02:44:47.128 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-21T02:44:47.129 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-21T02:44:47.130 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-21T02:44:47.131 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-21T02:44:47.132 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-21T02:44:47.133 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-21T02:44:47.134 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-21T02:44:47.135 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-21T02:44:47.136 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-21T02:44:47.138 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-21T02:44:47.139 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-21T02:44:47.140 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-21T02:44:47.142 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-21T02:44:47.143 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-21T02:44:47.144 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-21T02:44:47.145 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-21T02:44:47.146 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-21T02:44:47.148 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-21T02:44:47.149 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-21T02:44:47.150 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-21T02:44:47.151 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-21T02:44:47.152 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-21T02:44:47.154 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-21T02:44:47.155 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-21T02:44:47.156 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-21T02:44:47.158 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-21T02:44:47.159 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-21T02:44:47.161 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-21T02:44:47.163 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-21T02:44:47.165 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-21T02:44:47.166 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-21T02:44:47.168 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-21T02:44:47.170 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-21T02:44:47.171 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-21T02:44:47.172 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-21T02:44:47.173 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-21T02:44:47.174 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-21T02:44:47.175 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-21T02:44:47.176 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-21T02:44:47.178 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-21T02:44:47.179 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-21T02:44:47.180 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-21T02:44:47.181 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-21T02:44:47.183 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-21T02:44:47.184 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-21T02:44:47.185 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-21T02:44:47.186 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-21T02:44:47.187 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-21T02:44:47.188 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-21T02:44:47.189 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-21T02:44:47.191 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-21T02:44:47.192 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-21T02:44:47.193 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-21T02:44:47.194 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-21T02:44:47.195 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-21T02:44:47.196 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-21T02:44:47.198 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-21T02:44:47.199 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-21T02:44:47.200 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-21T02:44:47.201 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-21T02:44:47.202 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-21T02:44:47.204 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-21T02:44:47.206 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-21T02:44:47.206 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-21T02:44:47.207 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-21T02:44:47.208 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-21T02:44:47.209 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-21T02:44:47.211 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-21T02:44:47.212 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-21T02:44:47.213 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-21T02:44:47.215 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-21T02:44:47.216 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-21T02:44:47.217 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-21T02:44:47.219 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-21T02:44:47.220 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-21T02:44:47.221 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-21T02:44:47.222 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-21T02:44:47.223 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-21T02:44:47.224 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-21T02:44:47.225 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-21T02:44:47.227 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-21T02:44:47.228 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-21T02:44:47.229 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-21T02:44:47.231 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-21T02:44:47.232 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-21T02:44:47.233 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-21T02:44:47.235 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-21T02:44:47.236 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-21T02:44:47.237 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-21T02:44:47.238 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-21T02:44:47.239 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-21T02:44:47.241 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-21T02:44:47.242 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-21T02:44:47.243 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-21T02:44:47.244 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-21T02:44:47.246 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-21T02:44:47.247 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-21T02:44:47.248 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-21T02:44:47.249 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-21T02:44:47.251 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-21T02:44:47.252 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-21T02:44:47.253 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-21T02:44:47.254 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-21T02:44:47.256 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-21T02:44:47.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:46 smithi172 ceph-mon[35067]: pgmap v470: 129 pgs: 129 active+clean; 89 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 5.0 MiB/s wr, 254 op/s 2024-09-21T02:44:47.257 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-21T02:44:47.258 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-21T02:44:47.259 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-21T02:44:47.260 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-21T02:44:47.263 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-21T02:44:47.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:46 smithi084 ceph-mon[30747]: pgmap v470: 129 pgs: 129 active+clean; 89 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 5.0 MiB/s wr, 254 op/s 2024-09-21T02:44:47.263 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-21T02:44:47.264 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-21T02:44:47.266 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-21T02:44:47.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:46 smithi090 ceph-mon[34571]: pgmap v470: 129 pgs: 129 active+clean; 89 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 5.0 MiB/s wr, 254 op/s 2024-09-21T02:44:47.267 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-21T02:44:47.268 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-21T02:44:47.270 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-21T02:44:47.271 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-21T02:44:47.272 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-21T02:44:47.273 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-21T02:44:47.275 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-21T02:44:47.276 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-21T02:44:47.277 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-21T02:44:47.278 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-21T02:44:47.279 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-21T02:44:47.280 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/ 2024-09-21T02:44:47.282 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-21T02:44:47.283 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-21T02:44:47.285 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-21T02:44:47.286 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-21T02:44:47.287 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-21T02:44:47.288 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-21T02:44:47.289 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-21T02:44:47.291 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-21T02:44:47.292 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-21T02:44:47.294 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-21T02:44:47.295 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-21T02:44:47.296 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-21T02:44:47.297 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-21T02:44:47.298 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-21T02:44:47.299 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-21T02:44:47.301 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-21T02:44:47.302 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-21T02:44:47.303 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-21T02:44:47.305 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-21T02:44:47.306 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-21T02:44:47.307 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-21T02:44:47.308 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hid/ 2024-09-21T02:44:47.310 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-21T02:44:47.311 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-21T02:44:47.312 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-21T02:44:47.313 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-21T02:44:47.315 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-21T02:44:47.316 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-21T02:44:47.317 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-21T02:44:47.318 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-21T02:44:47.319 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-21T02:44:47.321 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-21T02:44:47.323 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-21T02:44:47.323 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-21T02:44:47.325 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-21T02:44:47.326 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-21T02:44:47.327 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-21T02:44:47.328 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-21T02:44:47.329 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-21T02:44:47.330 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-21T02:44:47.332 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-21T02:44:47.333 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-21T02:44:47.334 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-21T02:44:47.335 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-21T02:44:47.336 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-21T02:44:47.338 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-21T02:44:47.339 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-21T02:44:47.340 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-21T02:44:47.342 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-21T02:44:47.343 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-21T02:44:47.344 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-21T02:44:47.345 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-21T02:44:47.347 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-21T02:44:47.348 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-21T02:44:47.349 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-21T02:44:47.350 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-21T02:44:47.352 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-21T02:44:47.353 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-21T02:44:47.354 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-21T02:44:47.356 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-21T02:44:47.357 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-21T02:44:47.358 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-21T02:44:47.359 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-21T02:44:47.360 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-21T02:44:47.361 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-21T02:44:47.363 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-21T02:44:47.364 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-21T02:44:47.365 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-21T02:44:47.367 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-21T02:44:47.368 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-21T02:44:47.369 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-21T02:44:47.370 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-21T02:44:47.371 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-21T02:44:47.372 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-21T02:44:47.373 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-21T02:44:47.374 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-21T02:44:47.375 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-21T02:44:47.377 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-21T02:44:47.378 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-21T02:44:47.379 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-21T02:44:47.381 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-21T02:44:47.382 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-21T02:44:47.383 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-21T02:44:47.384 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-21T02:44:47.386 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-21T02:44:47.387 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-21T02:44:47.388 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-21T02:44:47.389 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-21T02:44:47.391 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-21T02:44:47.392 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-21T02:44:47.393 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-21T02:44:47.394 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-21T02:44:47.395 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-21T02:44:47.396 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-21T02:44:47.397 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-21T02:44:47.398 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-21T02:44:47.399 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-21T02:44:47.400 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-21T02:44:47.402 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-21T02:44:47.403 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-21T02:44:47.404 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-21T02:44:47.405 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-21T02:44:47.406 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-21T02:44:47.407 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-21T02:44:47.409 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-21T02:44:47.410 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-21T02:44:47.411 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-21T02:44:47.412 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-21T02:44:47.413 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-21T02:44:47.414 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-21T02:44:47.415 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-21T02:44:47.416 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-21T02:44:47.418 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-21T02:44:47.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-21T02:44:47.420 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-21T02:44:47.421 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-21T02:44:47.422 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-21T02:44:47.423 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-21T02:44:47.424 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-21T02:44:47.425 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-21T02:44:47.426 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-21T02:44:47.428 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-21T02:44:47.431 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-21T02:44:47.433 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-21T02:44:47.434 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-21T02:44:47.436 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-21T02:44:47.437 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-21T02:44:47.438 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-21T02:44:47.440 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-21T02:44:47.441 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-21T02:44:47.442 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-21T02:44:47.683 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-21T02:44:47.684 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-21T02:44:47.685 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-21T02:44:47.687 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-21T02:44:47.688 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-21T02:44:47.690 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-21T02:44:47.691 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-21T02:44:47.692 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-21T02:44:47.693 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-21T02:44:47.694 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-21T02:44:47.695 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-21T02:44:47.697 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-21T02:44:47.698 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-21T02:44:47.699 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-21T02:44:47.701 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-21T02:44:47.702 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-21T02:44:47.703 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-21T02:44:47.705 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-21T02:44:47.706 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-21T02:44:47.707 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-21T02:44:47.708 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-21T02:44:47.709 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-21T02:44:47.710 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-21T02:44:47.712 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-21T02:44:47.713 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-21T02:44:47.714 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-21T02:44:47.716 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-21T02:44:47.717 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-21T02:44:47.719 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-21T02:44:47.720 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-21T02:44:47.722 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-21T02:44:47.723 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-21T02:44:47.724 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-21T02:44:47.726 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-21T02:44:47.727 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-21T02:44:47.728 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-21T02:44:47.730 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-21T02:44:47.731 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-21T02:44:47.733 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-21T02:44:47.734 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-21T02:44:47.735 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-21T02:44:47.736 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-21T02:44:47.737 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-21T02:44:47.739 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-21T02:44:47.740 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-21T02:44:47.741 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-21T02:44:47.742 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-21T02:44:47.743 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-21T02:44:47.744 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-21T02:44:47.746 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-21T02:44:47.747 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-21T02:44:47.748 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-21T02:44:47.749 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-21T02:44:47.750 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-21T02:44:47.751 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-21T02:44:47.752 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-21T02:44:47.753 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-21T02:44:47.755 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-21T02:44:47.756 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-21T02:44:47.757 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-21T02:44:47.758 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-21T02:44:47.759 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-21T02:44:47.760 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-21T02:44:47.762 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-21T02:44:47.763 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-21T02:44:47.764 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-21T02:44:47.765 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-21T02:44:47.766 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-21T02:44:47.767 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-21T02:44:47.768 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-21T02:44:47.771 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-21T02:44:47.771 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-21T02:44:47.773 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-21T02:44:47.774 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-21T02:44:47.775 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-21T02:44:47.776 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-21T02:44:47.777 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-21T02:44:47.778 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-21T02:44:47.780 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-21T02:44:47.781 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-21T02:44:47.783 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-21T02:44:47.784 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-21T02:44:47.785 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-21T02:44:47.786 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-21T02:44:47.788 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-21T02:44:47.789 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-21T02:44:47.790 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-21T02:44:47.792 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-21T02:44:47.793 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-21T02:44:47.794 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-21T02:44:47.795 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ide/ 2024-09-21T02:44:47.797 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-21T02:44:47.798 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-21T02:44:47.799 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-21T02:44:47.800 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-21T02:44:47.801 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-21T02:44:47.803 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-21T02:44:47.804 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-21T02:44:47.805 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-21T02:44:47.806 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-21T02:44:47.807 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-21T02:44:47.809 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-21T02:44:47.810 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-21T02:44:47.811 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-21T02:44:47.812 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/init.txt 2024-09-21T02:44:47.813 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-21T02:44:47.814 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/ 2024-09-21T02:44:47.816 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-21T02:44:47.817 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-21T02:44:47.818 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-21T02:44:47.820 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-21T02:44:47.821 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-21T02:44:47.822 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-21T02:44:47.823 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-21T02:44:47.824 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-21T02:44:47.826 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-21T02:44:47.827 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-21T02:44:47.828 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-21T02:44:47.829 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-21T02:44:47.830 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-21T02:44:47.831 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-21T02:44:47.833 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-21T02:44:47.834 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-21T02:44:47.836 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-21T02:44:47.837 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-21T02:44:47.839 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-21T02:44:47.841 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-21T02:44:47.842 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-21T02:44:47.843 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-21T02:44:47.844 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-21T02:44:47.845 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-21T02:44:47.846 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-21T02:44:47.847 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-21T02:44:47.848 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-21T02:44:47.849 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-21T02:44:47.851 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-21T02:44:47.852 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-21T02:44:47.853 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-21T02:44:47.854 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-21T02:44:47.855 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-21T02:44:47.856 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-21T02:44:47.857 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-21T02:44:47.858 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-21T02:44:47.860 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-21T02:44:47.861 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-21T02:44:47.862 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-21T02:44:47.864 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-21T02:44:47.865 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-21T02:44:47.866 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-21T02:44:47.867 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-21T02:44:47.868 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-21T02:44:47.870 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-21T02:44:47.871 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-21T02:44:47.873 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-21T02:44:47.874 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-21T02:44:47.875 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-21T02:44:47.876 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-21T02:44:47.877 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-21T02:44:47.878 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-21T02:44:47.879 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-21T02:44:47.880 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-21T02:44:47.882 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-21T02:44:47.883 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-21T02:44:47.884 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-21T02:44:47.885 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-21T02:44:47.886 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-21T02:44:47.887 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-21T02:44:47.889 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-21T02:44:47.890 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-21T02:44:47.891 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-21T02:44:47.892 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-21T02:44:47.894 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-21T02:44:47.895 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-21T02:44:47.896 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-21T02:44:47.898 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-21T02:44:47.899 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-21T02:44:47.900 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-21T02:44:47.901 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-21T02:44:47.903 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-21T02:44:47.904 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-21T02:44:47.905 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-21T02:44:47.906 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-21T02:44:47.908 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-21T02:44:47.909 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/java.txt 2024-09-21T02:44:47.910 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-21T02:44:47.911 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-21T02:44:47.913 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-21T02:44:47.914 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-21T02:44:47.915 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-21T02:44:47.916 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-21T02:44:47.918 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-21T02:44:47.919 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-21T02:44:47.920 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-21T02:44:47.921 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-21T02:44:47.923 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-21T02:44:47.924 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-21T02:44:47.925 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-21T02:44:47.926 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-21T02:44:47.927 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-21T02:44:47.929 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-21T02:44:47.930 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-21T02:44:47.931 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-21T02:44:47.932 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-21T02:44:47.933 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-21T02:44:47.935 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-21T02:44:47.936 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-21T02:44:47.937 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-21T02:44:47.938 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-21T02:44:47.939 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-21T02:44:47.940 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-21T02:44:47.941 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-21T02:44:47.943 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-21T02:44:47.944 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-21T02:44:47.945 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-21T02:44:47.946 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-21T02:44:47.947 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-21T02:44:47.948 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-21T02:44:47.949 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-21T02:44:47.951 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-21T02:44:47.952 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-21T02:44:47.953 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-21T02:44:47.954 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-21T02:44:47.955 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-21T02:44:47.957 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/ 2024-09-21T02:44:47.959 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-21T02:44:47.960 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-21T02:44:47.961 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-21T02:44:47.962 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-21T02:44:47.964 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-21T02:44:47.965 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-21T02:44:47.966 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-21T02:44:47.968 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-21T02:44:47.969 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-21T02:44:47.970 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-21T02:44:47.971 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-21T02:44:47.972 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-21T02:44:47.974 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/ 2024-09-21T02:44:47.975 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-21T02:44:47.976 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-21T02:44:47.978 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-21T02:44:47.979 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-21T02:44:47.980 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-21T02:44:47.981 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-21T02:44:47.982 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-21T02:44:47.984 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-21T02:44:47.985 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-21T02:44:47.986 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-21T02:44:47.987 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-21T02:44:47.989 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-21T02:44:47.990 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-21T02:44:47.991 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-21T02:44:47.992 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-21T02:44:47.994 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-21T02:44:47.995 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-21T02:44:47.996 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-21T02:44:47.998 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-21T02:44:47.999 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-21T02:44:48.000 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/md.txt 2024-09-21T02:44:48.001 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-21T02:44:48.002 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-21T02:44:48.106 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-21T02:44:48.108 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-21T02:44:48.109 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-21T02:44:48.111 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/metag/ 2024-09-21T02:44:48.113 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-21T02:44:48.114 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-21T02:44:48.115 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/ 2024-09-21T02:44:48.118 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-21T02:44:48.119 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-21T02:44:48.121 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-21T02:44:48.122 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-21T02:44:48.124 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-21T02:44:48.126 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-21T02:44:48.127 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-21T02:44:48.129 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-21T02:44:48.131 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-21T02:44:48.133 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-21T02:44:48.134 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mips/ 2024-09-21T02:44:48.137 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-21T02:44:48.138 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-21T02:44:48.140 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-21T02:44:48.143 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-21T02:44:48.145 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-21T02:44:48.146 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-21T02:44:48.148 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-21T02:44:48.149 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-21T02:44:48.151 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-21T02:44:48.153 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-21T02:44:48.154 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-21T02:44:48.156 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-21T02:44:48.158 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-21T02:44:48.159 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-21T02:44:48.161 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-21T02:44:48.163 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-21T02:44:48.165 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-21T02:44:48.166 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-21T02:44:48.168 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-21T02:44:48.170 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-21T02:44:48.172 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-21T02:44:48.173 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-21T02:44:48.175 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-21T02:44:48.176 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-21T02:44:48.178 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-21T02:44:48.180 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-21T02:44:48.182 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-21T02:44:48.184 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-21T02:44:48.186 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-21T02:44:48.187 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-21T02:44:48.189 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-21T02:44:48.190 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-21T02:44:48.192 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-21T02:44:48.194 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-21T02:44:48.195 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-21T02:44:48.197 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-21T02:44:48.199 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-21T02:44:48.200 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-21T02:44:48.202 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-21T02:44:48.204 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-21T02:44:48.206 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-21T02:44:48.208 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-21T02:44:48.210 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-21T02:44:48.211 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-21T02:44:48.213 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-21T02:44:48.214 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ 2024-09-21T02:44:48.216 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-21T02:44:48.218 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-21T02:44:48.220 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-21T02:44:48.221 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-21T02:44:48.223 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-21T02:44:48.225 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-21T02:44:48.227 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-21T02:44:48.229 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-21T02:44:48.230 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-21T02:44:48.232 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-21T02:44:48.233 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-21T02:44:48.235 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-21T02:44:48.236 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-21T02:44:48.238 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-21T02:44:48.240 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-21T02:44:48.242 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-21T02:44:48.244 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-21T02:44:48.245 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-21T02:44:48.247 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-21T02:44:48.249 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-21T02:44:48.251 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-21T02:44:48.253 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-21T02:44:48.255 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-21T02:44:48.256 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-21T02:44:48.258 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-21T02:44:48.260 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-21T02:44:48.262 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-21T02:44:48.263 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-21T02:44:48.265 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-21T02:44:48.267 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-21T02:44:48.269 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-21T02:44:48.270 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-21T02:44:48.272 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-21T02:44:48.273 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-21T02:44:48.275 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-21T02:44:48.277 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-21T02:44:48.279 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-21T02:44:48.280 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-21T02:44:48.282 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-21T02:44:48.284 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-21T02:44:48.285 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-21T02:44:48.287 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-21T02:44:48.289 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-21T02:44:48.291 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-21T02:44:48.292 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-21T02:44:48.294 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-21T02:44:48.296 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-21T02:44:48.297 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-21T02:44:48.299 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-21T02:44:48.301 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-21T02:44:48.303 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-21T02:44:48.304 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-21T02:44:48.306 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-21T02:44:48.308 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-21T02:44:48.309 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-21T02:44:48.311 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-21T02:44:48.313 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-21T02:44:48.315 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-21T02:44:48.316 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-21T02:44:48.319 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-21T02:44:48.320 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-21T02:44:48.322 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-21T02:44:48.324 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-21T02:44:48.326 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-21T02:44:48.327 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-21T02:44:48.329 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-21T02:44:48.331 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-21T02:44:48.332 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-21T02:44:48.334 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-21T02:44:48.336 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-21T02:44:48.338 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-21T02:44:48.339 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-21T02:44:48.341 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-21T02:44:48.343 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-21T02:44:48.345 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-21T02:44:48.346 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-21T02:44:48.348 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-21T02:44:48.350 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-21T02:44:48.351 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-21T02:44:48.353 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-21T02:44:48.355 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-21T02:44:48.357 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-21T02:44:48.358 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-21T02:44:48.360 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-21T02:44:48.362 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-21T02:44:48.364 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-21T02:44:48.365 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-21T02:44:48.368 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-21T02:44:48.369 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-21T02:44:48.371 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-21T02:44:48.373 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-21T02:44:48.375 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-21T02:44:48.377 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-21T02:44:48.379 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-21T02:44:48.380 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-21T02:44:48.382 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-21T02:44:48.384 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-21T02:44:48.386 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-21T02:44:48.387 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-21T02:44:48.389 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-21T02:44:48.390 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-21T02:44:48.392 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-21T02:44:48.394 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-21T02:44:48.396 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-21T02:44:48.397 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-21T02:44:48.398 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-21T02:44:48.399 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-21T02:44:48.400 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-21T02:44:48.402 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-21T02:44:48.403 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-21T02:44:48.404 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-21T02:44:48.406 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-21T02:44:48.407 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-21T02:44:48.408 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-21T02:44:48.409 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-21T02:44:48.410 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-21T02:44:48.412 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-21T02:44:48.413 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-21T02:44:48.414 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-21T02:44:48.415 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-21T02:44:48.416 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-21T02:44:48.417 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-21T02:44:48.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-21T02:44:48.420 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-21T02:44:48.421 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-21T02:44:48.422 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-21T02:44:48.423 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-21T02:44:48.425 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-21T02:44:48.426 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-21T02:44:48.427 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-21T02:44:48.428 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-21T02:44:48.429 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-21T02:44:48.430 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-21T02:44:48.432 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-21T02:44:48.434 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-21T02:44:48.435 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-21T02:44:48.438 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-21T02:44:48.438 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-21T02:44:48.439 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-21T02:44:48.441 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-21T02:44:48.442 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-21T02:44:48.443 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-21T02:44:48.444 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-21T02:44:48.445 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-21T02:44:48.447 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-21T02:44:48.449 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-21T02:44:48.450 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-21T02:44:48.451 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-21T02:44:48.452 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-21T02:44:48.454 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-21T02:44:48.455 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-21T02:44:48.456 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-21T02:44:48.457 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-21T02:44:48.459 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-21T02:44:48.460 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-21T02:44:48.461 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-21T02:44:48.462 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-21T02:44:48.463 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-21T02:44:48.464 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-21T02:44:48.465 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-21T02:44:48.467 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/phy/ 2024-09-21T02:44:48.468 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-21T02:44:48.469 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-21T02:44:48.470 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-21T02:44:48.471 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/platform/ 2024-09-21T02:44:48.473 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-21T02:44:48.474 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-21T02:44:48.475 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/ 2024-09-21T02:44:48.478 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-21T02:44:48.479 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-21T02:44:48.480 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-21T02:44:48.481 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-21T02:44:48.483 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-21T02:44:48.484 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-21T02:44:48.485 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-21T02:44:48.487 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-21T02:44:48.488 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-21T02:44:48.489 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-21T02:44:48.491 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-21T02:44:48.492 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-21T02:44:48.493 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-21T02:44:48.494 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-21T02:44:48.495 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-21T02:44:48.496 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-21T02:44:48.498 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-21T02:44:48.499 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-21T02:44:48.500 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-21T02:44:48.501 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-21T02:44:48.502 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-21T02:44:48.504 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-21T02:44:48.505 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-21T02:44:48.506 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-21T02:44:48.507 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-21T02:44:48.509 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-21T02:44:48.510 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-21T02:44:48.511 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-21T02:44:48.512 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-21T02:44:48.514 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-21T02:44:48.515 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-21T02:44:48.516 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-21T02:44:48.518 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-21T02:44:48.519 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-21T02:44:48.520 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-21T02:44:48.522 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-21T02:44:48.523 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-21T02:44:48.524 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-21T02:44:48.526 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-21T02:44:48.527 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-21T02:44:48.529 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-21T02:44:48.530 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-21T02:44:48.531 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-21T02:44:48.532 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-21T02:44:48.533 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-21T02:44:48.535 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-21T02:44:48.536 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pps/ 2024-09-21T02:44:48.538 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-21T02:44:48.539 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-21T02:44:48.541 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-21T02:44:48.542 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-21T02:44:48.543 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-21T02:44:48.544 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-21T02:44:48.545 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-21T02:44:48.546 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-21T02:44:48.547 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-21T02:44:48.548 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-21T02:44:48.549 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-21T02:44:48.551 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pti/ 2024-09-21T02:44:48.552 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-21T02:44:48.553 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-21T02:44:48.555 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-21T02:44:48.556 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-21T02:44:48.557 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-21T02:44:48.558 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-21T02:44:48.559 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-21T02:44:48.560 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-21T02:44:48.561 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-21T02:44:48.562 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-21T02:44:48.564 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-21T02:44:48.565 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-21T02:44:48.567 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-21T02:44:48.568 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-21T02:44:48.569 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-21T02:44:48.570 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-21T02:44:48.572 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-21T02:44:48.573 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-21T02:44:48.575 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-21T02:44:48.576 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-21T02:44:48.577 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/ 2024-09-21T02:44:48.579 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-21T02:44:48.580 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-21T02:44:48.581 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-21T02:44:48.583 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-21T02:44:48.584 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-21T02:44:48.585 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-21T02:44:48.586 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-21T02:44:48.588 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-21T02:44:48.589 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-21T02:44:48.590 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-21T02:44:48.591 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-21T02:44:48.592 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-21T02:44:48.594 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-21T02:44:48.595 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-21T02:44:48.596 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-21T02:44:48.599 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-21T02:44:48.600 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-21T02:44:48.601 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-21T02:44:48.602 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-21T02:44:48.603 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-21T02:44:48.604 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-21T02:44:48.606 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-21T02:44:48.607 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-21T02:44:48.608 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-21T02:44:48.609 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-21T02:44:48.610 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-21T02:44:48.612 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-21T02:44:48.614 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-21T02:44:48.615 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-21T02:44:48.616 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-21T02:44:48.618 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-21T02:44:48.619 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-21T02:44:48.620 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-21T02:44:48.622 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-21T02:44:48.623 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-21T02:44:48.624 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-21T02:44:48.625 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-21T02:44:48.626 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-21T02:44:48.628 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-21T02:44:48.629 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-21T02:44:48.630 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-21T02:44:48.631 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-21T02:44:48.633 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-21T02:44:48.634 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-21T02:44:48.635 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-21T02:44:48.636 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-21T02:44:48.637 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-21T02:44:48.639 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-21T02:44:48.642 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-21T02:44:48.642 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-21T02:44:48.643 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-21T02:44:48.644 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-21T02:44:48.645 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-21T02:44:48.646 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-21T02:44:48.647 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-21T02:44:48.648 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-21T02:44:48.649 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-21T02:44:48.650 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-21T02:44:48.651 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-21T02:44:48.653 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-21T02:44:48.654 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-21T02:44:48.655 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-21T02:44:48.657 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-21T02:44:48.658 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-21T02:44:48.659 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-21T02:44:48.660 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-21T02:44:48.661 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-21T02:44:48.662 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-21T02:44:48.664 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-21T02:44:48.665 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-21T02:44:48.666 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-21T02:44:48.667 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-21T02:44:48.669 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-21T02:44:48.670 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-21T02:44:48.671 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-21T02:44:48.673 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-21T02:44:48.674 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-21T02:44:48.675 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-21T02:44:48.676 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-21T02:44:48.677 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-21T02:44:48.678 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-21T02:44:48.679 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-21T02:44:48.680 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-21T02:44:48.681 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-21T02:44:48.682 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-21T02:44:48.684 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/ 2024-09-21T02:44:48.686 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-21T02:44:48.687 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-21T02:44:48.688 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-21T02:44:48.689 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-21T02:44:48.690 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-21T02:44:48.692 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-21T02:44:48.693 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-21T02:44:48.694 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-21T02:44:48.695 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-21T02:44:48.696 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-21T02:44:48.697 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-21T02:44:48.698 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-21T02:44:48.699 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-21T02:44:48.700 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-21T02:44:48.701 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/ 2024-09-21T02:44:48.702 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-21T02:44:48.704 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-21T02:44:48.705 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-21T02:44:48.706 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-21T02:44:48.707 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-21T02:44:48.708 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-21T02:44:48.709 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-21T02:44:48.710 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-21T02:44:48.712 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-21T02:44:48.713 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sh/ 2024-09-21T02:44:48.715 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-21T02:44:48.716 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-21T02:44:48.717 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-21T02:44:48.719 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/ 2024-09-21T02:44:48.720 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-21T02:44:48.721 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-21T02:44:48.723 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-21T02:44:48.724 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-21T02:44:48.725 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-21T02:44:48.726 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-21T02:44:48.727 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-21T02:44:48.729 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-21T02:44:48.730 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-21T02:44:48.731 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-21T02:44:48.732 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-21T02:44:48.733 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-21T02:44:48.735 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-21T02:44:48.736 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-21T02:44:48.737 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-21T02:44:48.738 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-21T02:44:48.739 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-21T02:44:48.741 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-21T02:44:48.742 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-21T02:44:48.743 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-21T02:44:48.744 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-21T02:44:48.745 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-21T02:44:48.746 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-21T02:44:48.748 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-21T02:44:48.749 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-21T02:44:48.751 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-21T02:44:48.752 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-21T02:44:48.753 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-21T02:44:48.754 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-21T02:44:48.755 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-21T02:44:48.756 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-21T02:44:48.757 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-21T02:44:48.758 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-21T02:44:48.760 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-21T02:44:48.761 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-21T02:44:48.762 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-21T02:44:48.763 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-21T02:44:48.765 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-21T02:44:48.766 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-21T02:44:48.767 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-21T02:44:48.768 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-21T02:44:48.769 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-21T02:44:48.770 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-21T02:44:48.771 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-21T02:44:48.772 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-21T02:44:48.773 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-21T02:44:48.774 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-21T02:44:48.775 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-21T02:44:48.776 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-21T02:44:48.777 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-21T02:44:48.778 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-21T02:44:48.780 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-21T02:44:48.781 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-21T02:44:48.782 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-21T02:44:48.783 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-21T02:44:48.784 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-21T02:44:48.785 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-21T02:44:48.787 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-21T02:44:48.788 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-21T02:44:48.789 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-21T02:44:48.790 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-21T02:44:48.792 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-21T02:44:48.793 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-21T02:44:48.794 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/ 2024-09-21T02:44:48.796 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-21T02:44:48.797 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-21T02:44:48.799 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-21T02:44:48.800 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-21T02:44:48.801 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-21T02:44:48.802 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-21T02:44:48.803 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-21T02:44:48.804 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-21T02:44:48.805 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-21T02:44:48.806 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-21T02:44:48.808 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-21T02:44:48.809 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-21T02:44:48.810 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-21T02:44:48.811 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-21T02:44:48.812 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-21T02:44:48.813 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-21T02:44:48.814 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-21T02:44:48.816 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-21T02:44:48.817 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-21T02:44:48.818 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-21T02:44:48.819 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-21T02:44:48.820 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-21T02:44:48.822 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-21T02:44:48.824 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-21T02:44:48.824 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-21T02:44:48.826 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-21T02:44:48.827 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-21T02:44:48.828 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/target/ 2024-09-21T02:44:48.829 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-21T02:44:48.830 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-21T02:44:48.831 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-21T02:44:48.832 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-21T02:44:48.834 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-21T02:44:48.835 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-21T02:44:48.836 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-21T02:44:48.837 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-21T02:44:48.839 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-21T02:44:48.840 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-21T02:44:48.841 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-21T02:44:48.842 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-21T02:44:48.843 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/ 2024-09-21T02:44:48.845 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-21T02:44:48.846 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-21T02:44:48.850 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-21T02:44:48.850 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-21T02:44:48.850 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-21T02:44:48.851 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-21T02:44:48.852 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-21T02:44:48.853 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-21T02:44:48.854 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-21T02:44:48.855 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-21T02:44:48.856 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-21T02:44:48.857 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-21T02:44:48.860 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-21T02:44:48.861 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/ 2024-09-21T02:44:48.862 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-21T02:44:48.863 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-21T02:44:48.864 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-21T02:44:48.865 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-21T02:44:48.866 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-21T02:44:48.867 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-21T02:44:48.869 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-21T02:44:48.870 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-21T02:44:48.871 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-21T02:44:48.872 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-21T02:44:48.874 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-21T02:44:48.875 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-21T02:44:48.876 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-21T02:44:48.877 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-21T02:44:48.878 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-21T02:44:48.879 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-21T02:44:48.880 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-21T02:44:48.881 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-21T02:44:48.883 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-21T02:44:48.884 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-21T02:44:48.885 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/ 2024-09-21T02:44:48.887 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-21T02:44:48.888 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-21T02:44:48.889 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-21T02:44:48.891 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-21T02:44:48.892 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-21T02:44:48.893 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-21T02:44:48.894 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-21T02:44:48.895 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-21T02:44:48.897 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-21T02:44:48.898 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-21T02:44:48.899 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-21T02:44:48.900 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-21T02:44:48.901 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-21T02:44:48.902 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-21T02:44:48.903 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-21T02:44:48.904 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-21T02:44:48.905 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-21T02:44:48.906 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-21T02:44:48.907 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-21T02:44:48.909 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-21T02:44:48.910 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-21T02:44:48.911 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-21T02:44:48.912 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-21T02:44:48.913 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-21T02:44:48.914 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-21T02:44:48.915 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-21T02:44:48.916 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-21T02:44:48.918 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-21T02:44:48.919 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-21T02:44:48.920 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-21T02:44:48.921 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-21T02:44:48.922 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-21T02:44:48.923 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-21T02:44:48.924 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-21T02:44:48.926 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-21T02:44:48.927 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-21T02:44:48.928 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-21T02:44:48.929 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-21T02:44:48.931 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-21T02:44:48.932 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-21T02:44:48.933 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-21T02:44:48.934 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-21T02:44:48.935 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-21T02:44:48.936 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-21T02:44:48.937 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-21T02:44:48.939 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-21T02:44:48.940 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-21T02:44:48.942 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-21T02:44:48.943 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-21T02:44:48.944 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-21T02:44:48.945 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-21T02:44:48.946 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-21T02:44:48.947 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-21T02:44:48.949 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-21T02:44:48.950 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-21T02:44:48.951 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-21T02:44:48.952 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-21T02:44:48.954 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-21T02:44:48.955 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-21T02:44:48.956 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-21T02:44:48.957 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-21T02:44:48.958 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-21T02:44:48.960 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-21T02:44:48.961 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-21T02:44:48.962 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-21T02:44:48.964 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-21T02:44:48.965 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-21T02:44:48.966 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-21T02:44:48.968 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-21T02:44:48.969 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-21T02:44:48.970 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-21T02:44:48.971 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-21T02:44:48.972 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-21T02:44:48.974 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-21T02:44:48.974 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-21T02:44:48.976 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-21T02:44:48.977 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-21T02:44:48.978 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-21T02:44:48.979 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-21T02:44:48.980 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-21T02:44:48.981 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-21T02:44:48.982 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-21T02:44:48.984 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-21T02:44:48.985 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-21T02:44:48.986 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-21T02:44:48.987 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-21T02:44:48.988 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-21T02:44:48.990 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-21T02:44:48.991 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-21T02:44:48.992 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-21T02:44:48.993 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-21T02:44:48.994 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-21T02:44:48.995 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-21T02:44:48.997 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-21T02:44:48.998 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-21T02:44:48.999 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-21T02:44:49.000 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-21T02:44:49.001 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-21T02:44:49.003 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-21T02:44:49.004 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-21T02:44:49.005 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-21T02:44:49.006 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-21T02:44:49.007 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-21T02:44:49.008 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-21T02:44:49.009 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-21T02:44:49.011 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-21T02:44:49.011 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-21T02:44:49.013 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-21T02:44:49.014 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-21T02:44:49.015 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-21T02:44:49.016 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-21T02:44:49.018 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-21T02:44:49.019 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-21T02:44:49.020 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-21T02:44:49.021 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-21T02:44:49.022 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-21T02:44:49.024 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-21T02:44:49.025 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-21T02:44:49.026 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-21T02:44:49.027 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-21T02:44:49.028 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-21T02:44:49.030 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-21T02:44:49.031 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-21T02:44:49.034 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-21T02:44:49.039 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-21T02:44:49.041 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-21T02:44:49.042 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-21T02:44:49.043 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-21T02:44:49.044 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-21T02:44:49.046 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-21T02:44:49.047 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-21T02:44:49.048 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-21T02:44:49.049 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-21T02:44:49.050 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-21T02:44:49.051 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-21T02:44:49.052 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-21T02:44:49.053 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-21T02:44:49.055 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-21T02:44:49.056 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-21T02:44:49.057 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-21T02:44:49.058 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-21T02:44:49.060 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-21T02:44:49.061 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-21T02:44:49.063 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-21T02:44:49.064 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-21T02:44:49.065 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-21T02:44:49.067 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-21T02:44:49.068 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-21T02:44:49.070 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-21T02:44:49.071 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-21T02:44:49.073 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/ 2024-09-21T02:44:49.075 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-21T02:44:49.076 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-21T02:44:49.077 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-21T02:44:49.078 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-21T02:44:49.079 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-21T02:44:49.081 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-21T02:44:49.082 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-21T02:44:49.084 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-21T02:44:49.085 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-21T02:44:49.086 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-21T02:44:49.088 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-21T02:44:49.089 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-21T02:44:49.090 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-21T02:44:49.092 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-21T02:44:49.093 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-21T02:44:49.095 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-21T02:44:49.096 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-21T02:44:49.098 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-21T02:44:49.100 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-21T02:44:49.101 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-21T02:44:49.102 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-21T02:44:49.104 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-21T02:44:49.105 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-21T02:44:49.107 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-21T02:44:49.108 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-21T02:44:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:48 smithi172 ceph-mon[35067]: pgmap v471: 129 pgs: 129 active+clean; 91 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 5.1 MiB/s wr, 262 op/s 2024-09-21T02:44:49.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:48 smithi084 ceph-mon[30747]: pgmap v471: 129 pgs: 129 active+clean; 91 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 5.1 MiB/s wr, 262 op/s 2024-09-21T02:44:49.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:48 smithi090 ceph-mon[34571]: pgmap v471: 129 pgs: 129 active+clean; 91 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 5.1 MiB/s wr, 262 op/s 2024-09-21T02:44:49.338 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/ 2024-09-21T02:44:49.340 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-21T02:44:49.342 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-21T02:44:49.343 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-21T02:44:49.344 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-21T02:44:49.345 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-21T02:44:49.347 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-21T02:44:49.348 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-21T02:44:49.349 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-21T02:44:49.351 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-21T02:44:49.352 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-21T02:44:49.354 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-21T02:44:49.355 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-21T02:44:49.356 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-21T02:44:49.357 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-21T02:44:49.358 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-21T02:44:49.359 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-21T02:44:49.361 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-21T02:44:49.362 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-21T02:44:49.363 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-21T02:44:49.365 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-21T02:44:49.366 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-21T02:44:49.367 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-21T02:44:49.368 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-21T02:44:49.369 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-21T02:44:49.371 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-21T02:44:49.372 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-21T02:44:49.373 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-21T02:44:49.374 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-21T02:44:49.375 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-21T02:44:49.376 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-21T02:44:49.378 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-21T02:44:49.380 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-21T02:44:49.381 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-21T02:44:49.382 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-21T02:44:49.383 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/ 2024-09-21T02:44:49.385 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-21T02:44:49.386 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-21T02:44:49.387 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-21T02:44:49.388 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-21T02:44:49.389 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-21T02:44:49.390 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-21T02:44:49.391 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-21T02:44:49.392 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-21T02:44:49.393 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-21T02:44:49.394 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-21T02:44:49.396 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-21T02:44:49.397 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-21T02:44:49.398 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-21T02:44:49.399 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-21T02:44:49.400 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-21T02:44:49.401 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-21T02:44:49.402 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-21T02:44:49.403 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-21T02:44:49.405 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-21T02:44:49.406 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-21T02:44:49.407 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-21T02:44:49.408 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-21T02:44:49.409 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-21T02:44:49.410 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-21T02:44:49.411 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-21T02:44:49.412 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-21T02:44:49.414 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-21T02:44:49.415 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-21T02:44:49.416 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-21T02:44:49.418 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-21T02:44:49.419 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-21T02:44:49.420 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-21T02:44:49.421 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-21T02:44:49.423 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-21T02:44:49.424 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-21T02:44:49.425 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-21T02:44:49.426 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-21T02:44:49.427 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-21T02:44:49.428 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-21T02:44:49.429 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-21T02:44:49.430 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-21T02:44:49.432 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-21T02:44:49.434 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-21T02:44:49.436 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-21T02:44:49.437 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-21T02:44:49.439 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-21T02:44:49.440 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-21T02:44:49.441 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-21T02:44:49.442 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-21T02:44:49.443 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-21T02:44:49.444 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-21T02:44:49.446 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-21T02:44:49.447 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-21T02:44:49.448 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-21T02:44:49.449 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-21T02:44:49.450 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-21T02:44:49.451 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-21T02:44:49.452 INFO:tasks.workunit.client.0.smithi084.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-21T02:44:51.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:50 smithi172 ceph-mon[35067]: pgmap v472: 129 pgs: 129 active+clean; 91 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 5.1 MiB/s wr, 259 op/s 2024-09-21T02:44:51.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:50 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:51.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:50 smithi084 ceph-mon[30747]: pgmap v472: 129 pgs: 129 active+clean; 91 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 5.1 MiB/s wr, 259 op/s 2024-09-21T02:44:51.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:50 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:51.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:50 smithi090 ceph-mon[34571]: pgmap v472: 129 pgs: 129 active+clean; 91 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 5.1 MiB/s wr, 259 op/s 2024-09-21T02:44:51.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:50 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 -- 172.21.15.84:0/4009510660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1601034e0 msgr2=0x7fc160103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 --2- 172.21.15.84:0/4009510660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1601034e0 0x7fc160103950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc150009860 tx=0x7fc15002a340 comp rx=0 tx=0).stop 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 -- 172.21.15.84:0/4009510660 shutdown_connections 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 --2- 172.21.15.84:0/4009510660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc160104f00 0x7fc16010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 --2- 172.21.15.84:0/4009510660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc160104560 0x7fc160104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 --2- 172.21.15.84:0/4009510660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1601034e0 0x7fc160103950 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 -- 172.21.15.84:0/4009510660 >> 172.21.15.84:0/4009510660 conn(0x7fc1600fee20 msgr2=0x7fc1601012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 -- 172.21.15.84:0/4009510660 shutdown_connections 2024-09-21T02:44:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.312+0000 7fc15fe00640 1 -- 172.21.15.84:0/4009510660 wait complete. 2024-09-21T02:44:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.313+0000 7fc15fe00640 1 Processor -- start 2024-09-21T02:44:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.313+0000 7fc15fe00640 1 -- start start 2024-09-21T02:44:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1601034e0 0x7fc16019c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc160104560 0x7fc16019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc160104f00 0x7fc16019d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc16010f280 con 0x7fc1601034e0 2024-09-21T02:44:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc16010f100 con 0x7fc160104560 2024-09-21T02:44:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15fe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc16010f400 con 0x7fc160104f00 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1601034e0 0x7fc16019c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1601034e0 0x7fc16019c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56958/0 (socket says 172.21.15.84:56958) 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15ea00640 1 -- 172.21.15.84:0/104964162 learned_addr learned my addr 172.21.15.84:0/104964162 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15f400640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc160104f00 0x7fc16019d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.314+0000 7fc15e000640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc160104560 0x7fc16019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc15ea00640 1 -- 172.21.15.84:0/104964162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc160104f00 msgr2=0x7fc16019d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc15ea00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc160104f00 0x7fc16019d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc15ea00640 1 -- 172.21.15.84:0/104964162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc160104560 msgr2=0x7fc16019c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc15ea00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc160104560 0x7fc16019c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc15ea00640 1 -- 172.21.15.84:0/104964162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16019da50 con 0x7fc1601034e0 2024-09-21T02:44:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc15ea00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1601034e0 0x7fc16019c010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc150009980 tx=0x7fc150032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc157400640 1 -- 172.21.15.84:0/104964162 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150037040 con 0x7fc1601034e0 2024-09-21T02:44:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc157400640 1 -- 172.21.15.84:0/104964162 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc150040070 con 0x7fc1601034e0 2024-09-21T02:44:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc15fe00640 1 -- 172.21.15.84:0/104964162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16019dce0 con 0x7fc1601034e0 2024-09-21T02:44:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.315+0000 7fc157400640 1 -- 172.21.15.84:0/104964162 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150003850 con 0x7fc1601034e0 2024-09-21T02:44:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.316+0000 7fc15fe00640 1 -- 172.21.15.84:0/104964162 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16019dff0 con 0x7fc1601034e0 2024-09-21T02:44:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc16cbd6740 1 Processor -- start 2024-09-21T02:44:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc16cbd6740 1 -- start start 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cfa1b0 0x55d8690a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cd94d0 0x55d8690a2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d8690146b0 con 0x55d868cd12f0 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d869003ae0 con 0x55d868cfa1b0 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d8690078f0 con 0x55d868cd94d0 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.319+0000 7fc157400640 1 -- 172.21.15.84:0/104964162 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fc1500039f0 con 0x7fc1601034e0 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cfa1b0 0x55d8690a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15e000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cd94d0 0x55d8690a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cfa1b0 0x55d8690a12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58596/0 (socket says 172.21.15.84:58596) 2024-09-21T02:44:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 -- 172.21.15.84:0/468303853 learned_addr learned my addr 172.21.15.84:0/468303853 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15ea00640 1 --2- 172.21.15.84:0/468303853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 -- 172.21.15.84:0/468303853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cd94d0 msgr2=0x55d8690a2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 --2- 172.21.15.84:0/468303853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cd94d0 0x55d8690a2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 -- 172.21.15.84:0/468303853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 msgr2=0x55d8690a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 --2- 172.21.15.84:0/468303853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 -- 172.21.15.84:0/468303853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d868fd0780 con 0x55d868cfa1b0 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.320+0000 7fc15f400640 1 --2- 172.21.15.84:0/468303853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cfa1b0 0x55d8690a12b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc158009fd0 tx=0x7fc1580118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff822caff882d319 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.321+0000 7fc14be00640 1 -- 172.21.15.84:0/468303853 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158004d20 con 0x55d868cfa1b0 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.321+0000 7fc14be00640 1 -- 172.21.15.84:0/468303853 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc158004050 con 0x55d868cfa1b0 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.321+0000 7fc14be00640 1 -- 172.21.15.84:0/468303853 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158005260 con 0x55d868cfa1b0 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.321+0000 7fc157400640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc1440b6510 0x7fc1440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc157400640 1 -- 172.21.15.84:0/104964162 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc150107240 con 0x7fc1601034e0 2024-09-21T02:44:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc15ea00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc1440b6510 0x7fc1440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 -- 172.21.15.84:0/468303853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cfa1b0 msgr2=0x55d8690a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/468303853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cfa1b0 0x55d8690a12b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc158009fd0 tx=0x7fc1580118d0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 -- 172.21.15.84:0/468303853 shutdown_connections 2024-09-21T02:44:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/468303853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cd94d0 0x55d8690a2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/468303853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/468303853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cfa1b0 0x55d8690a12b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 -- 172.21.15.84:0/468303853 >> 172.21.15.84:0/468303853 conn(0x55d868cee300 msgr2=0x55d86909cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc15ea00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc1440b6510 0x7fc1440b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc150035040 tx=0x7fc15002a340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 -- 172.21.15.84:0/468303853 shutdown_connections 2024-09-21T02:44:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.322+0000 7fc16cbd6740 1 -- 172.21.15.84:0/468303853 wait complete. 2024-09-21T02:44:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.323+0000 7fc16cbd6740 1 -- start start 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.323+0000 7fc16cbd6740 1 Processor -- start 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd12f0 0x55d8690aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd94d0 0x55d8690aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690abb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d868f3bab0 con 0x55d868cd94d0 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55d868faa570 con 0x55d868cd12f0 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d8690a2f90 con 0x55d868cfa1b0 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc16cbd6740 10 client.0 _ll_register_callbacks cb 0x55d868fb9100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc15f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd12f0 0x55d8690aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc15f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd12f0 0x55d8690aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58610/0 (socket says 172.21.15.84:58610) 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc15f400640 1 -- 172.21.15.84:0/2571844772 learned_addr learned my addr 172.21.15.84:0/2571844772 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc15e000640 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd94d0 0x55d8690aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.324+0000 7fc15f400640 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.325+0000 7fc15f400640 1 -- 172.21.15.84:0/2571844772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 msgr2=0x55d8690abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.325+0000 7fc15f400640 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.325+0000 7fc15f400640 1 -- 172.21.15.84:0/2571844772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd94d0 msgr2=0x55d8690aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.325+0000 7fc15f400640 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd94d0 0x55d8690aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.325+0000 7fc15f400640 1 -- 172.21.15.84:0/2571844772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d868d65790 con 0x55d868cd12f0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.325+0000 7fc15f400640 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd12f0 0x55d8690aa910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc15801b040 tx=0x7fc158000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76ec3fd844f80050 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.325+0000 7fc148c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.326+0000 7fc148c00640 1 -- 172.21.15.84:0/2571844772 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1580045e0 con 0x55d868cd12f0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.326+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2571844772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc158004050 con 0x55d868cd12f0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.326+0000 7fc148c00640 1 -- 172.21.15.84:0/2571844772 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc15800f4e0 con 0x55d868cd12f0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.326+0000 7fc148c00640 1 -- 172.21.15.84:0/2571844772 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc158036050 con 0x55d868cd12f0 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.326+0000 7fc16cbd6740 10 client.25691 fetch_fsmap learned FSMap version 30 2024-09-21T02:44:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.326+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2571844772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d868dde620 con 0x55d868cd12f0 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc148c00640 1 -- 172.21.15.84:0/2571844772 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc158004050 con 0x55d868cd12f0 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc148c00640 1 -- 172.21.15.84:0/2571844772 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fc158028810 con 0x55d868cd12f0 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc16cbd6740 10 client.25691 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc16cbd6740 10 client.25691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc16cbd6740 20 client.25691 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d868cb8d80 0x55d8690b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc16cbd6740 4 client.25691 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2571844772 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d869016600 con 0x55d868cb8d80 2024-09-21T02:44:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.327+0000 7fc15e000640 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d868cb8d80 0x55d8690b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.328+0000 7fc148c00640 10 client.25691 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.328+0000 7fc15e000640 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d868cb8d80 0x55d8690b7df0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a732ba4949ffeccb server_cookie=4db7e0650efbe283 in_seq=0 out_seq=0 2024-09-21T02:44:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc148c00640 1 -- 172.21.15.84:0/2571844772 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d869016600 con 0x55d868cb8d80 2024-09-21T02:44:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc148c00640 10 client.25691 handle_command_reply: tid=0 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 client.25691 shutdown 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2571844772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd12f0 msgr2=0x55d8690aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd12f0 0x55d8690aa910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc15801b040 tx=0x7fc158000f40 comp rx=0 tx=0).stop 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2571844772 shutdown_connections 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d868cb8d80 0x55d8690b7df0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd94d0 0x55d8690aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2571844772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd12f0 0x55d8690aa910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc148c00640 0 client.25691 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2571844772 >> 172.21.15.84:0/2571844772 conn(0x55d868cee300 msgr2=0x55d8690a2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2571844772 shutdown_connections 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2571844772 wait complete. 2024-09-21T02:44:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.329+0000 7fc16cbd6740 20 client.25691 trim_cache size 0 max 16384 2024-09-21T02:44:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.352+0000 7fc16cbd6740 1 Processor -- start 2024-09-21T02:44:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.352+0000 7fc16cbd6740 1 -- start start 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d86909ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d86909d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601b10d0 con 0x55d868cd12f0 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601ae940 con 0x55d868cd94d0 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601ac790 con 0x55d868cfa1b0 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc15f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc15f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56988/0 (socket says 172.21.15.84:56988) 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc15f400640 1 -- 172.21.15.84:0/2777629475 learned_addr learned my addr 172.21.15.84:0/2777629475 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.353+0000 7fc15e000640 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d86909ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc15f400640 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d86909d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc15e000640 1 -- 172.21.15.84:0/2777629475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 msgr2=0x55d86909d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc15e000640 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d86909d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc15e000640 1 -- 172.21.15.84:0/2777629475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 msgr2=0x55d8690a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc15e000640 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc15e000640 1 -- 172.21.15.84:0/2777629475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d86909d6c0 con 0x55d868cd94d0 2024-09-21T02:44:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc15f400640 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc15e000640 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d86909ba70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55d8690b8350 tx=0x7fc14c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b12b0d5c40684e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc14b400640 1 -- 172.21.15.84:0/2777629475 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c005020 con 0x55d868cd94d0 2024-09-21T02:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc14b400640 1 -- 172.21.15.84:0/2777629475 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc14c00f870 con 0x55d868cd94d0 2024-09-21T02:44:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.354+0000 7fc14b400640 1 -- 172.21.15.84:0/2777629475 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c004b00 con 0x55d868cd94d0 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.355+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2777629475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 msgr2=0x55d86909ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.355+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d86909ba70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55d8690b8350 tx=0x7fc14c009260 comp rx=0 tx=0).stop 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.355+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2777629475 shutdown_connections 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.355+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d86909d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.355+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d86909ba70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.355+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2777629475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690a2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.355+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2777629475 >> 172.21.15.84:0/2777629475 conn(0x55d868cee300 msgr2=0x55d86909b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.355+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2777629475 shutdown_connections 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.356+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2777629475 wait complete. 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.356+0000 7fc16cbd6740 1 -- start start 2024-09-21T02:44:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.356+0000 7fc16cbd6740 1 Processor -- start 2024-09-21T02:44:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d8690aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc16cbd6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601ace00 con 0x55d868cd12f0 2024-09-21T02:44:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601ae270 con 0x55d868cd94d0 2024-09-21T02:44:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc16cbd6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1601ad4d0 con 0x55d868cfa1b0 2024-09-21T02:44:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc16cbd6740 10 client.0 _ll_register_callbacks cb 0x7fc14c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d8690aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15e000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d8690aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58620/0 (socket says 172.21.15.84:58620) 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15e000640 1 -- 172.21.15.84:0/2376316803 learned_addr learned my addr 172.21.15.84:0/2376316803 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15f400640 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15e000640 1 -- 172.21.15.84:0/2376316803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 msgr2=0x55d8690af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15e000640 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15e000640 1 -- 172.21.15.84:0/2376316803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 msgr2=0x55d8690ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15e000640 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15e000640 1 -- 172.21.15.84:0/2376316803 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8690afde0 con 0x55d868cd94d0 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.357+0000 7fc15f400640 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.358+0000 7fc15e000640 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d8690aec10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00a010 tx=0x7fc14c00fb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95a6578fe0e664ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.358+0000 7fc148c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:44:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.358+0000 7fc148c00640 1 -- 172.21.15.84:0/2376316803 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c005020 con 0x55d868cd94d0 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.358+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2376316803 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc14c00f870 con 0x55d868cd94d0 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.358+0000 7fc148c00640 1 -- 172.21.15.84:0/2376316803 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc14c0051c0 con 0x55d868cd94d0 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.358+0000 7fc148c00640 1 -- 172.21.15.84:0/2376316803 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc14c0053e0 con 0x55d868cd94d0 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.358+0000 7fc16cbd6740 10 client.25697 fetch_fsmap learned FSMap version 30 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.358+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2376316803 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d869123040 con 0x55d868cd94d0 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc148c00640 1 -- 172.21.15.84:0/2376316803 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc14c00f870 con 0x55d868cd94d0 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc148c00640 1 -- 172.21.15.84:0/2376316803 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fc14c024890 con 0x55d868cd94d0 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc16cbd6740 10 client.25697 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc16cbd6740 10 client.25697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc16cbd6740 20 client.25697 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d868c8e1c0 0x55d8691259e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc16cbd6740 4 client.25697 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:44:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2376316803 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8690120b0 con 0x55d868c8e1c0 2024-09-21T02:44:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.359+0000 7fc15f400640 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d868c8e1c0 0x55d8691259e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.360+0000 7fc15f400640 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d868c8e1c0 0x55d8691259e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f37969f3826f358 server_cookie=affcd96cc25c6238 in_seq=0 out_seq=0 2024-09-21T02:44:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.360+0000 7fc148c00640 10 client.25697 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.395+0000 7fc148c00640 1 -- 172.21.15.84:0/2376316803 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8690120b0 con 0x55d868c8e1c0 2024-09-21T02:44:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.395+0000 7fc148c00640 10 client.25697 handle_command_reply: tid=0 2024-09-21T02:44:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 client.25697 shutdown 2024-09-21T02:44:52.397 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2376316803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 msgr2=0x55d8690aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d8690aec10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00a010 tx=0x7fc14c00fb30 comp rx=0 tx=0).stop 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2376316803 shutdown_connections 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d868cfa1b0 0x55d8690af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55d868c8e1c0 0x55d8691259e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d868cd94d0 0x55d8690aec10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 --2- 172.21.15.84:0/2376316803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d868cd12f0 0x55d8690ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc148c00640 0 client.25697 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2376316803 >> 172.21.15.84:0/2376316803 conn(0x55d868cee300 msgr2=0x55d86909baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2376316803 shutdown_connections 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 1 -- 172.21.15.84:0/2376316803 wait complete. 2024-09-21T02:44:52.398 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.396+0000 7fc16cbd6740 20 client.25697 trim_cache size 0 max 16384 2024-09-21T02:44:52.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:44:52.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:44:52.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:44:52.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:44:52.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 -- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc1440b6510 msgr2=0x7fc1440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc1440b6510 0x7fc1440b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc150035040 tx=0x7fc15002a340 comp rx=0 tx=0).stop 2024-09-21T02:44:52.399 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 -- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1601034e0 msgr2=0x7fc16019c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1601034e0 0x7fc16019c010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc150009980 tx=0x7fc150032670 comp rx=0 tx=0).stop 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 -- 172.21.15.84:0/104964162 shutdown_connections 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc1440b6510 0x7fc1440b8a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc160104f00 0x7fc16019d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc160104560 0x7fc16019c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 --2- 172.21.15.84:0/104964162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1601034e0 0x7fc16019c010 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 -- 172.21.15.84:0/104964162 >> 172.21.15.84:0/104964162 conn(0x7fc1600fee20 msgr2=0x7fc1600755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 -- 172.21.15.84:0/104964162 shutdown_connections 2024-09-21T02:44:52.400 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:44:52.397+0000 7fc15fe00640 1 -- 172.21.15.84:0/104964162 wait complete. 2024-09-21T02:44:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:52 smithi172 ceph-mon[35067]: pgmap v473: 129 pgs: 129 active+clean; 93 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 5.3 MiB/s wr, 267 op/s 2024-09-21T02:44:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:52 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:44:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:52 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:44:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:52 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:44:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:52 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:44:53.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:52 smithi084 ceph-mon[30747]: pgmap v473: 129 pgs: 129 active+clean; 93 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 5.3 MiB/s wr, 267 op/s 2024-09-21T02:44:53.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:52 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:44:53.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:52 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:44:53.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:52 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:44:53.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:52 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:44:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:52 smithi090 ceph-mon[34571]: pgmap v473: 129 pgs: 129 active+clean; 93 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 5.3 MiB/s wr, 267 op/s 2024-09-21T02:44:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:52 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:44:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:52 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:44:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:52 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:44:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:52 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:44:54.658 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-21T02:44:55.057 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:54 smithi172 ceph-mon[35067]: pgmap v474: 129 pgs: 129 active+clean; 95 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.2 MiB/s wr, 103 op/s 2024-09-21T02:44:55.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:54 smithi084 ceph-mon[30747]: pgmap v474: 129 pgs: 129 active+clean; 95 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.2 MiB/s wr, 103 op/s 2024-09-21T02:44:55.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:54 smithi090 ceph-mon[34571]: pgmap v474: 129 pgs: 129 active+clean; 95 MiB data, 595 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.2 MiB/s wr, 103 op/s 2024-09-21T02:44:55.754 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar xf doc.tar 2024-09-21T02:44:56.018 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T02:44:56.018 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T02:44:56.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:44:56.405 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:44:56.844 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:56 smithi084 ceph-mon[30747]: pgmap v475: 129 pgs: 129 active+clean; 95 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 798 KiB/s wr, 45 op/s 2024-09-21T02:44:57.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 -- 172.21.15.84:0/2033099671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f8105bb0 msgr2=0x7fa9f8105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:57.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2033099671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f8105bb0 0x7fa9f8105fc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009900 tx=0x7fa9e802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 -- 172.21.15.84:0/2033099671 shutdown_connections 2024-09-21T02:44:57.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2033099671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9f810be40 0x7fa9f8112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2033099671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f810b4f0 0x7fa9f810b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2033099671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f8105bb0 0x7fa9f8105fc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 -- 172.21.15.84:0/2033099671 >> 172.21.15.84:0/2033099671 conn(0x7fa9f8101680 msgr2=0x7fa9f8103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:57.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 -- 172.21.15.84:0/2033099671 shutdown_connections 2024-09-21T02:44:57.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.025+0000 7fa9fce00640 1 -- 172.21.15.84:0/2033099671 wait complete. 2024-09-21T02:44:57.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.027+0000 7fa9fce00640 1 Processor -- start 2024-09-21T02:44:57.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.027+0000 7fa9fce00640 1 -- start start 2024-09-21T02:44:57.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.027+0000 7fa9fce00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f8105bb0 0x7fa9f819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:57.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.027+0000 7fa9fce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9f810b4f0 0x7fa9f819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:57.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.027+0000 7fa9fce00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f810be40 0x7fa9f81a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:57.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.027+0000 7fa9fce00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8115c90 con 0x7fa9f810b4f0 2024-09-21T02:44:57.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.027+0000 7fa9fce00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8115b10 con 0x7fa9f8105bb0 2024-09-21T02:44:57.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.027+0000 7fa9fce00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f8115e10 con 0x7fa9f810be40 2024-09-21T02:44:57.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f8105bb0 0x7fa9f819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:57.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9eea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9f810b4f0 0x7fa9f819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:57.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f8105bb0 0x7fa9f819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58638/0 (socket says 172.21.15.84:58638) 2024-09-21T02:44:57.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7400640 1 -- 172.21.15.84:0/2226351402 learned_addr learned my addr 172.21.15.84:0/2226351402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:57.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7e00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f810be40 0x7fa9f81a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:57.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7400640 1 -- 172.21.15.84:0/2226351402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f810be40 msgr2=0x7fa9f81a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:57.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7400640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f810be40 0x7fa9f81a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7400640 1 -- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9f810b4f0 msgr2=0x7fa9f819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:57.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7400640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9f810b4f0 0x7fa9f819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7400640 1 -- 172.21.15.84:0/2226351402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f81a2570 con 0x7fa9f8105bb0 2024-09-21T02:44:57.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9f7e00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f810be40 0x7fa9f81a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:57.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.028+0000 7fa9eea00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9f810b4f0 0x7fa9f819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:57.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.029+0000 7fa9f7400640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f8105bb0 0x7fa9f819c600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80314b0 tx=0x7fa9e8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:57.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.029+0000 7fa9f4c00640 1 -- 172.21.15.84:0/2226351402 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e803f070 con 0x7fa9f8105bb0 2024-09-21T02:44:57.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.029+0000 7fa9f4c00640 1 -- 172.21.15.84:0/2226351402 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9e8031bf0 con 0x7fa9f8105bb0 2024-09-21T02:44:57.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.029+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f81a2800 con 0x7fa9f8105bb0 2024-09-21T02:44:57.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.029+0000 7fa9f4c00640 1 -- 172.21.15.84:0/2226351402 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8035030 con 0x7fa9f8105bb0 2024-09-21T02:44:57.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.029+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f81a8fc0 con 0x7fa9f8105bb0 2024-09-21T02:44:57.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.030+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f8106e30 con 0x7fa9f8105bb0 2024-09-21T02:44:57.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.033+0000 7fa9f4c00640 1 -- 172.21.15.84:0/2226351402 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fa9e803bd10 con 0x7fa9f8105bb0 2024-09-21T02:44:57.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.035+0000 7fa9f4c00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9dc0b6590 0x7fa9dc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:57.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.035+0000 7fa9f4c00640 1 -- 172.21.15.84:0/2226351402 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa9e8108320 con 0x7fa9f8105bb0 2024-09-21T02:44:57.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.035+0000 7fa9eea00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9dc0b6590 0x7fa9dc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:57.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.036+0000 7fa9eea00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9dc0b6590 0x7fa9dc0b8aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8104ed0 tx=0x7fa9e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:57.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.036+0000 7fa9f4c00640 1 -- 172.21.15.84:0/2226351402 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9e8031da0 con 0x7fa9f8105bb0 2024-09-21T02:44:57.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:56 smithi172 ceph-mon[35067]: pgmap v475: 129 pgs: 129 active+clean; 95 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 798 KiB/s wr, 45 op/s 2024-09-21T02:44:57.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:56 smithi090 ceph-mon[34571]: pgmap v475: 129 pgs: 129 active+clean; 95 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 798 KiB/s wr, 45 op/s 2024-09-21T02:44:57.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.282+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9f810dc70 con 0x7fa9f8105bb0 2024-09-21T02:44:57.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.284+0000 7fa9f4c00640 1 -- 172.21.15.84:0/2226351402 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11913 (secure 0 0 0) 0x7fa9e80d2ba0 con 0x7fa9f8105bb0 2024-09-21T02:44:57.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:44:57.285 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":30,"btime":"2024-09-21T02:44:49:769551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:44:49.033686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:44:57.286 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 30 2024-09-21T02:44:57.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9dc0b6590 msgr2=0x7fa9dc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9dc0b6590 0x7fa9dc0b8aa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8104ed0 tx=0x7fa9e0005f90 comp rx=0 tx=0).stop 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f8105bb0 msgr2=0x7fa9f819c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f8105bb0 0x7fa9f819c600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80314b0 tx=0x7fa9e8003c10 comp rx=0 tx=0).stop 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 shutdown_connections 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa9dc0b6590 0x7fa9dc0b8aa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9f810be40 0x7fa9f81a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9f810b4f0 0x7fa9f819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 --2- 172.21.15.84:0/2226351402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f8105bb0 0x7fa9f819c600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 >> 172.21.15.84:0/2226351402 conn(0x7fa9f8101680 msgr2=0x7fa9f810ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 shutdown_connections 2024-09-21T02:44:57.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:57.286+0000 7fa9fce00640 1 -- 172.21.15.84:0/2226351402 wait complete. 2024-09-21T02:44:58.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:57 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2226351402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:58.133 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T02:44:58.133 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T02:44:58.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:57 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2226351402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:58.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:57 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2226351402' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:44:58.520 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:44:58.970 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:44:58 smithi084 ceph-mon[30747]: pgmap v476: 129 pgs: 129 active+clean; 96 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 702 KiB/s wr, 67 op/s 2024-09-21T02:44:59.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 -- 172.21.15.84:0/1346552605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73701047f0 msgr2=0x7f7370104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 --2- 172.21.15.84:0/1346552605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73701047f0 0x7f7370104c00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7364009900 tx=0x7f736402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 -- 172.21.15.84:0/1346552605 shutdown_connections 2024-09-21T02:44:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 --2- 172.21.15.84:0/1346552605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f737010dc50 0x7f7370110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 --2- 172.21.15.84:0/1346552605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7370105140 0x7f737010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 --2- 172.21.15.84:0/1346552605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73701047f0 0x7f7370104c00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 -- 172.21.15.84:0/1346552605 >> 172.21.15.84:0/1346552605 conn(0x7f73700fe330 msgr2=0x7f7370100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 -- 172.21.15.84:0/1346552605 shutdown_connections 2024-09-21T02:44:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.164+0000 7f7376c00640 1 -- 172.21.15.84:0/1346552605 wait complete. 2024-09-21T02:44:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.165+0000 7f7376c00640 1 Processor -- start 2024-09-21T02:44:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.165+0000 7f7376c00640 1 -- start start 2024-09-21T02:44:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.165+0000 7f7376c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73701047f0 0x7f737019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.165+0000 7f7376c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7370105140 0x7f737019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7376c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737010dc50 0x7f73701a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7376c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7370113a40 con 0x7f7370105140 2024-09-21T02:44:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7376c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73701138c0 con 0x7f737010dc50 2024-09-21T02:44:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7376c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7370113bc0 con 0x7f73701047f0 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7375800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73701047f0 0x7f737019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7375800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73701047f0 0x7f737019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:43462/0 (socket says 172.21.15.84:43462) 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7375800640 1 -- 172.21.15.84:0/3049328807 learned_addr learned my addr 172.21.15.84:0/3049328807 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7376200640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737010dc50 0x7f73701a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7374e00640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7370105140 0x7f737019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7375800640 1 -- 172.21.15.84:0/3049328807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737010dc50 msgr2=0x7f73701a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7375800640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737010dc50 0x7f73701a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7375800640 1 -- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7370105140 msgr2=0x7f737019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7375800640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7370105140 0x7f737019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7375800640 1 -- 172.21.15.84:0/3049328807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73701a25a0 con 0x7f73701047f0 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.166+0000 7f7374e00640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7370105140 0x7f737019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.167+0000 7f7375800640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73701047f0 0x7f737019c630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73640314b0 tx=0x7f7364003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:59.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.167+0000 7f736e000640 1 -- 172.21.15.84:0/3049328807 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736403f070 con 0x7f73701047f0 2024-09-21T02:44:59.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.167+0000 7f7376c00640 1 -- 172.21.15.84:0/3049328807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73701a2830 con 0x7f73701047f0 2024-09-21T02:44:59.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.167+0000 7f736e000640 1 -- 172.21.15.84:0/3049328807 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7364031bf0 con 0x7f73701047f0 2024-09-21T02:44:59.170 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:44:58 smithi090 ceph-mon[34571]: pgmap v476: 129 pgs: 129 active+clean; 96 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 702 KiB/s wr, 67 op/s 2024-09-21T02:44:59.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.167+0000 7f736e000640 1 -- 172.21.15.84:0/3049328807 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364035030 con 0x7f73701047f0 2024-09-21T02:44:59.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.167+0000 7f7376c00640 1 -- 172.21.15.84:0/3049328807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73701a8ff0 con 0x7f73701047f0 2024-09-21T02:44:59.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.170+0000 7f737ee81740 1 Processor -- start 2024-09-21T02:44:59.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.170+0000 7f737ee81740 1 -- start start 2024-09-21T02:44:59.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f736e000640 1 -- 172.21.15.84:0/3049328807 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f7364042070 con 0x7f73701047f0 2024-09-21T02:44:59.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f737ee81740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2661510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f737ee81740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac2661a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f737ee81740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac2661f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f737ee81740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556ac25d6ca0 con 0x556ac22b9840 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f737ee81740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556ac25c60d0 con 0x556ac2290980 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f737ee81740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556ac25c9ee0 con 0x556ac2298b60 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f7374e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac2661f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f7376200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2661510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f7375800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac2661a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f7374e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac2661f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:43466/0 (socket says 172.21.15.84:43466) 2024-09-21T02:44:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.171+0000 7f7374e00640 1 -- 172.21.15.84:0/2017791813 learned_addr learned my addr 172.21.15.84:0/2017791813 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.172+0000 7f7375800640 1 -- 172.21.15.84:0/2017791813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 msgr2=0x556ac2661f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.172+0000 7f7375800640 1 --2- 172.21.15.84:0/2017791813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac2661f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.172+0000 7f7375800640 1 -- 172.21.15.84:0/2017791813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 msgr2=0x556ac2661510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.172+0000 7f7375800640 1 --2- 172.21.15.84:0/2017791813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2661510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.172+0000 7f7375800640 1 -- 172.21.15.84:0/2017791813 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac2578400 con 0x556ac2290980 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.172+0000 7f7374e00640 1 --2- 172.21.15.84:0/2017791813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac2661f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.172+0000 7f7375800640 1 --2- 172.21.15.84:0/2017791813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac2661a50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f73641054b0 tx=0x7f7364110460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1830b7a46c0e9d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.172+0000 7f7362a00640 1 -- 172.21.15.84:0/2017791813 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364117070 con 0x556ac2290980 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.173+0000 7f7362a00640 1 -- 172.21.15.84:0/2017791813 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f736410db10 con 0x556ac2290980 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.173+0000 7f736e000640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f73580b6500 0x7f73580b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.173+0000 7f7362a00640 1 -- 172.21.15.84:0/2017791813 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736410ca80 con 0x556ac2290980 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.173+0000 7f736e000640 1 -- 172.21.15.84:0/3049328807 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f7364107d70 con 0x7f73701047f0 2024-09-21T02:44:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.173+0000 7f7376200640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f73580b6500 0x7f73580b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.173+0000 7f737ee81740 1 -- 172.21.15.84:0/2017791813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 msgr2=0x556ac2661a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.173+0000 7f737ee81740 1 --2- 172.21.15.84:0/2017791813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac2661a50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f73641054b0 tx=0x7f7364110460 comp rx=0 tx=0).stop 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f737ee81740 1 -- 172.21.15.84:0/2017791813 shutdown_connections 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f737ee81740 1 --2- 172.21.15.84:0/2017791813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac2661f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f737ee81740 1 --2- 172.21.15.84:0/2017791813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac2661a50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f737ee81740 1 --2- 172.21.15.84:0/2017791813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2661510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f737ee81740 1 -- 172.21.15.84:0/2017791813 >> 172.21.15.84:0/2017791813 conn(0x556ac22ad990 msgr2=0x556ac265f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f7376200640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f73580b6500 0x7f73580b8a10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7368005fd0 tx=0x7f7368009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f737ee81740 1 -- 172.21.15.84:0/2017791813 shutdown_connections 2024-09-21T02:44:59.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f737ee81740 1 -- 172.21.15.84:0/2017791813 wait complete. 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.174+0000 7f737ee81740 1 -- start start 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f737ee81740 1 Processor -- start 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f737ee81740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac266cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f737ee81740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac266d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f737ee81740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2678d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f737ee81740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556ac24277a0 con 0x556ac22b9840 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f737ee81740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556ac256ba10 con 0x556ac2290980 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f737ee81740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556ac266fab0 con 0x556ac2298b60 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f737ee81740 10 client.0 _ll_register_callbacks cb 0x556ac257bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f7374e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac266d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f7374e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac266d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:43476/0 (socket says 172.21.15.84:43476) 2024-09-21T02:44:59.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f7374e00640 1 -- 172.21.15.84:0/3019127343 learned_addr learned my addr 172.21.15.84:0/3019127343 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:59.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.175+0000 7f7375800640 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac266cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7376200640 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2678d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7374e00640 1 -- 172.21.15.84:0/3019127343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 msgr2=0x556ac266cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:59.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7374e00640 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac266cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7374e00640 1 -- 172.21.15.84:0/3019127343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 msgr2=0x556ac2678d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:59.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7374e00640 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2678d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7374e00640 1 -- 172.21.15.84:0/3019127343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac2333b90 con 0x556ac2298b60 2024-09-21T02:44:59.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7374e00640 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac266d100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f735c0137e0 tx=0x7f735c013ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3748b2602e876d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7357400640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7357400640 1 -- 172.21.15.84:0/3019127343 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c011e30 con 0x556ac2298b60 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.176+0000 7f7357400640 1 -- 172.21.15.84:0/3019127343 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f735c01b3f0 con 0x556ac2298b60 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 1 -- 172.21.15.84:0/3019127343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f736410db10 con 0x556ac2298b60 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f7357400640 1 -- 172.21.15.84:0/3019127343 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f735c026050 con 0x556ac2298b60 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 10 client.25726 fetch_fsmap learned FSMap version 30 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 1 -- 172.21.15.84:0/3019127343 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ac267b730 con 0x556ac2298b60 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f7357400640 1 -- 172.21.15.84:0/3019127343 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f736410db10 con 0x556ac2298b60 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f7357400640 1 -- 172.21.15.84:0/3019127343 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f735c01a030 con 0x556ac2298b60 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 10 client.25726 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 10 client.25726 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:44:59.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 20 client.25726 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556ac22781c0 0x556ac267ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 4 client.25726 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.177+0000 7f737ee81740 1 -- 172.21.15.84:0/3019127343 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ac25d8bf0 con 0x556ac22781c0 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.178+0000 7f7375800640 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556ac22781c0 0x556ac267ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.178+0000 7f7375800640 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556ac22781c0 0x556ac267ecd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819beeb14239e2a7 server_cookie=a42d68feb1dd4aa9 in_seq=0 out_seq=0 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.178+0000 7f7357400640 10 client.25726 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f7357400640 1 -- 172.21.15.84:0/3019127343 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ac25d8bf0 con 0x556ac22781c0 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f7357400640 10 client.25726 handle_command_reply: tid=0 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 client.25726 shutdown 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 -- 172.21.15.84:0/3019127343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 msgr2=0x556ac266d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac266d100 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f735c0137e0 tx=0x7f735c013ca0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 -- 172.21.15.84:0/3019127343 shutdown_connections 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2298b60 0x556ac266d100 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556ac22781c0 0x556ac267ecd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2678d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f7357400640 0 client.25726 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:59.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 --2- 172.21.15.84:0/3019127343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2290980 0x556ac266cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.179+0000 7f737ee81740 1 -- 172.21.15.84:0/3019127343 >> 172.21.15.84:0/3019127343 conn(0x556ac22ad990 msgr2=0x556ac26646f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:59.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.180+0000 7f737ee81740 1 -- 172.21.15.84:0/3019127343 shutdown_connections 2024-09-21T02:44:59.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.180+0000 7f737ee81740 1 -- 172.21.15.84:0/3019127343 wait complete. 2024-09-21T02:44:59.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.180+0000 7f737ee81740 20 client.25726 trim_cache size 0 max 16384 2024-09-21T02:44:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f737ee81740 1 Processor -- start 2024-09-21T02:44:59.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f737ee81740 1 -- start start 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f737ee81740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2678b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f737ee81740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2298b60 0x556ac2664d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f737ee81740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2684490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f737ee81740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73701b5530 con 0x556ac22b9840 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f737ee81740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73701b2da0 con 0x556ac2298b60 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f737ee81740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73701b0bf0 con 0x556ac2290980 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.198+0000 7f7375800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2678b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7375800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2678b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:43490/0 (socket says 172.21.15.84:43490) 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7375800640 1 -- 172.21.15.84:0/2175320120 learned_addr learned my addr 172.21.15.84:0/2175320120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7376200640 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2684490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7374e00640 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2298b60 0x556ac2664d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7375800640 1 -- 172.21.15.84:0/2175320120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2298b60 msgr2=0x556ac2664d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7375800640 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2298b60 0x556ac2664d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7375800640 1 -- 172.21.15.84:0/2175320120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 msgr2=0x556ac2684490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7375800640 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2684490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7375800640 1 -- 172.21.15.84:0/2175320120 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac266de80 con 0x556ac2290980 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7374e00640 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2298b60 0x556ac2664d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7375800640 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2678b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73640ca140 tx=0x7f7364009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78c32a6ec72a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7362000640 1 -- 172.21.15.84:0/2175320120 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364049040 con 0x556ac2290980 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7362000640 1 -- 172.21.15.84:0/2175320120 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f73640cd680 con 0x556ac2290980 2024-09-21T02:44:59.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.199+0000 7f7362000640 1 -- 172.21.15.84:0/2175320120 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364117040 con 0x556ac2290980 2024-09-21T02:44:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.200+0000 7f737ee81740 1 -- 172.21.15.84:0/2175320120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 msgr2=0x556ac2678b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:44:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.200+0000 7f737ee81740 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2678b90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f73640ca140 tx=0x7f7364009260 comp rx=0 tx=0).stop 2024-09-21T02:44:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.200+0000 7f737ee81740 1 -- 172.21.15.84:0/2175320120 shutdown_connections 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.200+0000 7f737ee81740 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac22b9840 0x556ac2684490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.200+0000 7f737ee81740 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac2298b60 0x556ac2664d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.200+0000 7f737ee81740 1 --2- 172.21.15.84:0/2175320120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2678b90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.200+0000 7f737ee81740 1 -- 172.21.15.84:0/2175320120 >> 172.21.15.84:0/2175320120 conn(0x556ac22ad990 msgr2=0x556ac2664610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.201+0000 7f737ee81740 1 -- 172.21.15.84:0/2175320120 shutdown_connections 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.201+0000 7f737ee81740 1 -- 172.21.15.84:0/2175320120 wait complete. 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.201+0000 7f737ee81740 1 -- start start 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.201+0000 7f737ee81740 1 Processor -- start 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f737ee81740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2672fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f737ee81740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac2298b60 0x556ac26734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f737ee81740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac22b9840 0x556ac26e86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f737ee81740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73701b1260 con 0x556ac2298b60 2024-09-21T02:44:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f737ee81740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73701b26d0 con 0x556ac22b9840 2024-09-21T02:44:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f737ee81740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73701b1930 con 0x556ac2290980 2024-09-21T02:44:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f737ee81740 10 client.0 _ll_register_callbacks cb 0x7f735c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:44:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7375800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2672fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7374e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac2298b60 0x556ac26734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7375800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2672fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:43496/0 (socket says 172.21.15.84:43496) 2024-09-21T02:44:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7375800640 1 -- 172.21.15.84:0/3519140942 learned_addr learned my addr 172.21.15.84:0/3519140942 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:44:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7376200640 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac22b9840 0x556ac26e86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7375800640 1 -- 172.21.15.84:0/3519140942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac22b9840 msgr2=0x556ac26e86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7375800640 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac22b9840 0x556ac26e86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7375800640 1 -- 172.21.15.84:0/3519140942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac2298b60 msgr2=0x556ac26734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7375800640 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac2298b60 0x556ac26734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7375800640 1 -- 172.21.15.84:0/3519140942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac26e8be0 con 0x556ac2290980 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.202+0000 7f7374e00640 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac2298b60 0x556ac26734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f7375800640 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2672fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f736410be50 tx=0x7f73640b5170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3049ddb5c205ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f7357400640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f7357400640 1 -- 172.21.15.84:0/3519140942 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364049070 con 0x556ac2290980 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f7357400640 1 -- 172.21.15.84:0/3519140942 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f736410b6d0 con 0x556ac2290980 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f737ee81740 1 -- 172.21.15.84:0/3519140942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73640cd680 con 0x556ac2290980 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f7357400640 1 -- 172.21.15.84:0/3519140942 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7364117070 con 0x556ac2290980 2024-09-21T02:44:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f737ee81740 10 client.25732 fetch_fsmap learned FSMap version 30 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f737ee81740 1 -- 172.21.15.84:0/3519140942 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ac26e9c50 con 0x556ac2290980 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f7357400640 1 -- 172.21.15.84:0/3519140942 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f73640cd680 con 0x556ac2290980 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.203+0000 7f7357400640 1 -- 172.21.15.84:0/3519140942 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f73640f10b0 con 0x556ac2290980 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f737ee81740 10 client.25732 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f737ee81740 10 client.25732 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f737ee81740 20 client.25732 populate_metadata read hostname 'smithi084' 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f737ee81740 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556ac224d570 0x556ac26ec030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f737ee81740 4 client.25732 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f737ee81740 1 -- 172.21.15.84:0/3519140942 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x556ac25d46a0 con 0x556ac224d570 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f7374e00640 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556ac224d570 0x556ac26ec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f7374e00640 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556ac224d570 0x556ac26ec030 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abe34cfe001cf8ed server_cookie=a9e2d67baf55eda6 in_seq=0 out_seq=0 2024-09-21T02:44:59.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:44:59.204+0000 7f7357400640 10 client.25732 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:44:59.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:44:58 smithi172 ceph-mon[35067]: pgmap v476: 129 pgs: 129 active+clean; 96 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 702 KiB/s wr, 67 op/s 2024-09-21T02:45:00.914 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:00 smithi084 ceph-mon[30747]: pgmap v477: 129 pgs: 129 active+clean; 100 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 882 KiB/s wr, 62 op/s 2024-09-21T02:45:01.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:00 smithi172 ceph-mon[35067]: pgmap v477: 129 pgs: 129 active+clean; 100 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 882 KiB/s wr, 62 op/s 2024-09-21T02:45:01.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:00 smithi090 ceph-mon[34571]: pgmap v477: 129 pgs: 129 active+clean; 100 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 882 KiB/s wr, 62 op/s 2024-09-21T02:45:02.945 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:02 smithi084 ceph-mon[30747]: pgmap v478: 129 pgs: 129 active+clean; 103 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-21T02:45:03.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:02 smithi172 ceph-mon[35067]: pgmap v478: 129 pgs: 129 active+clean; 103 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-21T02:45:03.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:02 smithi090 ceph-mon[34571]: pgmap v478: 129 pgs: 129 active+clean; 103 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-21T02:45:05.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:04 smithi172 ceph-mon[35067]: pgmap v479: 129 pgs: 129 active+clean; 103 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 925 KiB/s wr, 80 op/s 2024-09-21T02:45:05.262 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:04 smithi084 ceph-mon[30747]: pgmap v479: 129 pgs: 129 active+clean; 103 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 925 KiB/s wr, 80 op/s 2024-09-21T02:45:05.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:04 smithi090 ceph-mon[34571]: pgmap v479: 129 pgs: 129 active+clean; 103 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 925 KiB/s wr, 80 op/s 2024-09-21T02:45:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.672+0000 7f527a400640 1 -- 172.21.15.84:0/2742995409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 msgr2=0x7f5274104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.672+0000 7f527a400640 1 --2- 172.21.15.84:0/2742995409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 0x7f5274104b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5260009900 tx=0x7f526002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.672+0000 7f527a400640 1 -- 172.21.15.84:0/2742995409 shutdown_connections 2024-09-21T02:45:05.673 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.672+0000 7f527a400640 1 --2- 172.21.15.84:0/2742995409 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52741050e0 0x7f527410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.672+0000 7f527a400640 1 --2- 172.21.15.84:0/2742995409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 0x7f5274104b50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.672+0000 7f527a400640 1 --2- 172.21.15.84:0/2742995409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52741036c0 0x7f5274103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.672+0000 7f527a400640 1 -- 172.21.15.84:0/2742995409 >> 172.21.15.84:0/2742995409 conn(0x7f52740ff020 msgr2=0x7f52741014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.673+0000 7f527a400640 1 -- 172.21.15.84:0/2742995409 shutdown_connections 2024-09-21T02:45:05.674 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.673+0000 7f527a400640 1 -- 172.21.15.84:0/2742995409 wait complete. 2024-09-21T02:45:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.674+0000 7f527a400640 1 Processor -- start 2024-09-21T02:45:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.675+0000 7f527a400640 1 -- start start 2024-09-21T02:45:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.675+0000 7f527a400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52741036c0 0x7f527419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.675+0000 7f527a400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 0x7f527419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.675+0000 7f527a400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52741050e0 0x7f527419d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.675+0000 7f527a400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f527410f4f0 con 0x7f52741036c0 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.675+0000 7f527a400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f527410f370 con 0x7f5274104740 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.675+0000 7f527a400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f527410f670 con 0x7f52741050e0 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.676+0000 7f5273e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52741050e0 0x7f527419d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.676+0000 7f5272a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 0x7f527419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.676+0000 7f5273400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52741036c0 0x7f527419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.676+0000 7f5273e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52741050e0 0x7f527419d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:36666/0 (socket says 172.21.15.84:36666) 2024-09-21T02:45:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.676+0000 7f5273e00640 1 -- 172.21.15.84:0/2761086944 learned_addr learned my addr 172.21.15.84:0/2761086944 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.676+0000 7f5272a00640 1 -- 172.21.15.84:0/2761086944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52741050e0 msgr2=0x7f527419d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.676+0000 7f5272a00640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52741050e0 0x7f527419d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.677+0000 7f5272a00640 1 -- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52741036c0 msgr2=0x7f527419c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.677+0000 7f5272a00640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52741036c0 0x7f527419c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.677+0000 7f5272a00640 1 -- 172.21.15.84:0/2761086944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527419dcd0 con 0x7f5274104740 2024-09-21T02:45:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.677+0000 7f5272a00640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 0x7f527419c900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f526002a9e0 tx=0x7f5260032c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.678+0000 7f526be00640 1 -- 172.21.15.84:0/2761086944 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526003f030 con 0x7f5274104740 2024-09-21T02:45:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.678+0000 7f526be00640 1 -- 172.21.15.84:0/2761086944 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5260032e30 con 0x7f5274104740 2024-09-21T02:45:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.678+0000 7f526be00640 1 -- 172.21.15.84:0/2761086944 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5260035070 con 0x7f5274104740 2024-09-21T02:45:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.678+0000 7f527a400640 1 -- 172.21.15.84:0/2761086944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527419df60 con 0x7f5274104740 2024-09-21T02:45:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.679+0000 7f527a400640 1 -- 172.21.15.84:0/2761086944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52741a4550 con 0x7f5274104740 2024-09-21T02:45:05.684 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.683+0000 7f52813d4740 1 Processor -- start 2024-09-21T02:45:05.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.684+0000 7f52813d4740 1 -- start start 2024-09-21T02:45:05.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.684+0000 7f52813d4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.684+0000 7f52813d4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.685 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.684+0000 7f52813d4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b38254d0 0x5629b3bee290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.684+0000 7f52813d4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5629b3b606b0 con 0x5629b38254d0 2024-09-21T02:45:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.684+0000 7f52813d4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5629b3b4fae0 con 0x5629b381d2f0 2024-09-21T02:45:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.684+0000 7f52813d4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5629b3b538f0 con 0x5629b38461b0 2024-09-21T02:45:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:38040/0 (socket says 172.21.15.84:38040) 2024-09-21T02:45:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 -- 172.21.15.84:0/1728739581 learned_addr learned my addr 172.21.15.84:0/1728739581 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273e00640 1 --2- 172.21.15.84:0/1728739581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 -- 172.21.15.84:0/1728739581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 msgr2=0x5629b3bed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 --2- 172.21.15.84:0/1728739581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bed0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 -- 172.21.15.84:0/1728739581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b38254d0 msgr2=0x5629b3bee290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T02:45:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 --2- 172.21.15.84:0/1728739581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b38254d0 0x5629b3bee290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 -- 172.21.15.84:0/1728739581 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629b3b1c780 con 0x5629b381d2f0 2024-09-21T02:45:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.685+0000 7f5273400640 1 --2- 172.21.15.84:0/1728739581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bed740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5264009cf0 tx=0x7f5264011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5993c2d4816a7168 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.686+0000 7f5268c00640 1 -- 172.21.15.84:0/1728739581 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5264004230 con 0x5629b381d2f0 2024-09-21T02:45:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.686+0000 7f5268c00640 1 -- 172.21.15.84:0/1728739581 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52640043d0 con 0x5629b381d2f0 2024-09-21T02:45:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.686+0000 7f5268c00640 1 -- 172.21.15.84:0/1728739581 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52640198c0 con 0x5629b381d2f0 2024-09-21T02:45:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.687+0000 7f52813d4740 1 -- 172.21.15.84:0/1728739581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 msgr2=0x5629b3bed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.687+0000 7f52813d4740 1 --2- 172.21.15.84:0/1728739581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bed740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5264009cf0 tx=0x7f5264011810 comp rx=0 tx=0).stop 2024-09-21T02:45:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.687+0000 7f52813d4740 1 -- 172.21.15.84:0/1728739581 shutdown_connections 2024-09-21T02:45:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.687+0000 7f52813d4740 1 --2- 172.21.15.84:0/1728739581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b38254d0 0x5629b3bee290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.687+0000 7f52813d4740 1 --2- 172.21.15.84:0/1728739581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bed740 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.687+0000 7f52813d4740 1 --2- 172.21.15.84:0/1728739581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.687+0000 7f52813d4740 1 -- 172.21.15.84:0/1728739581 >> 172.21.15.84:0/1728739581 conn(0x5629b383a300 msgr2=0x5629b3be8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.688+0000 7f526be00640 1 -- 172.21.15.84:0/2761086944 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f5260042030 con 0x7f5274104740 2024-09-21T02:45:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.689+0000 7f52813d4740 1 -- 172.21.15.84:0/1728739581 shutdown_connections 2024-09-21T02:45:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.689+0000 7f52813d4740 1 -- 172.21.15.84:0/1728739581 wait complete. 2024-09-21T02:45:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.689+0000 7f52813d4740 1 -- start start 2024-09-21T02:45:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.690+0000 7f52813d4740 1 Processor -- start 2024-09-21T02:45:05.691 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.690+0000 7f526be00640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f52580b64a0 0x7f52580b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f5273e00640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f52580b64a0 0x7f52580b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f52813d4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bff060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f52813d4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bff720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f52813d4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b3804d80 0x5629b3c00290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f52813d4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5629b3a87ab0 con 0x5629b3804d80 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f52813d4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5629b3af6570 con 0x5629b381d2f0 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f52813d4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5629b3beedb0 con 0x5629b38461b0 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f52813d4740 10 client.0 _ll_register_callbacks cb 0x5629b3b05100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.691+0000 7f5273400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bff060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.692+0000 7f526be00640 1 -- 172.21.15.84:0/2761086944 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f5260107ae0 con 0x7f5274104740 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.692+0000 7f5272a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.692+0000 7f5272a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bff720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:36692/0 (socket says 172.21.15.84:36692) 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.692+0000 7f5272a00640 1 -- 172.21.15.84:0/677959774 learned_addr learned my addr 172.21.15.84:0/677959774 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.692+0000 7f5273e00640 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b3804d80 0x5629b3c00290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f5273e00640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f52580b64a0 0x7f52580b89b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f526c009fd0 tx=0x7f526c009710 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f5273e00640 1 -- 172.21.15.84:0/677959774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 msgr2=0x5629b3bff720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f5273e00640 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bff720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f5273e00640 1 -- 172.21.15.84:0/677959774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 msgr2=0x5629b3bff060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:05.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f5273e00640 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bff060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.695 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f5273e00640 1 -- 172.21.15.84:0/677959774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629b38b1790 con 0x5629b3804d80 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f5273e00640 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b3804d80 0x5629b3c00290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f526c01adf0 tx=0x7f526c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e36a2613117c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f525d600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.693+0000 7f525d600640 1 -- 172.21.15.84:0/677959774 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c029060 con 0x5629b3804d80 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.694+0000 7f525d600640 1 -- 172.21.15.84:0/677959774 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f526c017670 con 0x5629b3804d80 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.694+0000 7f52813d4740 1 -- 172.21.15.84:0/677959774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52640043d0 con 0x5629b3804d80 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.694+0000 7f525d600640 1 -- 172.21.15.84:0/677959774 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f526c020070 con 0x5629b3804d80 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.694+0000 7f52813d4740 10 client.15702 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.694+0000 7f52813d4740 1 -- 172.21.15.84:0/677959774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5629b392a620 con 0x5629b3804d80 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.694+0000 7f525d600640 1 -- 172.21.15.84:0/677959774 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f526c015e40 con 0x5629b3804d80 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.695+0000 7f525d600640 1 -- 172.21.15.84:0/677959774 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f526c0249c0 con 0x5629b3804d80 2024-09-21T02:45:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.695+0000 7f52813d4740 10 client.15702 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.695+0000 7f52813d4740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.695+0000 7f52813d4740 20 client.15702 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.695+0000 7f52813d4740 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5629b37da1c0 0x5629b3bfba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.695+0000 7f52813d4740 4 client.15702 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.695+0000 7f52813d4740 1 -- 172.21.15.84:0/677959774 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f52640043d0 con 0x5629b37da1c0 2024-09-21T02:45:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.696+0000 7f5273400640 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5629b37da1c0 0x5629b3bfba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.696+0000 7f525d600640 10 client.15702 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.696+0000 7f5273400640 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5629b37da1c0 0x5629b3bfba40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b02d22258587d13e server_cookie=d08ca3d740820934 in_seq=0 out_seq=0 2024-09-21T02:45:05.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.697+0000 7f525d600640 1 -- 172.21.15.84:0/677959774 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f52640043d0 con 0x5629b37da1c0 2024-09-21T02:45:05.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.697+0000 7f525d600640 10 client.15702 handle_command_reply: tid=0 2024-09-21T02:45:05.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.698+0000 7f52813d4740 1 client.15702 shutdown 2024-09-21T02:45:05.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.698+0000 7f52813d4740 1 -- 172.21.15.84:0/677959774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b3804d80 msgr2=0x5629b3c00290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.699 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.698+0000 7f52813d4740 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b3804d80 0x5629b3c00290 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f526c01adf0 tx=0x7f526c01f000 comp rx=0 tx=0).stop 2024-09-21T02:45:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 1 -- 172.21.15.84:0/677959774 shutdown_connections 2024-09-21T02:45:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b38461b0 0x5629b3bff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5629b37da1c0 0x5629b3bfba40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b3804d80 0x5629b3c00290 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 1 --2- 172.21.15.84:0/677959774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b381d2f0 0x5629b3bff060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 1 -- 172.21.15.84:0/677959774 >> 172.21.15.84:0/677959774 conn(0x5629b383a300 msgr2=0x5629b3be70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f525d600640 0 client.15702 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:05.700 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 1 -- 172.21.15.84:0/677959774 shutdown_connections 2024-09-21T02:45:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 1 -- 172.21.15.84:0/677959774 wait complete. 2024-09-21T02:45:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.699+0000 7f52813d4740 20 client.15702 trim_cache size 0 max 16384 2024-09-21T02:45:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.727+0000 7f52813d4740 1 Processor -- start 2024-09-21T02:45:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.727+0000 7f52813d4740 1 -- start start 2024-09-21T02:45:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f52813d4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b383a300 0x5629b3bf6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f52813d4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3bf11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f52813d4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b381d2f0 0x5629b3bf1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f52813d4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52741acf40 con 0x5629b383a300 2024-09-21T02:45:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f52813d4740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52741aa7b0 con 0x5629b3804d80 2024-09-21T02:45:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f52813d4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52741a85c0 con 0x5629b381d2f0 2024-09-21T02:45:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f5272a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3bf11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f5272a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3bf11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:38058/0 (socket says 172.21.15.84:38058) 2024-09-21T02:45:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f5272a00640 1 -- 172.21.15.84:0/1482870327 learned_addr learned my addr 172.21.15.84:0/1482870327 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f5273400640 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b383a300 0x5629b3bf6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.728+0000 7f5273e00640 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b381d2f0 0x5629b3bf1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.729+0000 7f5272a00640 1 -- 172.21.15.84:0/1482870327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b381d2f0 msgr2=0x5629b3bf1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.729+0000 7f5272a00640 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b381d2f0 0x5629b3bf1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.729+0000 7f5272a00640 1 -- 172.21.15.84:0/1482870327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b383a300 msgr2=0x5629b3bf6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.729+0000 7f5272a00640 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b383a300 0x5629b3bf6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.729+0000 7f5272a00640 1 -- 172.21.15.84:0/1482870327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629b3bf8280 con 0x5629b3804d80 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.729+0000 7f5273400640 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b383a300 0x5629b3bf6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.729+0000 7f5272a00640 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3bf11c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52600c9e50 tx=0x7f5260031470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b47213ea894f1f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.729+0000 7f525fe00640 1 -- 172.21.15.84:0/1482870327 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52600ccff0 con 0x5629b3804d80 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.730+0000 7f525fe00640 1 -- 172.21.15.84:0/1482870327 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52600cd390 con 0x5629b3804d80 2024-09-21T02:45:05.731 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.730+0000 7f525fe00640 1 -- 172.21.15.84:0/1482870327 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526003bbc0 con 0x5629b3804d80 2024-09-21T02:45:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.731+0000 7f52813d4740 1 -- 172.21.15.84:0/1482870327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 msgr2=0x5629b3bf11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.731+0000 7f52813d4740 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3bf11c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52600c9e50 tx=0x7f5260031470 comp rx=0 tx=0).stop 2024-09-21T02:45:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.732+0000 7f52813d4740 1 -- 172.21.15.84:0/1482870327 shutdown_connections 2024-09-21T02:45:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.732+0000 7f52813d4740 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b381d2f0 0x5629b3bf1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.732+0000 7f52813d4740 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3bf11c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.732+0000 7f52813d4740 1 --2- 172.21.15.84:0/1482870327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b383a300 0x5629b3bf6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.732+0000 7f52813d4740 1 -- 172.21.15.84:0/1482870327 >> 172.21.15.84:0/1482870327 conn(0x5629b3be3db0 msgr2=0x5629b3bf5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.732+0000 7f52813d4740 1 -- 172.21.15.84:0/1482870327 shutdown_connections 2024-09-21T02:45:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.732+0000 7f52813d4740 1 -- 172.21.15.84:0/1482870327 wait complete. 2024-09-21T02:45:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.733+0000 7f52813d4740 1 -- start start 2024-09-21T02:45:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.733+0000 7f52813d4740 1 Processor -- start 2024-09-21T02:45:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.734+0000 7f52813d4740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3c06840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.734+0000 7f52813d4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b381d2f0 0x5629b3c05500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f52813d4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b383a300 0x5629b3c05a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f5273400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3c06840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f5273400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3c06840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:38066/0 (socket says 172.21.15.84:38066) 2024-09-21T02:45:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f5272a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b381d2f0 0x5629b3c05500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f5272a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b381d2f0 0x5629b3c05500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50154/0 (socket says 172.21.15.84:50154) 2024-09-21T02:45:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f5273400640 1 -- 172.21.15.84:0/2970872025 learned_addr learned my addr 172.21.15.84:0/2970872025 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52741a8c70 con 0x5629b381d2f0 2024-09-21T02:45:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f5273e00640 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b383a300 0x5629b3c05a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f52741aa0e0 con 0x5629b3804d80 2024-09-21T02:45:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.735+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52741a9340 con 0x5629b383a300 2024-09-21T02:45:05.737 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.736+0000 7f52813d4740 10 client.0 _ll_register_callbacks cb 0x7f526c009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.736+0000 7f5273e00640 1 -- 172.21.15.84:0/2970872025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 msgr2=0x5629b3c06840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.736+0000 7f5273e00640 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3c06840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.736+0000 7f5273e00640 1 -- 172.21.15.84:0/2970872025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b381d2f0 msgr2=0x5629b3c05500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.736+0000 7f5273e00640 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b381d2f0 0x5629b3c05500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.736+0000 7f5273e00640 1 -- 172.21.15.84:0/2970872025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629b3c06030 con 0x5629b383a300 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.736+0000 7f5273400640 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3c06840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.737+0000 7f5272a00640 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b381d2f0 0x5629b3c05500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.737+0000 7f5273e00640 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b383a300 0x5629b3c05a40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f526c014820 tx=0x7f526c022320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e44d510f929ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:05.738 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.737+0000 7f525d600640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:45:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.737+0000 7f525d600640 1 -- 172.21.15.84:0/2970872025 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c033080 con 0x5629b383a300 2024-09-21T02:45:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.737+0000 7f525d600640 1 -- 172.21.15.84:0/2970872025 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f526c022c30 con 0x5629b383a300 2024-09-21T02:45:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.738+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52600cd390 con 0x5629b383a300 2024-09-21T02:45:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.738+0000 7f525d600640 1 -- 172.21.15.84:0/2970872025 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f526c020070 con 0x5629b383a300 2024-09-21T02:45:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.738+0000 7f52813d4740 10 client.25750 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.738+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5629b3c04f50 con 0x5629b383a300 2024-09-21T02:45:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.739+0000 7f525d600640 1 -- 172.21.15.84:0/2970872025 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52600cd390 con 0x5629b383a300 2024-09-21T02:45:05.740 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.739+0000 7f525d600640 1 -- 172.21.15.84:0/2970872025 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f526c024ce0 con 0x5629b383a300 2024-09-21T02:45:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.739+0000 7f52813d4740 10 client.25750 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.739+0000 7f52813d4740 10 client.25750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.739+0000 7f52813d4740 20 client.25750 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.740+0000 7f52813d4740 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5629b38461b0 0x5629b3c82cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.740+0000 7f52813d4740 4 client.25750 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.740+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629b3b62600 con 0x5629b38461b0 2024-09-21T02:45:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.740+0000 7f5273400640 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5629b38461b0 0x5629b3c82cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.741+0000 7f5273400640 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5629b38461b0 0x5629b3c82cf0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb2719071b1edfd5 server_cookie=7583497ca68fb445 in_seq=0 out_seq=0 2024-09-21T02:45:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.741+0000 7f525d600640 10 client.25750 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.805+0000 7f525d600640 1 -- 172.21.15.84:0/2970872025 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629b3b62600 con 0x5629b38461b0 2024-09-21T02:45:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.805+0000 7f525d600640 10 client.25750 handle_command_reply: tid=0 2024-09-21T02:45:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.805+0000 7f52813d4740 1 client.25750 shutdown 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.806+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b383a300 msgr2=0x5629b3c05a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.806+0000 7f52813d4740 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b383a300 0x5629b3c05a40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f526c014820 tx=0x7f526c022320 comp rx=0 tx=0).stop 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.806+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 shutdown_connections 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.806+0000 7f52813d4740 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629b383a300 0x5629b3c05a40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.806+0000 7f52813d4740 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5629b38461b0 0x5629b3c82cf0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.806+0000 7f52813d4740 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5629b381d2f0 0x5629b3c05500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.806+0000 7f52813d4740 1 --2- 172.21.15.84:0/2970872025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629b3804d80 0x5629b3c06840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.806+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 >> 172.21.15.84:0/2970872025 conn(0x5629b3be3db0 msgr2=0x5629b3beccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.807+0000 7f525d600640 0 client.25750 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.807+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 shutdown_connections 2024-09-21T02:45:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.807+0000 7f52813d4740 1 -- 172.21.15.84:0/2970872025 wait complete. 2024-09-21T02:45:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.808+0000 7f52813d4740 20 client.25750 trim_cache size 0 max 16384 2024-09-21T02:45:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:45:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:45:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:45:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:45:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 -- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f52580b64a0 msgr2=0x7f52580b89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f52580b64a0 0x7f52580b89b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f526c009fd0 tx=0x7f526c009710 comp rx=0 tx=0).stop 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 -- 172.21.15.84:0/2761086944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 msgr2=0x7f527419c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 0x7f527419c900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f526002a9e0 tx=0x7f5260032c40 comp rx=0 tx=0).stop 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 -- 172.21.15.84:0/2761086944 shutdown_connections 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f52580b64a0 0x7f52580b89b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52741050e0 0x7f527419d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5274104740 0x7f527419c900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 --2- 172.21.15.84:0/2761086944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52741036c0 0x7f527419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 -- 172.21.15.84:0/2761086944 >> 172.21.15.84:0/2761086944 conn(0x7f52740ff020 msgr2=0x7f52740755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 -- 172.21.15.84:0/2761086944 shutdown_connections 2024-09-21T02:45:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:05.809+0000 7f527a400640 1 -- 172.21.15.84:0/2761086944 wait complete. 2024-09-21T02:45:07.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:06 smithi172 ceph-mon[35067]: pgmap v480: 129 pgs: 129 active+clean; 108 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.4 MiB/s wr, 292 op/s 2024-09-21T02:45:07.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:06 smithi084 ceph-mon[30747]: pgmap v480: 129 pgs: 129 active+clean; 108 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.4 MiB/s wr, 292 op/s 2024-09-21T02:45:07.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:06 smithi090 ceph-mon[34571]: pgmap v480: 129 pgs: 129 active+clean; 108 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 1.4 MiB/s wr, 292 op/s 2024-09-21T02:45:08.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.046+0000 7f7357400640 1 -- 172.21.15.84:0/3519140942 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556ac25d46a0 con 0x556ac224d570 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.046+0000 7f7357400640 10 client.25732 handle_command_reply: tid=0 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.046+0000 7f737ee81740 1 client.25732 shutdown 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.046+0000 7f737ee81740 1 -- 172.21.15.84:0/3519140942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 msgr2=0x556ac2672fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.046+0000 7f737ee81740 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2672fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f736410be50 tx=0x7f73640b5170 comp rx=0 tx=0).stop 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.046+0000 7f737ee81740 1 -- 172.21.15.84:0/3519140942 shutdown_connections 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.046+0000 7f737ee81740 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556ac224d570 0x556ac26ec030 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.047+0000 7f737ee81740 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556ac22b9840 0x556ac26e86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.047+0000 7f737ee81740 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ac2298b60 0x556ac26734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.047+0000 7f737ee81740 1 --2- 172.21.15.84:0/3519140942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ac2290980 0x556ac2672fb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.047+0000 7f737ee81740 1 -- 172.21.15.84:0/3519140942 >> 172.21.15.84:0/3519140942 conn(0x556ac22ad990 msgr2=0x556ac2664610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:08.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.047+0000 7f7357400640 0 client.25732 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:08.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.047+0000 7f737ee81740 1 -- 172.21.15.84:0/3519140942 shutdown_connections 2024-09-21T02:45:08.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.047+0000 7f737ee81740 1 -- 172.21.15.84:0/3519140942 wait complete. 2024-09-21T02:45:08.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.047+0000 7f737ee81740 20 client.25732 trim_cache size 0 max 16384 2024-09-21T02:45:08.050 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:45:08.050 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 30, 2024-09-21T02:45:08.050 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:45:08.050 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 10, 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "3c8d8ed4": { 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 10, 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 147.8, 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T02:45:08.051 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:08.052 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 -- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f73580b6500 msgr2=0x7f73580b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f73580b6500 0x7f73580b8a10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7368005fd0 tx=0x7f7368009500 comp rx=0 tx=0).stop 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 -- 172.21.15.84:0/3049328807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73701047f0 msgr2=0x7f737019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73701047f0 0x7f737019c630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73640314b0 tx=0x7f7364003c10 comp rx=0 tx=0).stop 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 -- 172.21.15.84:0/3049328807 shutdown_connections 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737010dc50 0x7f73701a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7370105140 0x7f737019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f73580b6500 0x7f73580b8a10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 --2- 172.21.15.84:0/3049328807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73701047f0 0x7f737019c630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 -- 172.21.15.84:0/3049328807 >> 172.21.15.84:0/3049328807 conn(0x7f73700fe330 msgr2=0x7f7370102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:08.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 -- 172.21.15.84:0/3049328807 shutdown_connections 2024-09-21T02:45:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:08.048+0000 7f7376c00640 1 -- 172.21.15.84:0/3049328807 wait complete. 2024-09-21T02:45:08.918 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3c8d8ed4', quiesce took 12.9 seconds. Will release after: 14.9 2024-09-21T02:45:09.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:08 smithi172 ceph-mon[35067]: pgmap v481: 129 pgs: 129 active+clean; 110 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 1.5 MiB/s wr, 342 op/s 2024-09-21T02:45:09.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:08 smithi084 ceph-mon[30747]: pgmap v481: 129 pgs: 129 active+clean; 110 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 1.5 MiB/s wr, 342 op/s 2024-09-21T02:45:09.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:08 smithi090 ceph-mon[34571]: pgmap v481: 129 pgs: 129 active+clean; 110 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 1.5 MiB/s wr, 342 op/s 2024-09-21T02:45:11.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:10 smithi172 ceph-mon[35067]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 1.4 MiB/s wr, 314 op/s 2024-09-21T02:45:11.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:10 smithi084 ceph-mon[30747]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 1.4 MiB/s wr, 314 op/s 2024-09-21T02:45:11.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:10 smithi090 ceph-mon[34571]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 1.4 MiB/s wr, 314 op/s 2024-09-21T02:45:13.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:12 smithi172 ceph-mon[35067]: pgmap v483: 129 pgs: 129 active+clean; 117 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 443 op/s 2024-09-21T02:45:13.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:12 smithi084 ceph-mon[30747]: pgmap v483: 129 pgs: 129 active+clean; 117 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 443 op/s 2024-09-21T02:45:13.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:12 smithi090 ceph-mon[34571]: pgmap v483: 129 pgs: 129 active+clean; 117 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 443 op/s 2024-09-21T02:45:15.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:14 smithi172 ceph-mon[35067]: pgmap v484: 129 pgs: 129 active+clean; 118 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 424 op/s 2024-09-21T02:45:15.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:14 smithi084 ceph-mon[30747]: pgmap v484: 129 pgs: 129 active+clean; 118 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 424 op/s 2024-09-21T02:45:15.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:14 smithi090 ceph-mon[34571]: pgmap v484: 129 pgs: 129 active+clean; 118 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 424 op/s 2024-09-21T02:45:17.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:16 smithi172 ceph-mon[35067]: pgmap v485: 129 pgs: 129 active+clean; 118 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.6 MiB/s wr, 442 op/s 2024-09-21T02:45:17.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:16 smithi084 ceph-mon[30747]: pgmap v485: 129 pgs: 129 active+clean; 118 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.6 MiB/s wr, 442 op/s 2024-09-21T02:45:17.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:16 smithi090 ceph-mon[34571]: pgmap v485: 129 pgs: 129 active+clean; 118 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.6 MiB/s wr, 442 op/s 2024-09-21T02:45:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 -- 172.21.15.84:0/663257397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c106770 msgr2=0x7fab7c106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.015 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 --2- 172.21.15.84:0/663257397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c106770 0x7fab7c106b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fab64009900 tx=0x7fab6402a410 comp rx=0 tx=0).stop 2024-09-21T02:45:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 -- 172.21.15.84:0/663257397 shutdown_connections 2024-09-21T02:45:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 --2- 172.21.15.84:0/663257397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab7c107110 0x7fab7c10dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 --2- 172.21.15.84:0/663257397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c106770 0x7fab7c106b80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 --2- 172.21.15.84:0/663257397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab7c1056f0 0x7fab7c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 -- 172.21.15.84:0/663257397 >> 172.21.15.84:0/663257397 conn(0x7fab7c101050 msgr2=0x7fab7c1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 -- 172.21.15.84:0/663257397 shutdown_connections 2024-09-21T02:45:19.016 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.013+0000 7fab7be00640 1 -- 172.21.15.84:0/663257397 wait complete. 2024-09-21T02:45:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.014+0000 7fab7be00640 1 Processor -- start 2024-09-21T02:45:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.014+0000 7fab7be00640 1 -- start start 2024-09-21T02:45:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.014+0000 7fab7be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab7c1056f0 0x7fab7c19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.014+0000 7fab7be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab7c106770 0x7fab7c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.014+0000 7fab7be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c107110 0x7fab7c19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.014+0000 7fab7be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1114e0 con 0x7fab7c107110 2024-09-21T02:45:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.014+0000 7fab7be00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c111360 con 0x7fab7c1056f0 2024-09-21T02:45:19.018 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.014+0000 7fab7be00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c111660 con 0x7fab7c106770 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c107110 0x7fab7c19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab7c1056f0 0x7fab7c19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab7c1056f0 0x7fab7c19c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51080/0 (socket says 172.21.15.84:51080) 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab73e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab7c106770 0x7fab7c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 -- 172.21.15.84:0/4062197468 learned_addr learned my addr 172.21.15.84:0/4062197468 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c107110 0x7fab7c19d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45054/0 (socket says 172.21.15.84:45054) 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 -- 172.21.15.84:0/4062197468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab7c106770 msgr2=0x7fab7c19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab7c106770 0x7fab7c19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 -- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c107110 msgr2=0x7fab7c19d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c107110 0x7fab7c19d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 -- 172.21.15.84:0/4062197468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c19daa0 con 0x7fab7c1056f0 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab7aa00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab7c1056f0 0x7fab7c19c060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e9f0 tx=0x7fab6c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.015+0000 7fab73400640 1 -- 172.21.15.84:0/4062197468 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c00cd80 con 0x7fab7c1056f0 2024-09-21T02:45:19.019 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.016+0000 7fab73400640 1 -- 172.21.15.84:0/4062197468 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab6c010900 con 0x7fab7c1056f0 2024-09-21T02:45:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.016+0000 7fab73400640 1 -- 172.21.15.84:0/4062197468 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c018920 con 0x7fab7c1056f0 2024-09-21T02:45:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.016+0000 7fab7be00640 1 -- 172.21.15.84:0/4062197468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c19dd90 con 0x7fab7c1056f0 2024-09-21T02:45:19.020 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.016+0000 7fab7be00640 1 -- 172.21.15.84:0/4062197468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c1a4480 con 0x7fab7c1056f0 2024-09-21T02:45:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.018+0000 7fab88bf1740 1 Processor -- start 2024-09-21T02:45:19.021 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab88bf1740 1 -- start start 2024-09-21T02:45:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 0x561260c54920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c55470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab88bf1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561260bc76b0 con 0x56126088c4d0 2024-09-21T02:45:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab88bf1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561260bb6ae0 con 0x5612608842f0 2024-09-21T02:45:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab88bf1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561260bba8f0 con 0x5612608ad1b0 2024-09-21T02:45:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab73e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c55470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab73e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c55470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45056/0 (socket says 172.21.15.84:45056) 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab73e00640 1 -- 172.21.15.84:0/1349689145 learned_addr learned my addr 172.21.15.84:0/1349689145 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab73400640 1 -- 172.21.15.84:0/4062197468 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fab6c010ab0 con 0x7fab7c1056f0 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.019+0000 7fab7b400640 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab73e00640 1 -- 172.21.15.84:0/1349689145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 msgr2=0x561260c542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab73e00640 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab73e00640 1 -- 172.21.15.84:0/1349689145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 msgr2=0x561260c54920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab73e00640 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 0x561260c54920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab73e00640 1 -- 172.21.15.84:0/1349689145 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561260b83780 con 0x56126088c4d0 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab7b400640 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab73e00640 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c55470 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fab64009900 tx=0x7fab640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa028f53943f728 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab6be00640 1 -- 172.21.15.84:0/1349689145 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64040070 con 0x56126088c4d0 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab6be00640 1 -- 172.21.15.84:0/1349689145 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab640044b0 con 0x56126088c4d0 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.020+0000 7fab6be00640 1 -- 172.21.15.84:0/1349689145 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64035040 con 0x56126088c4d0 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab73400640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fab600b6510 0x7fab600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 -- 172.21.15.84:0/1349689145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 msgr2=0x561260c55470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c55470 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fab64009900 tx=0x7fab640040c0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 -- 172.21.15.84:0/1349689145 shutdown_connections 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c55470 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 0x561260c54920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1349689145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.025 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 -- 172.21.15.84:0/1349689145 >> 172.21.15.84:0/1349689145 conn(0x5612608a1300 msgr2=0x561260c4fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:19.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 -- 172.21.15.84:0/1349689145 shutdown_connections 2024-09-21T02:45:19.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab7b400640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fab600b6510 0x7fab600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab88bf1740 1 -- 172.21.15.84:0/1349689145 wait complete. 2024-09-21T02:45:19.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.021+0000 7fab73400640 1 -- 172.21.15.84:0/4062197468 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fab6c0e7a60 con 0x7fab7c1056f0 2024-09-21T02:45:19.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.022+0000 7fab88bf1740 1 -- start start 2024-09-21T02:45:19.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.022+0000 7fab7b400640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fab600b6510 0x7fab600b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab74005fd0 tx=0x7fab740096a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:19.026 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.022+0000 7fab88bf1740 1 Processor -- start 2024-09-21T02:45:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608842f0 0x561260c5d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56126088c4d0 0x561260c5e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c5ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab88bf1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561260aeeab0 con 0x5612608842f0 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab88bf1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x561260b5d570 con 0x56126088c4d0 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab88bf1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561260c55f30 con 0x5612608ad1b0 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab88bf1740 10 client.0 _ll_register_callbacks cb 0x561260b6c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab7aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608842f0 0x561260c5d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab73e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56126088c4d0 0x561260c5e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab7b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c5ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab73e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56126088c4d0 0x561260c5e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51098/0 (socket says 172.21.15.84:51098) 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab7aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608842f0 0x561260c5d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45062/0 (socket says 172.21.15.84:45062) 2024-09-21T02:45:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.023+0000 7fab73e00640 1 -- 172.21.15.84:0/2059877868 learned_addr learned my addr 172.21.15.84:0/2059877868 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab73e00640 1 -- 172.21.15.84:0/2059877868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 msgr2=0x561260c5ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab73e00640 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c5ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab73e00640 1 -- 172.21.15.84:0/2059877868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608842f0 msgr2=0x561260c5d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab73e00640 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608842f0 0x561260c5d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab73e00640 1 -- 172.21.15.84:0/2059877868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561260918790 con 0x56126088c4d0 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab7aa00640 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608842f0 0x561260c5d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab73e00640 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56126088c4d0 0x561260c5e090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab64009680 tx=0x7fab64005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=304e7d2ea0bfafca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab68c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab68c00640 1 -- 172.21.15.84:0/2059877868 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64040030 con 0x56126088c4d0 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab88bf1740 1 -- 172.21.15.84:0/2059877868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab640044b0 con 0x56126088c4d0 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.024+0000 7fab68c00640 1 -- 172.21.15.84:0/2059877868 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fab64005200 con 0x56126088c4d0 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab68c00640 1 -- 172.21.15.84:0/2059877868 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab64056050 con 0x56126088c4d0 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab88bf1740 10 client.25742 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab88bf1740 1 -- 172.21.15.84:0/2059877868 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561260991620 con 0x56126088c4d0 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab68c00640 1 -- 172.21.15.84:0/2059877868 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab640044b0 con 0x56126088c4d0 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab68c00640 1 -- 172.21.15.84:0/2059877868 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fab640035f0 con 0x56126088c4d0 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab88bf1740 10 client.25742 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab88bf1740 10 client.25742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab88bf1740 20 client.25742 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab88bf1740 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56126086bd80 0x561260c6ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab88bf1740 4 client.25742 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.025+0000 7fab88bf1740 1 -- 172.21.15.84:0/2059877868 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561260bc9600 con 0x56126086bd80 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.026+0000 7fab7aa00640 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56126086bd80 0x561260c6ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.026+0000 7fab7aa00640 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56126086bd80 0x561260c6ace0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34de7e4aa2f15a90 server_cookie=cee7e4a4f90beb6b in_seq=0 out_seq=0 2024-09-21T02:45:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.026+0000 7fab68c00640 10 client.25742 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab68c00640 1 -- 172.21.15.84:0/2059877868 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561260bc9600 con 0x56126086bd80 2024-09-21T02:45:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab68c00640 10 client.25742 handle_command_reply: tid=0 2024-09-21T02:45:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 client.25742 shutdown 2024-09-21T02:45:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 -- 172.21.15.84:0/2059877868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56126088c4d0 msgr2=0x561260c5e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56126088c4d0 0x561260c5e090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab64009680 tx=0x7fab64005d90 comp rx=0 tx=0).stop 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 -- 172.21.15.84:0/2059877868 shutdown_connections 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608ad1b0 0x561260c5ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56126086bd80 0x561260c6ace0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56126088c4d0 0x561260c5e090 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 --2- 172.21.15.84:0/2059877868 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608842f0 0x561260c5d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab68c00640 0 client.25742 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 -- 172.21.15.84:0/2059877868 >> 172.21.15.84:0/2059877868 conn(0x5612608a1300 msgr2=0x561260c4e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 -- 172.21.15.84:0/2059877868 shutdown_connections 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.027+0000 7fab88bf1740 1 -- 172.21.15.84:0/2059877868 wait complete. 2024-09-21T02:45:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.028+0000 7fab88bf1740 20 client.25742 trim_cache size 0 max 16384 2024-09-21T02:45:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.042+0000 7fab88bf1740 1 Processor -- start 2024-09-21T02:45:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.042+0000 7fab88bf1740 1 -- start start 2024-09-21T02:45:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 0x561260c5e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56126088c4d0 0x561260c65ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608ad1b0 0x561260c5cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab88bf1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1b1090 con 0x5612608ad1b0 2024-09-21T02:45:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab88bf1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ae900 con 0x5612608842f0 2024-09-21T02:45:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab88bf1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ac750 con 0x56126088c4d0 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab7b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608ad1b0 0x561260c5cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab7b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608ad1b0 0x561260c5cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45078/0 (socket says 172.21.15.84:45078) 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab7b400640 1 -- 172.21.15.84:0/3385518507 learned_addr learned my addr 172.21.15.84:0/3385518507 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab73e00640 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56126088c4d0 0x561260c65ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab7aa00640 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 0x561260c5e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab7b400640 1 -- 172.21.15.84:0/3385518507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56126088c4d0 msgr2=0x561260c65ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab7b400640 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56126088c4d0 0x561260c65ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab7b400640 1 -- 172.21.15.84:0/3385518507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 msgr2=0x561260c5e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.043+0000 7fab7b400640 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 0x561260c5e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.044+0000 7fab7b400640 1 -- 172.21.15.84:0/3385518507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561260c5ef70 con 0x5612608ad1b0 2024-09-21T02:45:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.044+0000 7fab73e00640 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56126088c4d0 0x561260c65ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.044+0000 7fab7b400640 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608ad1b0 0x561260c5cbd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab7401e770 tx=0x7fab74019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b60eb1ec255942b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.044+0000 7fab6b400640 1 -- 172.21.15.84:0/3385518507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74011580 con 0x5612608ad1b0 2024-09-21T02:45:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.044+0000 7fab6b400640 1 -- 172.21.15.84:0/3385518507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab74011bf0 con 0x5612608ad1b0 2024-09-21T02:45:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.044+0000 7fab6b400640 1 -- 172.21.15.84:0/3385518507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7401cd90 con 0x5612608ad1b0 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 -- 172.21.15.84:0/3385518507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608ad1b0 msgr2=0x561260c5cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608ad1b0 0x561260c5cbd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab7401e770 tx=0x7fab74019000 comp rx=0 tx=0).stop 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 -- 172.21.15.84:0/3385518507 shutdown_connections 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56126088c4d0 0x561260c65ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5612608ad1b0 0x561260c5cbd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 --2- 172.21.15.84:0/3385518507 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608842f0 0x561260c5e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 -- 172.21.15.84:0/3385518507 >> 172.21.15.84:0/3385518507 conn(0x5612608a1300 msgr2=0x561260c5d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 -- 172.21.15.84:0/3385518507 shutdown_connections 2024-09-21T02:45:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 -- 172.21.15.84:0/3385518507 wait complete. 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.045+0000 7fab88bf1740 1 -- start start 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab88bf1740 1 Processor -- start 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608842f0 0x561260c65660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c64320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab88bf1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608ad1b0 0x561260c64860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab88bf1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1acdc0 con 0x56126088c4d0 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab88bf1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ae230 con 0x5612608ad1b0 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab88bf1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c1ad490 con 0x5612608842f0 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab88bf1740 10 client.0 _ll_register_callbacks cb 0x7fab74009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab73e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c64320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab73e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c64320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45090/0 (socket says 172.21.15.84:45090) 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab7aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608842f0 0x561260c65660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab73e00640 1 -- 172.21.15.84:0/1835001821 learned_addr learned my addr 172.21.15.84:0/1835001821 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.046+0000 7fab7b400640 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608ad1b0 0x561260c64860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab73e00640 1 -- 172.21.15.84:0/1835001821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608842f0 msgr2=0x561260c65660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab73e00640 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608842f0 0x561260c65660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab73e00640 1 -- 172.21.15.84:0/1835001821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608ad1b0 msgr2=0x561260c64860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab73e00640 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608ad1b0 0x561260c64860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab73e00640 1 -- 172.21.15.84:0/1835001821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561260c64e70 con 0x56126088c4d0 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab73e00640 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c64320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab64003bb0 tx=0x7fab64003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376d7ee10d948c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab68c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab68c00640 1 -- 172.21.15.84:0/1835001821 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64040070 con 0x56126088c4d0 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab68c00640 1 -- 172.21.15.84:0/1835001821 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fab640042b0 con 0x56126088c4d0 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab88bf1740 1 -- 172.21.15.84:0/1835001821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab74011bf0 con 0x56126088c4d0 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab68c00640 1 -- 172.21.15.84:0/1835001821 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fab6406a050 con 0x56126088c4d0 2024-09-21T02:45:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab88bf1740 10 client.15726 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.047+0000 7fab88bf1740 1 -- 172.21.15.84:0/1835001821 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561260c63cf0 con 0x56126088c4d0 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab68c00640 1 -- 172.21.15.84:0/1835001821 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fab6405e020 con 0x56126088c4d0 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab68c00640 1 -- 172.21.15.84:0/1835001821 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fab64031610 con 0x56126088c4d0 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab88bf1740 10 client.15726 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab88bf1740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab88bf1740 20 client.15726 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5612608411c0 0x561260cd7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab88bf1740 4 client.15726 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab88bf1740 1 -- 172.21.15.84:0/1835001821 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561260bc50b0 con 0x5612608411c0 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.048+0000 7fab7aa00640 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5612608411c0 0x561260cd7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.049+0000 7fab7aa00640 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5612608411c0 0x561260cd7eb0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=615b526edf960b8c server_cookie=b0fd33313a65a1e6 in_seq=0 out_seq=0 2024-09-21T02:45:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.049+0000 7fab68c00640 10 client.15726 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab68c00640 1 -- 172.21.15.84:0/1835001821 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561260bc50b0 con 0x5612608411c0 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab68c00640 10 client.15726 handle_command_reply: tid=0 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 client.15726 shutdown 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 -- 172.21.15.84:0/1835001821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 msgr2=0x561260c64320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c64320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab64003bb0 tx=0x7fab64003820 comp rx=0 tx=0).stop 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 -- 172.21.15.84:0/1835001821 shutdown_connections 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5612608411c0 0x561260cd7eb0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5612608ad1b0 0x561260c64860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56126088c4d0 0x561260c64320 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 --2- 172.21.15.84:0/1835001821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612608842f0 0x561260c65660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab68c00640 0 client.15726 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 -- 172.21.15.84:0/1835001821 >> 172.21.15.84:0/1835001821 conn(0x5612608a1300 msgr2=0x561260c5bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 -- 172.21.15.84:0/1835001821 shutdown_connections 2024-09-21T02:45:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 1 -- 172.21.15.84:0/1835001821 wait complete. 2024-09-21T02:45:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.080+0000 7fab88bf1740 20 client.15726 trim_cache size 0 max 16384 2024-09-21T02:45:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:45:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:45:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:45:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 -- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fab600b6510 msgr2=0x7fab600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fab600b6510 0x7fab600b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab74005fd0 tx=0x7fab740096a0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 -- 172.21.15.84:0/4062197468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab7c1056f0 msgr2=0x7fab7c19c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab7c1056f0 0x7fab7c19c060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e9f0 tx=0x7fab6c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 -- 172.21.15.84:0/4062197468 shutdown_connections 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fab600b6510 0x7fab600b8a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab7c106770 0x7fab7c19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab7c107110 0x7fab7c19d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.085 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 --2- 172.21.15.84:0/4062197468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab7c1056f0 0x7fab7c19c060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 -- 172.21.15.84:0/4062197468 >> 172.21.15.84:0/4062197468 conn(0x7fab7c101050 msgr2=0x7fab7c109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 -- 172.21.15.84:0/4062197468 shutdown_connections 2024-09-21T02:45:19.086 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:19.081+0000 7fab7be00640 1 -- 172.21.15.84:0/4062197468 wait complete. 2024-09-21T02:45:19.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:18 smithi172 ceph-mon[35067]: pgmap v486: 129 pgs: 129 active+clean; 118 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 993 KiB/s wr, 237 op/s 2024-09-21T02:45:19.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:18 smithi084 ceph-mon[30747]: pgmap v486: 129 pgs: 129 active+clean; 118 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 993 KiB/s wr, 237 op/s 2024-09-21T02:45:19.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:18 smithi090 ceph-mon[34571]: pgmap v486: 129 pgs: 129 active+clean; 118 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 993 KiB/s wr, 237 op/s 2024-09-21T02:45:21.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:20 smithi172 ceph-mon[35067]: pgmap v487: 129 pgs: 129 active+clean; 118 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 845 KiB/s wr, 178 op/s 2024-09-21T02:45:21.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:20 smithi084 ceph-mon[30747]: pgmap v487: 129 pgs: 129 active+clean; 118 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 845 KiB/s wr, 178 op/s 2024-09-21T02:45:21.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:20 smithi090 ceph-mon[34571]: pgmap v487: 129 pgs: 129 active+clean; 118 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 845 KiB/s wr, 178 op/s 2024-09-21T02:45:23.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:22 smithi172 ceph-mon[35067]: pgmap v488: 129 pgs: 129 active+clean; 119 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.3 MiB/s wr, 276 op/s 2024-09-21T02:45:23.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:22 smithi084 ceph-mon[30747]: pgmap v488: 129 pgs: 129 active+clean; 119 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.3 MiB/s wr, 276 op/s 2024-09-21T02:45:23.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:22 smithi090 ceph-mon[34571]: pgmap v488: 129 pgs: 129 active+clean; 119 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.3 MiB/s wr, 276 op/s 2024-09-21T02:45:23.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:45:24.203 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 -- 172.21.15.84:0/3260522247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354076100 msgr2=0x7fb35410fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 --2- 172.21.15.84:0/3260522247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354076100 0x7fb35410fb80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb340009900 tx=0x7fb34002a410 comp rx=0 tx=0).stop 2024-09-21T02:45:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 -- 172.21.15.84:0/3260522247 shutdown_connections 2024-09-21T02:45:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 --2- 172.21.15.84:0/3260522247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3541100c0 0x7fb354112500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 --2- 172.21.15.84:0/3260522247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb354076100 0x7fb35410fb80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 --2- 172.21.15.84:0/3260522247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3540757b0 0x7fb354075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 -- 172.21.15.84:0/3260522247 >> 172.21.15.84:0/3260522247 conn(0x7fb35407b850 msgr2=0x7fb35407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:24.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 -- 172.21.15.84:0/3260522247 shutdown_connections 2024-09-21T02:45:24.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.930+0000 7fb35b000640 1 -- 172.21.15.84:0/3260522247 wait complete. 2024-09-21T02:45:24.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.932+0000 7fb35b000640 1 Processor -- start 2024-09-21T02:45:24.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.932+0000 7fb35b000640 1 -- start start 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb35b000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3540757b0 0x7fb35419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb35b000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb354076100 0x7fb35419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb35b000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3541100c0 0x7fb3541a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb35b000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb354115d70 con 0x7fb3541100c0 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb35b000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb354115bf0 con 0x7fb3540757b0 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb35b000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb354115ef0 con 0x7fb354076100 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb353e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3540757b0 0x7fb35419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb353400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb354076100 0x7fb35419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:24.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb353e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3540757b0 0x7fb35419c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:50956/0 (socket says 172.21.15.84:50956) 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb353400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb354076100 0x7fb35419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47192/0 (socket says 172.21.15.84:47192) 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb353e00640 1 -- 172.21.15.84:0/136579739 learned_addr learned my addr 172.21.15.84:0/136579739 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.933+0000 7fb359000640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3541100c0 0x7fb3541a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb353e00640 1 -- 172.21.15.84:0/136579739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb354076100 msgr2=0x7fb35419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb353e00640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb354076100 0x7fb35419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb353e00640 1 -- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3541100c0 msgr2=0x7fb3541a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb353e00640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3541100c0 0x7fb3541a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb353e00640 1 -- 172.21.15.84:0/136579739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3541a26d0 con 0x7fb3540757b0 2024-09-21T02:45:24.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb353400640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb354076100 0x7fb35419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:24.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb353e00640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3540757b0 0x7fb35419c760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb34400e9f0 tx=0x7fb34400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:24.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb350c00640 1 -- 172.21.15.84:0/136579739 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34400ccc0 con 0x7fb3540757b0 2024-09-21T02:45:24.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb350c00640 1 -- 172.21.15.84:0/136579739 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb344010900 con 0x7fb3540757b0 2024-09-21T02:45:24.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb350c00640 1 -- 172.21.15.84:0/136579739 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb344018860 con 0x7fb3540757b0 2024-09-21T02:45:24.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3541a29c0 con 0x7fb3540757b0 2024-09-21T02:45:24.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.934+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3541a9120 con 0x7fb3540757b0 2024-09-21T02:45:24.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.935+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb354075bc0 con 0x7fb3540757b0 2024-09-21T02:45:24.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.938+0000 7fb350c00640 1 -- 172.21.15.84:0/136579739 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fb344010ab0 con 0x7fb3540757b0 2024-09-21T02:45:24.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.940+0000 7fb350c00640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3380b6590 0x7fb3380b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:24.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.940+0000 7fb353400640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3380b6590 0x7fb3380b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:24.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.940+0000 7fb350c00640 1 -- 172.21.15.84:0/136579739 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fb3440e7e10 con 0x7fb3540757b0 2024-09-21T02:45:24.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.941+0000 7fb353400640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3380b6590 0x7fb3380b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb3400314b0 tx=0x7fb3400058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:24.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:24.941+0000 7fb350c00640 1 -- 172.21.15.84:0/136579739 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3440ae2b0 con 0x7fb3540757b0 2024-09-21T02:45:25.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:24 smithi084 ceph-mon[30747]: pgmap v489: 129 pgs: 129 active+clean; 121 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 758 KiB/s wr, 179 op/s 2024-09-21T02:45:25.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.163+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3541a93c0 con 0x7fb3540757b0 2024-09-21T02:45:25.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.164+0000 7fb350c00640 1 -- 172.21.15.84:0/136579739 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11913 (secure 0 0 0) 0x7fb3440b2690 con 0x7fb3540757b0 2024-09-21T02:45:25.166 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:45:25.166 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":30,"btime":"2024-09-21T02:44:49:769551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:44:49.033686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:45:25.166 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 30 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3380b6590 msgr2=0x7fb3380b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3380b6590 0x7fb3380b8aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb3400314b0 tx=0x7fb3400058d0 comp rx=0 tx=0).stop 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3540757b0 msgr2=0x7fb35419c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3540757b0 0x7fb35419c760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb34400e9f0 tx=0x7fb34400edf0 comp rx=0 tx=0).stop 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 shutdown_connections 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3380b6590 0x7fb3380b8aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb354076100 0x7fb35419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3541100c0 0x7fb3541a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 --2- 172.21.15.84:0/136579739 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3540757b0 0x7fb35419c760 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 >> 172.21.15.84:0/136579739 conn(0x7fb35407b850 msgr2=0x7fb354101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 shutdown_connections 2024-09-21T02:45:25.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:25.167+0000 7fb35b000640 1 -- 172.21.15.84:0/136579739 wait complete. 2024-09-21T02:45:25.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:24 smithi172 ceph-mon[35067]: pgmap v489: 129 pgs: 129 active+clean; 121 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 758 KiB/s wr, 179 op/s 2024-09-21T02:45:25.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:24 smithi090 ceph-mon[34571]: pgmap v489: 129 pgs: 129 active+clean; 121 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 758 KiB/s wr, 179 op/s 2024-09-21T02:45:26.058 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 3c8d8ed4 --release --await' 2024-09-21T02:45:26.059 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 3c8d8ed4 --release --await 2024-09-21T02:45:26.131 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:25 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/136579739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:26.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:25 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/136579739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:26.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:25 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/136579739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:26.477 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:26.959 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:26 smithi084 ceph-mon[30747]: pgmap v490: 129 pgs: 129 active+clean; 125 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.1 MiB/s wr, 216 op/s 2024-09-21T02:45:27.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 -- 172.21.15.84:0/2699503870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 msgr2=0x7f5130112540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 --2- 172.21.15.84:0/2699503870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 0x7f5130112540 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5128009ca0 tx=0x7f512802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 -- 172.21.15.84:0/2699503870 shutdown_connections 2024-09-21T02:45:27.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 --2- 172.21.15.84:0/2699503870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51300760a0 0x7f513010fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 --2- 172.21.15.84:0/2699503870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 0x7f5130112540 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 --2- 172.21.15.84:0/2699503870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5130075750 0x7f5130075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 -- 172.21.15.84:0/2699503870 >> 172.21.15.84:0/2699503870 conn(0x7f513007b850 msgr2=0x7f513007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:27.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 -- 172.21.15.84:0/2699503870 shutdown_connections 2024-09-21T02:45:27.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.137+0000 7f5135400640 1 -- 172.21.15.84:0/2699503870 wait complete. 2024-09-21T02:45:27.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.138+0000 7f5135400640 1 Processor -- start 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.138+0000 7f5135400640 1 -- start start 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f5135400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5130075750 0x7f513019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f5135400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51300760a0 0x7f513019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f5135400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 0x7f51301a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f5135400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5130115dd0 con 0x7f5130110120 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f5135400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5130115c50 con 0x7f51300760a0 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f5135400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5130115f50 con 0x7f5130075750 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f512f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 0x7f51301a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f5125e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51300760a0 0x7f513019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f512f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 0x7f51301a1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57054/0 (socket says 172.21.15.84:57054) 2024-09-21T02:45:27.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f512f200640 1 -- 172.21.15.84:0/2986774441 learned_addr learned my addr 172.21.15.84:0/2986774441 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.139+0000 7f512e800640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5130075750 0x7f513019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5125e00640 1 -- 172.21.15.84:0/2986774441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5130075750 msgr2=0x7f513019c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5125e00640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5130075750 0x7f513019c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5125e00640 1 -- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 msgr2=0x7f51301a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5125e00640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 0x7f51301a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5125e00640 1 -- 172.21.15.84:0/2986774441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51301a2690 con 0x7f51300760a0 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f512f200640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 0x7f51301a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5125e00640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51300760a0 0x7f513019ccc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f513006c9f0 tx=0x7f511800dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5127e00640 1 -- 172.21.15.84:0/2986774441 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118017070 con 0x7f51300760a0 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5135400640 1 -- 172.21.15.84:0/2986774441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51301a2980 con 0x7f51300760a0 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5127e00640 1 -- 172.21.15.84:0/2986774441 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51180099a0 con 0x7f51300760a0 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5127e00640 1 -- 172.21.15.84:0/2986774441 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51180047a0 con 0x7f51300760a0 2024-09-21T02:45:27.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.140+0000 7f5135400640 1 -- 172.21.15.84:0/2986774441 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51301a90e0 con 0x7f51300760a0 2024-09-21T02:45:27.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f513c1e1740 1 Processor -- start 2024-09-21T02:45:27.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f513c1e1740 1 -- start start 2024-09-21T02:45:27.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f5127e00640 1 -- 172.21.15.84:0/2986774441 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f5118009b50 con 0x7f51300760a0 2024-09-21T02:45:27.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4526b2520 0x55f452a591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a59700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f452691840 0x55f452a59c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f513c1e1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f4529d0290 con 0x55f452691840 2024-09-21T02:45:27.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f513c1e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f4529bf6c0 con 0x55f452689660 2024-09-21T02:45:27.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.144+0000 7f513c1e1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f4529c34d0 con 0x55f4526b2520 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f5125e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f452691840 0x55f452a59c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a59700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512f200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4526b2520 0x55f452a591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a59700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:50992/0 (socket says 172.21.15.84:50992) 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f5125e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f452691840 0x55f452a59c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57058/0 (socket says 172.21.15.84:57058) 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512e800640 1 -- 172.21.15.84:0/1699627583 learned_addr learned my addr 172.21.15.84:0/1699627583 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512f200640 1 -- 172.21.15.84:0/1699627583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 msgr2=0x55f452a59700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512f200640 1 --2- 172.21.15.84:0/1699627583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a59700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512f200640 1 -- 172.21.15.84:0/1699627583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f452691840 msgr2=0x55f452a59c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512f200640 1 --2- 172.21.15.84:0/1699627583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f452691840 0x55f452a59c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512f200640 1 -- 172.21.15.84:0/1699627583 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f45294c460 con 0x55f4526b2520 2024-09-21T02:45:27.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.145+0000 7f512f200640 1 --2- 172.21.15.84:0/1699627583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4526b2520 0x55f452a591c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5128005cc0 tx=0x7f512802f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4af0bffd5bd78b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.146+0000 7f511f400640 1 -- 172.21.15.84:0/1699627583 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128003b70 con 0x55f4526b2520 2024-09-21T02:45:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.146+0000 7f511f400640 1 -- 172.21.15.84:0/1699627583 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5128036040 con 0x55f4526b2520 2024-09-21T02:45:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.146+0000 7f511f400640 1 -- 172.21.15.84:0/1699627583 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128004510 con 0x55f4526b2520 2024-09-21T02:45:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.146+0000 7f5127e00640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51140b6510 0x7f51140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.146+0000 7f5127e00640 1 -- 172.21.15.84:0/2986774441 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f51180e7280 con 0x7f51300760a0 2024-09-21T02:45:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.146+0000 7f512e800640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51140b6510 0x7f51140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 -- 172.21.15.84:0/1699627583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4526b2520 msgr2=0x55f452a591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 --2- 172.21.15.84:0/1699627583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4526b2520 0x55f452a591c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5128005cc0 tx=0x7f512802f440 comp rx=0 tx=0).stop 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 -- 172.21.15.84:0/1699627583 shutdown_connections 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 --2- 172.21.15.84:0/1699627583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f452691840 0x55f452a59c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 --2- 172.21.15.84:0/1699627583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a59700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 --2- 172.21.15.84:0/1699627583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4526b2520 0x55f452a591c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 -- 172.21.15.84:0/1699627583 >> 172.21.15.84:0/1699627583 conn(0x55f4526a6910 msgr2=0x55f452a570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 -- 172.21.15.84:0/1699627583 shutdown_connections 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f513c1e1740 1 -- 172.21.15.84:0/1699627583 wait complete. 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.147+0000 7f512e800640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51140b6510 0x7f51140b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55f452a57e40 tx=0x7f5120005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.148+0000 7f513c1e1740 1 -- start start 2024-09-21T02:45:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.148+0000 7f513c1e1740 1 Processor -- start 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.148+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a64d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.148+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a65290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.148+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a70ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.148+0000 7f513c1e1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f452820bb0 con 0x55f4526b2520 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.148+0000 7f513c1e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55f45295a6c0 con 0x55f452689660 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.148+0000 7f513c1e1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f452a677c0 con 0x55f452691840 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f513c1e1740 10 client.0 _ll_register_callbacks cb 0x55f452975490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a70ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a70ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57062/0 (socket says 172.21.15.84:57062) 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a64d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512f200640 1 -- 172.21.15.84:0/2571535683 learned_addr learned my addr 172.21.15.84:0/2571535683 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f5125e00640 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a65290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512e800640 1 -- 172.21.15.84:0/2571535683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 msgr2=0x55f452a65290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512e800640 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a65290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512e800640 1 -- 172.21.15.84:0/2571535683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 msgr2=0x55f452a70ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512e800640 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a70ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512e800640 1 -- 172.21.15.84:0/2571535683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f45271db00 con 0x55f452689660 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.149+0000 7f512f200640 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a70ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f512e800640 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a64d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f512001e9d0 tx=0x7f5120004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d6edba7fc9e0c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f5113e00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f5113e00640 1 -- 172.21.15.84:0/2571535683 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512002e060 con 0x55f452689660 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f513c1e1740 1 -- 172.21.15.84:0/2571535683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5128036040 con 0x55f452689660 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f5113e00640 1 -- 172.21.15.84:0/2571535683 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f5120018030 con 0x55f452689660 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f5113e00640 1 -- 172.21.15.84:0/2571535683 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5120035050 con 0x55f452689660 2024-09-21T02:45:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f513c1e1740 10 client.25766 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f513c1e1740 1 -- 172.21.15.84:0/2571535683 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f452794960 con 0x55f452689660 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.150+0000 7f5113e00640 1 -- 172.21.15.84:0/2571535683 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5128036040 con 0x55f452689660 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.151+0000 7f5113e00640 1 -- 172.21.15.84:0/2571535683 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f512000f450 con 0x55f452689660 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.151+0000 7f513c1e1740 10 client.25766 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.151+0000 7f513c1e1740 10 client.25766 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.151+0000 7f513c1e1740 20 client.25766 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.151+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f452670ea0 0x55f452a76b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.151+0000 7f513c1e1740 4 client.25766 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.151+0000 7f513c1e1740 1 -- 172.21.15.84:0/2571535683 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4529d21e0 con 0x55f452670ea0 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.151+0000 7f5125e00640 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f452670ea0 0x55f452a76b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.152+0000 7f5125e00640 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f452670ea0 0x55f452a76b30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae84ceb46832c3d server_cookie=e5a6e34e48925c3f in_seq=0 out_seq=0 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.152+0000 7f5113e00640 10 client.25766 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.152+0000 7f5113e00640 1 -- 172.21.15.84:0/2571535683 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4529d21e0 con 0x55f452670ea0 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.152+0000 7f5113e00640 10 client.25766 handle_command_reply: tid=0 2024-09-21T02:45:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.152+0000 7f513c1e1740 1 client.25766 shutdown 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 -- 172.21.15.84:0/2571535683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 msgr2=0x55f452a64d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a64d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f512001e9d0 tx=0x7f5120004730 comp rx=0 tx=0).stop 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 -- 172.21.15.84:0/2571535683 shutdown_connections 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a65290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f452670ea0 0x55f452a76b30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a70ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2571535683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a64d50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 -- 172.21.15.84:0/2571535683 >> 172.21.15.84:0/2571535683 conn(0x55f4526a6910 msgr2=0x55f452a5c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f5113e00640 0 client.25766 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 -- 172.21.15.84:0/2571535683 shutdown_connections 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 1 -- 172.21.15.84:0/2571535683 wait complete. 2024-09-21T02:45:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.153+0000 7f513c1e1740 20 client.25766 trim_cache size 0 max 16384 2024-09-21T02:45:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f513c1e1740 1 Processor -- start 2024-09-21T02:45:27.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f513c1e1740 1 -- start start 2024-09-21T02:45:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452689660 0x55f452a66780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452691840 0x55f452a61d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a62280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f513c1e1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51301b5640 con 0x55f4526b2520 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f513c1e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51301b2eb0 con 0x55f452691840 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f513c1e1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51301b0d00 con 0x55f452689660 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f512f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a62280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f5125e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452691840 0x55f452a61d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f512e800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452689660 0x55f452a66780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f5125e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452691840 0x55f452a61d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51020/0 (socket says 172.21.15.84:51020) 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f512f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a62280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57070/0 (socket says 172.21.15.84:57070) 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f512e800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452689660 0x55f452a66780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47230/0 (socket says 172.21.15.84:47230) 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.171+0000 7f5125e00640 1 -- 172.21.15.84:0/2099339838 learned_addr learned my addr 172.21.15.84:0/2099339838 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:27.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f5125e00640 1 -- 172.21.15.84:0/2099339838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452689660 msgr2=0x55f452a66780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f5125e00640 1 --2- 172.21.15.84:0/2099339838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452689660 0x55f452a66780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f5125e00640 1 -- 172.21.15.84:0/2099339838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 msgr2=0x55f452a62280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f5125e00640 1 --2- 172.21.15.84:0/2099339838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a62280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f5125e00640 1 -- 172.21.15.84:0/2099339838 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f452a5b6e0 con 0x55f452691840 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f512f200640 1 --2- 172.21.15.84:0/2099339838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a62280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f5125e00640 1 --2- 172.21.15.84:0/2099339838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452691840 0x55f452a61d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f51180a95f0 tx=0x7f5118094040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dea2d6a3af069b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f511ea00640 1 -- 172.21.15.84:0/2099339838 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51180acdf0 con 0x55f452691840 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f511ea00640 1 -- 172.21.15.84:0/2099339838 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51180e4e50 con 0x55f452691840 2024-09-21T02:45:27.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.172+0000 7f511ea00640 1 -- 172.21.15.84:0/2099339838 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51180ac790 con 0x55f452691840 2024-09-21T02:45:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 -- 172.21.15.84:0/2099339838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452691840 msgr2=0x55f452a61d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2099339838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452691840 0x55f452a61d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f51180a95f0 tx=0x7f5118094040 comp rx=0 tx=0).stop 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 -- 172.21.15.84:0/2099339838 shutdown_connections 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2099339838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a62280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2099339838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452691840 0x55f452a61d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 --2- 172.21.15.84:0/2099339838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452689660 0x55f452a66780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 -- 172.21.15.84:0/2099339838 >> 172.21.15.84:0/2099339838 conn(0x55f4526a6910 msgr2=0x55f452a66070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 -- 172.21.15.84:0/2099339838 shutdown_connections 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.173+0000 7f513c1e1740 1 -- 172.21.15.84:0/2099339838 wait complete. 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.174+0000 7f513c1e1740 1 -- start start 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.174+0000 7f513c1e1740 1 Processor -- start 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a6d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a69530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f513c1e1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a69a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f513c1e1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51301b1370 con 0x55f4526b2520 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f513c1e1740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51301b27e0 con 0x55f452689660 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f513c1e1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51301b1a40 con 0x55f452691840 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f513c1e1740 10 client.0 _ll_register_callbacks cb 0x7f5120012f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a6d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a69a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a6d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:51028/0 (socket says 172.21.15.84:51028) 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512e800640 1 -- 172.21.15.84:0/761882161 learned_addr learned my addr 172.21.15.84:0/761882161 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f5125e00640 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a69530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512e800640 1 -- 172.21.15.84:0/761882161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 msgr2=0x55f452a69530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512e800640 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a69530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512e800640 1 -- 172.21.15.84:0/761882161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 msgr2=0x55f452a69a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:27.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512e800640 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a69a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512e800640 1 -- 172.21.15.84:0/761882161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f452a6a0b0 con 0x55f452689660 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f5125e00640 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a69530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.175+0000 7f512f200640 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a69a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.176+0000 7f512e800640 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a6d070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f512000f990 tx=0x7f512000f5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffbcfa10a09ad460 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.176+0000 7f5113e00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.176+0000 7f5113e00640 1 -- 172.21.15.84:0/761882161 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120009b30 con 0x55f452689660 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.176+0000 7f513c1e1740 1 -- 172.21.15.84:0/761882161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51180e4e50 con 0x55f452689660 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.176+0000 7f5113e00640 1 -- 172.21.15.84:0/761882161 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f512000fc20 con 0x55f452689660 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.176+0000 7f5113e00640 1 -- 172.21.15.84:0/761882161 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5120047050 con 0x55f452689660 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.176+0000 7f513c1e1740 10 client.25772 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:27.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.176+0000 7f513c1e1740 1 -- 172.21.15.84:0/761882161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f452ae2320 con 0x55f452689660 2024-09-21T02:45:27.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f5113e00640 1 -- 172.21.15.84:0/761882161 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f51180e4e50 con 0x55f452689660 2024-09-21T02:45:27.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f5113e00640 1 -- 172.21.15.84:0/761882161 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f5120029420 con 0x55f452689660 2024-09-21T02:45:27.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f513c1e1740 10 client.25772 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:27.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f513c1e1740 10 client.25772 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:27.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f513c1e1740 20 client.25772 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:27.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f513c1e1740 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f452646250 0x55f452ae4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:27.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f513c1e1740 4 client.25772 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3c8d8ed4", "release": true, "await": true}] 2024-09-21T02:45:27.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f513c1e1740 1 -- 172.21.15.84:0/761882161 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3c8d8ed4", "release": true, "await": true}) -- 0x55f4529cdc90 con 0x55f452646250 2024-09-21T02:45:27.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.177+0000 7f5125e00640 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f452646250 0x55f452ae4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:27.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.178+0000 7f5125e00640 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f452646250 0x55f452ae4b30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca150e4630675202 server_cookie=896a00f977264d1e in_seq=0 out_seq=0 2024-09-21T02:45:27.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.178+0000 7f5113e00640 10 client.25772 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:27.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:26 smithi172 ceph-mon[35067]: pgmap v490: 129 pgs: 129 active+clean; 125 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.1 MiB/s wr, 216 op/s 2024-09-21T02:45:27.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:26 smithi090 ceph-mon[34571]: pgmap v490: 129 pgs: 129 active+clean; 125 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.1 MiB/s wr, 216 op/s 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f5113e00640 1 -- 172.21.15.84:0/761882161 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f4529cdc90 con 0x55f452646250 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f5113e00640 10 client.25772 handle_command_reply: tid=0 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 client.25772 shutdown 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 -- 172.21.15.84:0/761882161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 msgr2=0x55f452a6d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a6d070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f512000f990 tx=0x7f512000f5f0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 -- 172.21.15.84:0/761882161 shutdown_connections 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f452691840 0x55f452a69530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55f452646250 0x55f452ae4b30 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4526b2520 0x55f452a69a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 --2- 172.21.15.84:0/761882161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f452689660 0x55f452a6d070 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 -- 172.21.15.84:0/761882161 >> 172.21.15.84:0/761882161 conn(0x55f4526a6910 msgr2=0x55f452a66000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f5113e00640 0 client.25772 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 -- 172.21.15.84:0/761882161 shutdown_connections 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.477+0000 7f513c1e1740 1 -- 172.21.15.84:0/761882161 wait complete. 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.478+0000 7f513c1e1740 20 client.25772 trim_cache size 0 max 16384 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 30, 2024-09-21T02:45:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 12, 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "3c8d8ed4": { 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 12, 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 147.8, 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T02:45:27.481 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:27.482 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.478+0000 7f5135400640 1 -- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51140b6510 msgr2=0x7f51140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.478+0000 7f5135400640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51140b6510 0x7f51140b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55f452a57e40 tx=0x7f5120005f90 comp rx=0 tx=0).stop 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.478+0000 7f5135400640 1 -- 172.21.15.84:0/2986774441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51300760a0 msgr2=0x7f513019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.478+0000 7f5135400640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51300760a0 0x7f513019ccc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f513006c9f0 tx=0x7f511800dbb0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.479+0000 7f5135400640 1 -- 172.21.15.84:0/2986774441 shutdown_connections 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.479+0000 7f5135400640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5130110120 0x7f51301a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.479+0000 7f5135400640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51300760a0 0x7f513019ccc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.479+0000 7f5135400640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f51140b6510 0x7f51140b8a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.479+0000 7f5135400640 1 --2- 172.21.15.84:0/2986774441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5130075750 0x7f513019c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:27.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.479+0000 7f5135400640 1 -- 172.21.15.84:0/2986774441 >> 172.21.15.84:0/2986774441 conn(0x7f513007b850 msgr2=0x7f5130109c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:27.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.479+0000 7f5135400640 1 -- 172.21.15.84:0/2986774441 shutdown_connections 2024-09-21T02:45:27.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:27.479+0000 7f5135400640 1 -- 172.21.15.84:0/2986774441 wait complete. 2024-09-21T02:45:28.251 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3c8d8ed4', total seconds elapsed: 32.2 2024-09-21T02:45:28.252 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T02:45:28.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:45:28.635 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:29.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:28 smithi084 ceph-mon[30747]: pgmap v491: 129 pgs: 129 active+clean; 132 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.7 MiB/s wr, 253 op/s 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 -- 172.21.15.84:0/1787819714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac076100 msgr2=0x7f47ac10f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 --2- 172.21.15.84:0/1787819714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac076100 0x7f47ac10f9d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4798009900 tx=0x7f479802a410 comp rx=0 tx=0).stop 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 -- 172.21.15.84:0/1787819714 shutdown_connections 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 --2- 172.21.15.84:0/1787819714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac10ff10 0x7f47ac112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 --2- 172.21.15.84:0/1787819714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac076100 0x7f47ac10f9d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 --2- 172.21.15.84:0/1787819714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac0757b0 0x7f47ac075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 -- 172.21.15.84:0/1787819714 >> 172.21.15.84:0/1787819714 conn(0x7f47ac0ff440 msgr2=0x7f47ac101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 -- 172.21.15.84:0/1787819714 shutdown_connections 2024-09-21T02:45:29.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.212+0000 7f47b3000640 1 -- 172.21.15.84:0/1787819714 wait complete. 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.213+0000 7f47b3000640 1 Processor -- start 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.213+0000 7f47b3000640 1 -- start start 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.213+0000 7f47b3000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac0757b0 0x7f47ac19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.213+0000 7f47b3000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac076100 0x7f47ac19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.213+0000 7f47b3000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac10ff10 0x7f47ac1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.213+0000 7f47b3000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac115c30 con 0x7f47ac10ff10 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.213+0000 7f47b3000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac115ab0 con 0x7f47ac076100 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.213+0000 7f47b3000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac115db0 con 0x7f47ac0757b0 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac0757b0 0x7f47ac19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac0757b0 0x7f47ac19c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47254/0 (socket says 172.21.15.84:47254) 2024-09-21T02:45:29.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 -- 172.21.15.84:0/1528887280 learned_addr learned my addr 172.21.15.84:0/1528887280 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b2600640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac10ff10 0x7f47ac1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1200640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac076100 0x7f47ac19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 -- 172.21.15.84:0/1528887280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac076100 msgr2=0x7f47ac19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac076100 0x7f47ac19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 -- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac10ff10 msgr2=0x7f47ac1a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac10ff10 0x7f47ac1a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 -- 172.21.15.84:0/1528887280 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ac1a25d0 con 0x7f47ac0757b0 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.214+0000 7f47b1c00640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac0757b0 0x7f47ac19c660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f47a000e9f0 tx=0x7f47a000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.215+0000 7f47aa000640 1 -- 172.21.15.84:0/1528887280 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a000cd80 con 0x7f47ac0757b0 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.215+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ac1a28c0 con 0x7f47ac0757b0 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.215+0000 7f47aa000640 1 -- 172.21.15.84:0/1528887280 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47a0010900 con 0x7f47ac0757b0 2024-09-21T02:45:29.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.215+0000 7f47aa000640 1 -- 172.21.15.84:0/1528887280 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a00188d0 con 0x7f47ac0757b0 2024-09-21T02:45:29.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.215+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ac1a9020 con 0x7f47ac0757b0 2024-09-21T02:45:29.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.216+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ac075bc0 con 0x7f47ac0757b0 2024-09-21T02:45:29.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.219+0000 7f47aa000640 1 -- 172.21.15.84:0/1528887280 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f47a0010ab0 con 0x7f47ac0757b0 2024-09-21T02:45:29.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.220+0000 7f47aa000640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47940b6590 0x7f47940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:29.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.220+0000 7f47aa000640 1 -- 172.21.15.84:0/1528887280 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f47a00e7e10 con 0x7f47ac0757b0 2024-09-21T02:45:29.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.220+0000 7f47b1200640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47940b6590 0x7f47940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:29.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.221+0000 7f47b1200640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47940b6590 0x7f47940b8aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4798004770 tx=0x7f4798000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:29.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.226+0000 7f47aa000640 1 -- 172.21.15.84:0/1528887280 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47a00b2690 con 0x7f47ac0757b0 2024-09-21T02:45:29.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:28 smithi172 ceph-mon[35067]: pgmap v491: 129 pgs: 129 active+clean; 132 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.7 MiB/s wr, 253 op/s 2024-09-21T02:45:29.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:28 smithi090 ceph-mon[34571]: pgmap v491: 129 pgs: 129 active+clean; 132 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 1.7 MiB/s wr, 253 op/s 2024-09-21T02:45:29.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.474+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47ac1a92c0 con 0x7f47ac0757b0 2024-09-21T02:45:29.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.475+0000 7f47aa000640 1 -- 172.21.15.84:0/1528887280 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11913 (secure 0 0 0) 0x7f47a00b75d0 con 0x7f47ac0757b0 2024-09-21T02:45:29.476 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:45:29.476 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":30,"btime":"2024-09-21T02:44:49:769551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:44:49.033686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:45:29.477 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 30 2024-09-21T02:45:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.477+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47940b6590 msgr2=0x7f47940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.477+0000 7f47b3000640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47940b6590 0x7f47940b8aa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4798004770 tx=0x7f4798000bc0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.477+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac0757b0 msgr2=0x7f47ac19c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.477+0000 7f47b3000640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac0757b0 0x7f47ac19c660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f47a000e9f0 tx=0x7f47a000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.478+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 shutdown_connections 2024-09-21T02:45:29.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.478+0000 7f47b3000640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac10ff10 0x7f47ac1a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.478+0000 7f47b3000640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac076100 0x7f47ac19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.478+0000 7f47b3000640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47940b6590 0x7f47940b8aa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.478+0000 7f47b3000640 1 --2- 172.21.15.84:0/1528887280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac0757b0 0x7f47ac19c660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.478+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 >> 172.21.15.84:0/1528887280 conn(0x7f47ac0ff440 msgr2=0x7f47ac109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.478+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 shutdown_connections 2024-09-21T02:45:29.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:29.478+0000 7f47b3000640 1 -- 172.21.15.84:0/1528887280 wait complete. 2024-09-21T02:45:30.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:29 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1528887280' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:30.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:29 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1528887280' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:30.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:29 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1528887280' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:30.346 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T02:45:30.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T02:45:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:31.154 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:30 smithi084 ceph-mon[30747]: pgmap v492: 129 pgs: 129 active+clean; 132 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.7 MiB/s wr, 241 op/s 2024-09-21T02:45:31.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:30 smithi172 ceph-mon[35067]: pgmap v492: 129 pgs: 129 active+clean; 132 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.7 MiB/s wr, 241 op/s 2024-09-21T02:45:31.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:30 smithi090 ceph-mon[34571]: pgmap v492: 129 pgs: 129 active+clean; 132 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 1.7 MiB/s wr, 241 op/s 2024-09-21T02:45:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 -- 172.21.15.84:0/2512591262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac109300 msgr2=0x7fc0ac109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 --2- 172.21.15.84:0/2512591262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac109300 0x7fc0ac109710 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc098009900 tx=0x7fc09802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 -- 172.21.15.84:0/2512591262 shutdown_connections 2024-09-21T02:45:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 --2- 172.21.15.84:0/2512591262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0ac109c50 0x7fc0ac110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 --2- 172.21.15.84:0/2512591262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac109300 0x7fc0ac109710 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 --2- 172.21.15.84:0/2512591262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0ac1039c0 0x7fc0ac103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 -- 172.21.15.84:0/2512591262 >> 172.21.15.84:0/2512591262 conn(0x7fc0ac0ff430 msgr2=0x7fc0ac101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 -- 172.21.15.84:0/2512591262 shutdown_connections 2024-09-21T02:45:31.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.510+0000 7fc0abe00640 1 -- 172.21.15.84:0/2512591262 wait complete. 2024-09-21T02:45:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.512+0000 7fc0abe00640 1 Processor -- start 2024-09-21T02:45:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.512+0000 7fc0abe00640 1 -- start start 2024-09-21T02:45:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.512+0000 7fc0abe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac1039c0 0x7fc0ac19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.512+0000 7fc0abe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0ac109300 0x7fc0ac19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.512+0000 7fc0abe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0ac109c50 0x7fc0ac1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.512+0000 7fc0abe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac113a80 con 0x7fc0ac1039c0 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0abe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac113900 con 0x7fc0ac109c50 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0abe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac113c00 con 0x7fc0ac109300 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac1039c0 0x7fc0ac19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0ac109300 0x7fc0ac19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac1039c0 0x7fc0ac19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59758/0 (socket says 172.21.15.84:59758) 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aaa00640 1 -- 172.21.15.84:0/3246741711 learned_addr learned my addr 172.21.15.84:0/3246741711 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:31.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0ab400640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0ac109c50 0x7fc0ac1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aa000640 1 -- 172.21.15.84:0/3246741711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0ac109c50 msgr2=0x7fc0ac1a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aa000640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0ac109c50 0x7fc0ac1a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aa000640 1 -- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac1039c0 msgr2=0x7fc0ac19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aa000640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac1039c0 0x7fc0ac19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.513+0000 7fc0aa000640 1 -- 172.21.15.84:0/3246741711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ac1a2580 con 0x7fc0ac109300 2024-09-21T02:45:31.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.514+0000 7fc0aa000640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0ac109300 0x7fc0ac19cbb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc098009230 tx=0x7fc098003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.514+0000 7fc0a3400640 1 -- 172.21.15.84:0/3246741711 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09803f070 con 0x7fc0ac109300 2024-09-21T02:45:31.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.514+0000 7fc0a3400640 1 -- 172.21.15.84:0/3246741711 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc098031be0 con 0x7fc0ac109300 2024-09-21T02:45:31.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.514+0000 7fc0a3400640 1 -- 172.21.15.84:0/3246741711 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098035030 con 0x7fc0ac109300 2024-09-21T02:45:31.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.514+0000 7fc0abe00640 1 -- 172.21.15.84:0/3246741711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ac1a2810 con 0x7fc0ac109300 2024-09-21T02:45:31.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.514+0000 7fc0abe00640 1 -- 172.21.15.84:0/3246741711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ac1a2c70 con 0x7fc0ac109300 2024-09-21T02:45:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.517+0000 7fc0b861e740 1 Processor -- start 2024-09-21T02:45:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.517+0000 7fc0b861e740 1 -- start start 2024-09-21T02:45:31.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0a3400640 1 -- 172.21.15.84:0/3246741711 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fc098042070 con 0x7fc0ac109300 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713df510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607100e980 0x5560713dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713dff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0b861e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556071354ca0 con 0x55607100e980 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0b861e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5560713440d0 con 0x556071016b60 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0b861e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556071347ee0 con 0x556071037840 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0ab400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713df510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713dff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0aaa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607100e980 0x5560713dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0ab400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713df510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47902/0 (socket says 172.21.15.84:47902) 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.518+0000 7fc0ab400640 1 -- 172.21.15.84:0/2302070069 learned_addr learned my addr 172.21.15.84:0/2302070069 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc0ab400640 1 -- 172.21.15.84:0/2302070069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 msgr2=0x5560713dff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc0ab400640 1 --2- 172.21.15.84:0/2302070069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713dff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc0ab400640 1 -- 172.21.15.84:0/2302070069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607100e980 msgr2=0x5560713dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc0ab400640 1 --2- 172.21.15.84:0/2302070069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607100e980 0x5560713dfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc0ab400640 1 -- 172.21.15.84:0/2302070069 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560712f6400 con 0x556071037840 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/2302070069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607100e980 0x5560713dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc0ab400640 1 --2- 172.21.15.84:0/2302070069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713df510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009fd0 tx=0x7fc0a40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dcf21cb1c2d54be server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc097e00640 1 -- 172.21.15.84:0/2302070069 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4004d20 con 0x556071037840 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc097e00640 1 -- 172.21.15.84:0/2302070069 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0a4004050 con 0x556071037840 2024-09-21T02:45:31.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.519+0000 7fc097e00640 1 -- 172.21.15.84:0/2302070069 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4005260 con 0x556071037840 2024-09-21T02:45:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0a3400640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc0900b6580 0x7fc0900b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0b861e740 1 -- 172.21.15.84:0/2302070069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 msgr2=0x5560713df510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2302070069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713df510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009fd0 tx=0x7fc0a40118d0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0a3400640 1 -- 172.21.15.84:0/3246741711 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc098107b50 con 0x7fc0ac109300 2024-09-21T02:45:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc0900b6580 0x7fc0900b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0b861e740 1 -- 172.21.15.84:0/2302070069 shutdown_connections 2024-09-21T02:45:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2302070069 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713dff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2302070069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607100e980 0x5560713dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2302070069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713df510 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.520+0000 7fc0b861e740 1 -- 172.21.15.84:0/2302070069 >> 172.21.15.84:0/2302070069 conn(0x55607102b990 msgr2=0x5560713dd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.521+0000 7fc0b861e740 1 -- 172.21.15.84:0/2302070069 shutdown_connections 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.521+0000 7fc0b861e740 1 -- 172.21.15.84:0/2302070069 wait complete. 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.521+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc0900b6580 0x7fc0900b8a90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5560713de190 tx=0x7fc09c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.521+0000 7fc0b861e740 1 -- start start 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.521+0000 7fc0b861e740 1 Processor -- start 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713eb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071037840 0x5560713f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0b861e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5560711a57a0 con 0x556071037840 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0b861e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5560712e9a10 con 0x556071016b60 2024-09-21T02:45:31.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0b861e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5560713edcf0 con 0x55607100e980 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0b861e740 10 client.0 _ll_register_callbacks cb 0x5560712f9be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713eb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0aaa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713eb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:54992/0 (socket says 172.21.15.84:54992) 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0aa000640 1 -- 172.21.15.84:0/1960760198 learned_addr learned my addr 172.21.15.84:0/1960760198 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.522+0000 7fc0ab400640 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071037840 0x5560713f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc0aa000640 1 -- 172.21.15.84:0/1960760198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 msgr2=0x5560713eabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc0aa000640 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713eabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc0aa000640 1 -- 172.21.15.84:0/1960760198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071037840 msgr2=0x5560713f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc0aa000640 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071037840 0x5560713f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc0aa000640 1 -- 172.21.15.84:0/1960760198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560710b1b90 con 0x556071016b60 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc0aa000640 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713eb130 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0980cd930 tx=0x7fc098009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a4f372284575b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc094c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:45:31.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc094c00640 1 -- 172.21.15.84:0/1960760198 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098049070 con 0x556071016b60 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc094c00640 1 -- 172.21.15.84:0/1960760198 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc0980c9c10 con 0x556071016b60 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.523+0000 7fc0b861e740 1 -- 172.21.15.84:0/1960760198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0a4004050 con 0x556071016b60 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.524+0000 7fc094c00640 1 -- 172.21.15.84:0/1960760198 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc0980cd770 con 0x556071016b60 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.524+0000 7fc0b861e740 10 client.25790 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.524+0000 7fc0b861e740 1 -- 172.21.15.84:0/1960760198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5560713f9a30 con 0x556071016b60 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.524+0000 7fc094c00640 1 -- 172.21.15.84:0/1960760198 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc0a4004050 con 0x556071016b60 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.524+0000 7fc094c00640 1 -- 172.21.15.84:0/1960760198 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fc098031710 con 0x556071016b60 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.524+0000 7fc0b861e740 10 client.25790 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.524+0000 7fc0b861e740 10 client.25790 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.524+0000 7fc0b861e740 20 client.25790 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.525+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556070ff61c0 0x5560713fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.525+0000 7fc0b861e740 4 client.25790 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.525+0000 7fc0b861e740 1 -- 172.21.15.84:0/1960760198 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556071356bf0 con 0x556070ff61c0 2024-09-21T02:45:31.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.525+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556070ff61c0 0x5560713fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.525+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556070ff61c0 0x5560713fcfc0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504afd0615288eb1 server_cookie=7034824ccddccc99 in_seq=0 out_seq=0 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.525+0000 7fc094c00640 10 client.25790 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.526+0000 7fc094c00640 1 -- 172.21.15.84:0/1960760198 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556071356bf0 con 0x556070ff61c0 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.526+0000 7fc094c00640 10 client.25790 handle_command_reply: tid=0 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 client.25790 shutdown 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 -- 172.21.15.84:0/1960760198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 msgr2=0x5560713eb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713eb130 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0980cd930 tx=0x7fc098009560 comp rx=0 tx=0).stop 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 -- 172.21.15.84:0/1960760198 shutdown_connections 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556070ff61c0 0x5560713fcfc0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071037840 0x5560713f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071016b60 0x5560713eb130 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc094c00640 0 client.25790 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:31.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1960760198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 -- 172.21.15.84:0/1960760198 >> 172.21.15.84:0/1960760198 conn(0x55607102b990 msgr2=0x5560713e26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 -- 172.21.15.84:0/1960760198 shutdown_connections 2024-09-21T02:45:31.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 1 -- 172.21.15.84:0/1960760198 wait complete. 2024-09-21T02:45:31.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.527+0000 7fc0b861e740 20 client.25790 trim_cache size 0 max 16384 2024-09-21T02:45:31.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.547+0000 7fc0b861e740 1 Processor -- start 2024-09-21T02:45:31.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.547+0000 7fc0b861e740 1 -- start start 2024-09-21T02:45:31.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.547+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55607100e980 0x5560713ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0b861e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac1b54a0 con 0x556071016b60 2024-09-21T02:45:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0b861e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac1b2d10 con 0x55607100e980 2024-09-21T02:45:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0b861e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac1b0b60 con 0x556071037840 2024-09-21T02:45:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aaa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55607100e980 0x5560713ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aaa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55607100e980 0x5560713ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:54996/0 (socket says 172.21.15.84:54996) 2024-09-21T02:45:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aaa00640 1 -- 172.21.15.84:0/1386794485 learned_addr learned my addr 172.21.15.84:0/1386794485 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0ab400640 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aa000640 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aaa00640 1 -- 172.21.15.84:0/1386794485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 msgr2=0x5560713e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713e7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aaa00640 1 -- 172.21.15.84:0/1386794485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 msgr2=0x5560713f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aaa00640 1 -- 172.21.15.84:0/1386794485 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560713d7630 con 0x55607100e980 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.548+0000 7fc0aa000640 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.549+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55607100e980 0x5560713ecad0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5560713fd720 tx=0x7fc09c01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5d33255a1d114e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.549+0000 7fc097400640 1 -- 172.21.15.84:0/1386794485 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c00f540 con 0x55607100e980 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.549+0000 7fc097400640 1 -- 172.21.15.84:0/1386794485 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc09c037070 con 0x55607100e980 2024-09-21T02:45:31.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.549+0000 7fc097400640 1 -- 172.21.15.84:0/1386794485 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c02cb00 con 0x55607100e980 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 -- 172.21.15.84:0/1386794485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55607100e980 msgr2=0x5560713ecad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55607100e980 0x5560713ecad0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x5560713fd720 tx=0x7fc09c01b000 comp rx=0 tx=0).stop 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 -- 172.21.15.84:0/1386794485 shutdown_connections 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556071037840 0x5560713e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 --2- 172.21.15.84:0/1386794485 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55607100e980 0x5560713ecad0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 -- 172.21.15.84:0/1386794485 >> 172.21.15.84:0/1386794485 conn(0x55607102b990 msgr2=0x5560713e2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 -- 172.21.15.84:0/1386794485 shutdown_connections 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.550+0000 7fc0b861e740 1 -- 172.21.15.84:0/1386794485 wait complete. 2024-09-21T02:45:31.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.551+0000 7fc0b861e740 1 -- start start 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.551+0000 7fc0b861e740 1 Processor -- start 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.551+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.551+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.551+0000 7fc0b861e740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071037840 0x556071466980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.551+0000 7fc0b861e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac1b11d0 con 0x556071016b60 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.551+0000 7fc0b861e740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac1b2640 con 0x556071037840 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.551+0000 7fc0b861e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac1b18a0 con 0x55607100e980 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0b861e740 10 client.0 _ll_register_callbacks cb 0x7fc098005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47936/0 (socket says 172.21.15.84:47936) 2024-09-21T02:45:31.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 -- 172.21.15.84:0/2363664294 learned_addr learned my addr 172.21.15.84:0/2363664294 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0ab400640 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071037840 0x556071466980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 -- 172.21.15.84:0/2363664294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071037840 msgr2=0x556071466980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071037840 0x556071466980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 -- 172.21.15.84:0/2363664294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 msgr2=0x5560713efbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713efbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 -- 172.21.15.84:0/2363664294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556071466f10 con 0x55607100e980 2024-09-21T02:45:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc0aaa00640 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713ef6b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc09c012f10 tx=0x7fc09c0050f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c87c9bc3b8e5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:31.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.552+0000 7fc094c00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.553+0000 7fc094c00640 1 -- 172.21.15.84:0/2363664294 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c03f070 con 0x55607100e980 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.553+0000 7fc0b861e740 1 -- 172.21.15.84:0/2363664294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09c037070 con 0x55607100e980 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.553+0000 7fc094c00640 1 -- 172.21.15.84:0/2363664294 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc09c0054e0 con 0x55607100e980 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.553+0000 7fc094c00640 1 -- 172.21.15.84:0/2363664294 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc09c02c780 con 0x55607100e980 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.553+0000 7fc0b861e740 10 client.25816 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.553+0000 7fc0b861e740 1 -- 172.21.15.84:0/2363664294 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556071468170 con 0x55607100e980 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.553+0000 7fc094c00640 1 -- 172.21.15.84:0/2363664294 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc09c037070 con 0x55607100e980 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.554+0000 7fc094c00640 1 -- 172.21.15.84:0/2363664294 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fc09c00f540 con 0x55607100e980 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.554+0000 7fc0b861e740 10 client.25816 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.554+0000 7fc0b861e740 10 client.25816 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.554+0000 7fc0b861e740 20 client.25816 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.554+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556070fcb570 0x55607146a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:31.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.554+0000 7fc0b861e740 4 client.25816 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T02:45:31.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.554+0000 7fc0b861e740 1 -- 172.21.15.84:0/2363664294 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x5560713526a0 con 0x556070fcb570 2024-09-21T02:45:31.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.554+0000 7fc0aa000640 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556070fcb570 0x55607146a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:31.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.555+0000 7fc0aa000640 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556070fcb570 0x55607146a9e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad0d60e5de76732f server_cookie=e1e97bd9c7e1d33c in_seq=0 out_seq=0 2024-09-21T02:45:31.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:31.555+0000 7fc094c00640 10 client.25816 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 -- 172.21.15.84:0/805554643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e81072f0 msgr2=0x7f55e810dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 --2- 172.21.15.84:0/805554643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e81072f0 0x7f55e810dc90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009ca0 tx=0x7f55e002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 -- 172.21.15.84:0/805554643 shutdown_connections 2024-09-21T02:45:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 --2- 172.21.15.84:0/805554643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e81072f0 0x7f55e810dc90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 --2- 172.21.15.84:0/805554643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e8106950 0x7f55e8106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 --2- 172.21.15.84:0/805554643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e81058d0 0x7f55e8105d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 -- 172.21.15.84:0/805554643 >> 172.21.15.84:0/805554643 conn(0x7f55e8101230 msgr2=0x7f55e81036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 -- 172.21.15.84:0/805554643 shutdown_connections 2024-09-21T02:45:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.293+0000 7f55ee200640 1 -- 172.21.15.84:0/805554643 wait complete. 2024-09-21T02:45:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.294+0000 7f55ee200640 1 Processor -- start 2024-09-21T02:45:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.294+0000 7f55ee200640 1 -- start start 2024-09-21T02:45:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.294+0000 7f55ee200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e81058d0 0x7f55e819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.294+0000 7f55ee200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e8106950 0x7f55e819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.294+0000 7f55ee200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e81072f0 0x7f55e819d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.294+0000 7f55ee200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55e8111670 con 0x7f55e81058d0 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.294+0000 7f55ee200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55e81114f0 con 0x7f55e81072f0 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.294+0000 7f55ee200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55e81117f0 con 0x7f55e8106950 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e81058d0 0x7f55e819c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e8106950 0x7f55e819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e81072f0 0x7f55e819d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e8106950 0x7f55e819c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47954/0 (socket says 172.21.15.84:47954) 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 -- 172.21.15.84:0/602332052 learned_addr learned my addr 172.21.15.84:0/602332052 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 -- 172.21.15.84:0/602332052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e81072f0 msgr2=0x7f55e819d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e81072f0 0x7f55e819d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 -- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e81058d0 msgr2=0x7f55e819c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e81058d0 0x7f55e819c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 -- 172.21.15.84:0/602332052 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e819dbd0 con 0x7f55e8106950 2024-09-21T02:45:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e7400640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e81058d0 0x7f55e819c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.295+0000 7f55e6a00640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e8106950 0x7f55e819c800 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f55d400e9f0 tx=0x7f55d400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.296+0000 7f55dfe00640 1 -- 172.21.15.84:0/602332052 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d400cd80 con 0x7f55e8106950 2024-09-21T02:45:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.296+0000 7f55ee200640 1 -- 172.21.15.84:0/602332052 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e819dec0 con 0x7f55e8106950 2024-09-21T02:45:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.296+0000 7f55dfe00640 1 -- 172.21.15.84:0/602332052 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55d4010900 con 0x7f55e8106950 2024-09-21T02:45:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.296+0000 7f55dfe00640 1 -- 172.21.15.84:0/602332052 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d40188d0 con 0x7f55e8106950 2024-09-21T02:45:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.296+0000 7f55ee200640 1 -- 172.21.15.84:0/602332052 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e81a45b0 con 0x7f55e8106950 2024-09-21T02:45:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55f5258740 1 Processor -- start 2024-09-21T02:45:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55f5258740 1 -- start start 2024-09-21T02:45:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55f5258740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b0581b0 0x55ce6b3ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55f5258740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3ff740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55f5258740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 0x55ce6b400290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55f5258740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ce6b3726b0 con 0x55ce6b02f2f0 2024-09-21T02:45:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55f5258740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ce6b361ae0 con 0x55ce6b0374d0 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55f5258740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ce6b3658f0 con 0x55ce6b0581b0 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.299+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b0581b0 0x55ce6b3ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b0581b0 0x55ce6b3ff0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47960/0 (socket says 172.21.15.84:47960) 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7e00640 1 -- 172.21.15.84:0/3101361876 learned_addr learned my addr 172.21.15.84:0/3101361876 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55dfe00640 1 -- 172.21.15.84:0/602332052 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f55d4010ab0 con 0x7f55e8106950 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7e00640 1 -- 172.21.15.84:0/3101361876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 msgr2=0x55ce6b400290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7e00640 1 --2- 172.21.15.84:0/3101361876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 0x55ce6b400290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7e00640 1 -- 172.21.15.84:0/3101361876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b02f2f0 msgr2=0x55ce6b3ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7e00640 1 --2- 172.21.15.84:0/3101361876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7e00640 1 -- 172.21.15.84:0/3101361876 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce6b32e780 con 0x55ce6b0581b0 2024-09-21T02:45:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55e7e00640 1 --2- 172.21.15.84:0/3101361876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b0581b0 0x55ce6b3ff0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55e0035000 tx=0x7f55e002f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6863664d0cfb87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.300+0000 7f55d3e00640 1 -- 172.21.15.84:0/3101361876 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0031650 con 0x55ce6b0581b0 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55d3e00640 1 -- 172.21.15.84:0/3101361876 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55e0036030 con 0x55ce6b0581b0 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55d3e00640 1 -- 172.21.15.84:0/3101361876 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0004860 con 0x55ce6b0581b0 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55dfe00640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f55cc0b6510 0x7f55cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 -- 172.21.15.84:0/3101361876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b0581b0 msgr2=0x55ce6b3ff0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 --2- 172.21.15.84:0/3101361876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b0581b0 0x55ce6b3ff0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55e0035000 tx=0x7f55e002f410 comp rx=0 tx=0).stop 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 -- 172.21.15.84:0/3101361876 shutdown_connections 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55dfe00640 1 -- 172.21.15.84:0/602332052 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f55d40e79e0 con 0x7f55e8106950 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 --2- 172.21.15.84:0/3101361876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 0x55ce6b400290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 --2- 172.21.15.84:0/3101361876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 --2- 172.21.15.84:0/3101361876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b0581b0 0x55ce6b3ff0d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 -- 172.21.15.84:0/3101361876 >> 172.21.15.84:0/3101361876 conn(0x55ce6b04c300 msgr2=0x55ce6b3fab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55e7400640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f55cc0b6510 0x7f55cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 -- 172.21.15.84:0/3101361876 shutdown_connections 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.301+0000 7f55f5258740 1 -- 172.21.15.84:0/3101361876 wait complete. 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.302+0000 7f55f5258740 1 -- start start 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.302+0000 7f55f5258740 1 Processor -- start 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.302+0000 7f55e7400640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f55cc0b6510 0x7f55cc0b8a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f55d80124a0 tx=0x7f55d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55f5258740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b408640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55f5258740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 0x55ce6b408d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55f5258740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0581b0 0x55ce6b409870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55f5258740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ce6b299ab0 con 0x55ce6b0581b0 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55f5258740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ce6b308570 con 0x55ce6b0374d0 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55f5258740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ce6b400bd0 con 0x55ce6b02f2f0 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55f5258740 10 client.0 _ll_register_callbacks cb 0x55ce6b317100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b408640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b408640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47966/0 (socket says 172.21.15.84:47966) 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e6a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 0x55ce6b408d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 -- 172.21.15.84:0/529814599 learned_addr learned my addr 172.21.15.84:0/529814599 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0581b0 0x55ce6b409870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 -- 172.21.15.84:0/529814599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 msgr2=0x55ce6b408d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 0x55ce6b408d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 -- 172.21.15.84:0/529814599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0581b0 msgr2=0x55ce6b409870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0581b0 0x55ce6b409870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 -- 172.21.15.84:0/529814599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce6b0c3790 con 0x55ce6b02f2f0 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55e7400640 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b408640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55d8003710 tx=0x7f55d8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b73696e7e6191c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.303+0000 7f55d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:45:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.304+0000 7f55d0c00640 1 -- 172.21.15.84:0/529814599 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d802d060 con 0x55ce6b02f2f0 2024-09-21T02:45:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.304+0000 7f55d0c00640 1 -- 172.21.15.84:0/529814599 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f55d8018030 con 0x55ce6b02f2f0 2024-09-21T02:45:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.304+0000 7f55f5258740 1 -- 172.21.15.84:0/529814599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e0036030 con 0x55ce6b02f2f0 2024-09-21T02:45:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.304+0000 7f55d0c00640 1 -- 172.21.15.84:0/529814599 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f55d8034050 con 0x55ce6b02f2f0 2024-09-21T02:45:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.304+0000 7f55f5258740 10 client.25828 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.304+0000 7f55f5258740 1 -- 172.21.15.84:0/529814599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ce6b13c620 con 0x55ce6b02f2f0 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.304+0000 7f55d0c00640 1 -- 172.21.15.84:0/529814599 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55e0036030 con 0x55ce6b02f2f0 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.304+0000 7f55d0c00640 1 -- 172.21.15.84:0/529814599 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f55d8028ac0 con 0x55ce6b02f2f0 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.305+0000 7f55f5258740 10 client.25828 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.305+0000 7f55f5258740 10 client.25828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.305+0000 7f55f5258740 20 client.25828 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.305+0000 7f55f5258740 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ce6b016d80 0x55ce6b415e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.305+0000 7f55f5258740 4 client.25828 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.305+0000 7f55f5258740 1 -- 172.21.15.84:0/529814599 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce6b374600 con 0x55ce6b016d80 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.305+0000 7f55e6a00640 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ce6b016d80 0x55ce6b415e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.306+0000 7f55e6a00640 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ce6b016d80 0x55ce6b415e60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9accbd2103f8f8de server_cookie=543eb826f25e8d49 in_seq=0 out_seq=0 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.306+0000 7f55d0c00640 10 client.25828 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.306+0000 7f55d0c00640 1 -- 172.21.15.84:0/529814599 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce6b374600 con 0x55ce6b016d80 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.306+0000 7f55d0c00640 10 client.25828 handle_command_reply: tid=0 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.306+0000 7f55f5258740 1 client.25828 shutdown 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 -- 172.21.15.84:0/529814599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 msgr2=0x55ce6b408640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b408640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55d8003710 tx=0x7f55d8004730 comp rx=0 tx=0).stop 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 -- 172.21.15.84:0/529814599 shutdown_connections 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ce6b016d80 0x55ce6b415e60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0581b0 0x55ce6b409870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55d0c00640 0 client.25828 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b0374d0 0x55ce6b408d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 --2- 172.21.15.84:0/529814599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b408640 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 -- 172.21.15.84:0/529814599 >> 172.21.15.84:0/529814599 conn(0x55ce6b04c300 msgr2=0x55ce6b3fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 -- 172.21.15.84:0/529814599 shutdown_connections 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 1 -- 172.21.15.84:0/529814599 wait complete. 2024-09-21T02:45:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.307+0000 7f55f5258740 20 client.25828 trim_cache size 0 max 16384 2024-09-21T02:45:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.322+0000 7f55f5258740 1 Processor -- start 2024-09-21T02:45:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.322+0000 7f55f5258740 1 -- start start 2024-09-21T02:45:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.322+0000 7f55f5258740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.322+0000 7f55f5258740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3fa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.322+0000 7f55f5258740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b3fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.322+0000 7f55f5258740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55e81b11e0 con 0x55ce6b0374d0 2024-09-21T02:45:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.322+0000 7f55f5258740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55e81aea50 con 0x55ce6b016d80 2024-09-21T02:45:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.322+0000 7f55f5258740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55e81ac8a0 con 0x55ce6b02f2f0 2024-09-21T02:45:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b3fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3fa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:47980/0 (socket says 172.21.15.84:47980) 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 -- 172.21.15.84:0/1007961804 learned_addr learned my addr 172.21.15.84:0/1007961804 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e7400640 1 --2- 172.21.15.84:0/1007961804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 -- 172.21.15.84:0/1007961804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 msgr2=0x55ce6b4038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 --2- 172.21.15.84:0/1007961804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 -- 172.21.15.84:0/1007961804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 msgr2=0x55ce6b3fb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 --2- 172.21.15.84:0/1007961804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b3fb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 -- 172.21.15.84:0/1007961804 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce6b413bb0 con 0x55ce6b02f2f0 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55e6a00640 1 --2- 172.21.15.84:0/1007961804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3fa0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f55d40e5150 tx=0x7f55d40e7d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7c4ed0ca43d9a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55d3400640 1 -- 172.21.15.84:0/1007961804 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d40b7200 con 0x55ce6b02f2f0 2024-09-21T02:45:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55d3400640 1 -- 172.21.15.84:0/1007961804 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55d40b2070 con 0x55ce6b02f2f0 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.323+0000 7f55d3400640 1 -- 172.21.15.84:0/1007961804 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d40a9440 con 0x55ce6b02f2f0 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 -- 172.21.15.84:0/1007961804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 msgr2=0x55ce6b3fa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 --2- 172.21.15.84:0/1007961804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3fa0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f55d40e5150 tx=0x7f55d40e7d00 comp rx=0 tx=0).stop 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 -- 172.21.15.84:0/1007961804 shutdown_connections 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 --2- 172.21.15.84:0/1007961804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b3fa0f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 --2- 172.21.15.84:0/1007961804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b3fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 --2- 172.21.15.84:0/1007961804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 -- 172.21.15.84:0/1007961804 >> 172.21.15.84:0/1007961804 conn(0x55ce6b04c300 msgr2=0x55ce6b4031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 -- 172.21.15.84:0/1007961804 shutdown_connections 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.324+0000 7f55f5258740 1 -- 172.21.15.84:0/1007961804 wait complete. 2024-09-21T02:45:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 1 -- start start 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 1 Processor -- start 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b40f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b40f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f55e81acf10 con 0x55ce6b0374d0 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55e81ae380 con 0x55ce6b016d80 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55e81ad5e0 con 0x55ce6b02f2f0 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.325+0000 7f55f5258740 10 client.0 _ll_register_callbacks cb 0x7f55d8004050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b40f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b40f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59866/0 (socket says 172.21.15.84:59866) 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7e00640 1 -- 172.21.15.84:0/200215101 learned_addr learned my addr 172.21.15.84:0/200215101 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7400640 1 -- 172.21.15.84:0/200215101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 msgr2=0x55ce6b40f090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7400640 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b40f090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7400640 1 -- 172.21.15.84:0/200215101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 msgr2=0x55ce6b40f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7400640 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b40f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7400640 1 -- 172.21.15.84:0/200215101 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce6b40fce0 con 0x55ce6b016d80 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7e00640 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b40f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55e7400640 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4103d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55d8019040 tx=0x7f55d8020270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8beafaa83032c7a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55d0c00640 1 -- 172.21.15.84:0/200215101 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8020c90 con 0x55ce6b016d80 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55d0c00640 1 -- 172.21.15.84:0/200215101 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f55d80283e0 con 0x55ce6b016d80 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.326+0000 7f55f5258740 1 -- 172.21.15.84:0/200215101 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55d40b2070 con 0x55ce6b016d80 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55d0c00640 1 -- 172.21.15.84:0/200215101 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f55d80203e0 con 0x55ce6b016d80 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55f5258740 10 client.25811 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55f5258740 1 -- 172.21.15.84:0/200215101 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ce6b480820 con 0x55ce6b016d80 2024-09-21T02:45:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55d0c00640 1 -- 172.21.15.84:0/200215101 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55d40b2070 con 0x55ce6b016d80 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55d0c00640 1 -- 172.21.15.84:0/200215101 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f55d801d670 con 0x55ce6b016d80 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55f5258740 10 client.25811 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55f5258740 10 client.25811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55f5258740 20 client.25811 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55f5258740 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ce6b0581b0 0x55ce6b483190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55f5258740 4 client.25811 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.327+0000 7f55f5258740 1 -- 172.21.15.84:0/200215101 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce6b3700b0 con 0x55ce6b0581b0 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.328+0000 7f55e6a00640 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ce6b0581b0 0x55ce6b483190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.328+0000 7f55e6a00640 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ce6b0581b0 0x55ce6b483190 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d01c5cf3abc6ded8 server_cookie=51dc944c09a71c89 in_seq=0 out_seq=0 2024-09-21T02:45:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.328+0000 7f55d0c00640 10 client.25811 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55d0c00640 1 -- 172.21.15.84:0/200215101 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ce6b3700b0 con 0x55ce6b0581b0 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55d0c00640 10 client.25811 handle_command_reply: tid=0 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 client.25811 shutdown 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 -- 172.21.15.84:0/200215101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 msgr2=0x55ce6b4103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4103d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f55d8019040 tx=0x7f55d8020270 comp rx=0 tx=0).stop 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 -- 172.21.15.84:0/200215101 shutdown_connections 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce6b02f2f0 0x55ce6b40f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ce6b0581b0 0x55ce6b483190 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ce6b0374d0 0x55ce6b40f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 --2- 172.21.15.84:0/200215101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ce6b016d80 0x55ce6b4103d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55d0c00640 0 client.25811 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 -- 172.21.15.84:0/200215101 >> 172.21.15.84:0/200215101 conn(0x55ce6b04c300 msgr2=0x55ce6b3fb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 -- 172.21.15.84:0/200215101 shutdown_connections 2024-09-21T02:45:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.356+0000 7f55f5258740 1 -- 172.21.15.84:0/200215101 wait complete. 2024-09-21T02:45:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55f5258740 20 client.25811 trim_cache size 0 max 16384 2024-09-21T02:45:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:45:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:45:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:45:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 -- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f55cc0b6510 msgr2=0x7f55cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f55cc0b6510 0x7f55cc0b8a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f55d80124a0 tx=0x7f55d8005f90 comp rx=0 tx=0).stop 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 -- 172.21.15.84:0/602332052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e8106950 msgr2=0x7f55e819c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e8106950 0x7f55e819c800 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f55d400e9f0 tx=0x7f55d400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 -- 172.21.15.84:0/602332052 shutdown_connections 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f55cc0b6510 0x7f55cc0b8a20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55e8106950 0x7f55e819c800 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e81072f0 0x7f55e819d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 --2- 172.21.15.84:0/602332052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55e81058d0 0x7f55e819c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.357+0000 7f55ee200640 1 -- 172.21.15.84:0/602332052 >> 172.21.15.84:0/602332052 conn(0x7f55e8101230 msgr2=0x7f55e8109c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.358+0000 7f55ee200640 1 -- 172.21.15.84:0/602332052 shutdown_connections 2024-09-21T02:45:32.361 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:32.358+0000 7f55ee200640 1 -- 172.21.15.84:0/602332052 wait complete. 2024-09-21T02:45:33.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:32 smithi172 ceph-mon[35067]: pgmap v493: 129 pgs: 129 active+clean; 153 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 3.5 MiB/s wr, 281 op/s 2024-09-21T02:45:33.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:32 smithi084 ceph-mon[30747]: pgmap v493: 129 pgs: 129 active+clean; 153 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 3.5 MiB/s wr, 281 op/s 2024-09-21T02:45:33.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:32 smithi090 ceph-mon[34571]: pgmap v493: 129 pgs: 129 active+clean; 153 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 3.5 MiB/s wr, 281 op/s 2024-09-21T02:45:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc094c00640 1 -- 172.21.15.84:0/2363664294 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5560713526a0 con 0x556070fcb570 2024-09-21T02:45:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc094c00640 10 client.25816 handle_command_reply: tid=0 2024-09-21T02:45:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 client.25816 shutdown 2024-09-21T02:45:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 -- 172.21.15.84:0/2363664294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 msgr2=0x5560713ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713ef6b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc09c012f10 tx=0x7fc09c0050f0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 -- 172.21.15.84:0/2363664294 shutdown_connections 2024-09-21T02:45:34.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556070fcb570 0x55607146a9e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556071037840 0x556071466980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556071016b60 0x5560713efbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 --2- 172.21.15.84:0/2363664294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55607100e980 0x5560713ef6b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc094c00640 0 client.25816 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.202+0000 7fc0b861e740 1 -- 172.21.15.84:0/2363664294 >> 172.21.15.84:0/2363664294 conn(0x55607102b990 msgr2=0x5560713ebeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.203+0000 7fc0b861e740 1 -- 172.21.15.84:0/2363664294 shutdown_connections 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.203+0000 7fc0b861e740 1 -- 172.21.15.84:0/2363664294 wait complete. 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.203+0000 7fc0b861e740 20 client.25816 trim_cache size 0 max 16384 2024-09-21T02:45:34.205 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 30, 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 14, 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "5fa09fcd": { 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 14, 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T02:45:34.206 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 147.8, 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:34.207 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:45:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 -- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc0900b6580 msgr2=0x7fc0900b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc0900b6580 0x7fc0900b8a90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5560713de190 tx=0x7fc09c005f90 comp rx=0 tx=0).stop 2024-09-21T02:45:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 -- 172.21.15.84:0/3246741711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0ac109300 msgr2=0x7fc0ac19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0ac109300 0x7fc0ac19cbb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc098009230 tx=0x7fc098003b90 comp rx=0 tx=0).stop 2024-09-21T02:45:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 -- 172.21.15.84:0/3246741711 shutdown_connections 2024-09-21T02:45:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc0900b6580 0x7fc0900b8a90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0ac109300 0x7fc0ac19cbb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0ac109c50 0x7fc0ac1a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 --2- 172.21.15.84:0/3246741711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0ac1039c0 0x7fc0ac19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 -- 172.21.15.84:0/3246741711 >> 172.21.15.84:0/3246741711 conn(0x7fc0ac0ff430 msgr2=0x7fc0ac1068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 -- 172.21.15.84:0/3246741711 shutdown_connections 2024-09-21T02:45:34.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:34.204+0000 7fc0abe00640 1 -- 172.21.15.84:0/3246741711 wait complete. 2024-09-21T02:45:35.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:34 smithi172 ceph-mon[35067]: pgmap v494: 129 pgs: 129 active+clean; 156 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 3.3 MiB/s wr, 192 op/s 2024-09-21T02:45:35.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:34 smithi084 ceph-mon[30747]: pgmap v494: 129 pgs: 129 active+clean; 156 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 3.3 MiB/s wr, 192 op/s 2024-09-21T02:45:35.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:34 smithi090 ceph-mon[34571]: pgmap v494: 129 pgs: 129 active+clean; 156 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 3.3 MiB/s wr, 192 op/s 2024-09-21T02:45:35.916 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5fa09fcd', quiesce took 7.7 seconds. Will release after: 20.1 2024-09-21T02:45:37.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:36 smithi172 ceph-mon[35067]: pgmap v495: 129 pgs: 129 active+clean; 155 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 3.1 MiB/s wr, 178 op/s 2024-09-21T02:45:37.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:36 smithi084 ceph-mon[30747]: pgmap v495: 129 pgs: 129 active+clean; 155 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 3.1 MiB/s wr, 178 op/s 2024-09-21T02:45:37.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:36 smithi090 ceph-mon[34571]: pgmap v495: 129 pgs: 129 active+clean; 155 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 3.1 MiB/s wr, 178 op/s 2024-09-21T02:45:39.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:38 smithi172 ceph-mon[35067]: pgmap v496: 129 pgs: 129 active+clean; 157 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 3.0 MiB/s wr, 259 op/s 2024-09-21T02:45:39.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:38 smithi084 ceph-mon[30747]: pgmap v496: 129 pgs: 129 active+clean; 157 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 3.0 MiB/s wr, 259 op/s 2024-09-21T02:45:39.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:38 smithi090 ceph-mon[34571]: pgmap v496: 129 pgs: 129 active+clean; 157 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 3.0 MiB/s wr, 259 op/s 2024-09-21T02:45:41.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:40 smithi172 ceph-mon[35067]: pgmap v497: 129 pgs: 129 active+clean; 157 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 2.4 MiB/s wr, 203 op/s 2024-09-21T02:45:41.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:40 smithi084 ceph-mon[30747]: pgmap v497: 129 pgs: 129 active+clean; 157 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 2.4 MiB/s wr, 203 op/s 2024-09-21T02:45:41.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:40 smithi090 ceph-mon[34571]: pgmap v497: 129 pgs: 129 active+clean; 157 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 2.4 MiB/s wr, 203 op/s 2024-09-21T02:45:43.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:42 smithi172 ceph-mon[35067]: pgmap v498: 129 pgs: 129 active+clean; 157 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-09-21T02:45:43.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:42 smithi084 ceph-mon[30747]: pgmap v498: 129 pgs: 129 active+clean; 157 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-09-21T02:45:43.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:42 smithi090 ceph-mon[34571]: pgmap v498: 129 pgs: 129 active+clean; 157 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-09-21T02:45:45.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:44 smithi172 ceph-mon[35067]: pgmap v499: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 620 KiB/s wr, 167 op/s 2024-09-21T02:45:45.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:44 smithi084 ceph-mon[30747]: pgmap v499: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 620 KiB/s wr, 167 op/s 2024-09-21T02:45:45.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:44 smithi090 ceph-mon[34571]: pgmap v499: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 620 KiB/s wr, 167 op/s 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 -- 172.21.15.84:0/2341663124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c06c4b0 msgr2=0x7f568c106310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 --2- 172.21.15.84:0/2341663124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c06c4b0 0x7f568c106310 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f567c009900 tx=0x7f567c02a3f0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 -- 172.21.15.84:0/2341663124 shutdown_connections 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 --2- 172.21.15.84:0/2341663124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c109410 0x7f568c10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 --2- 172.21.15.84:0/2341663124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f568c106850 0x7f568c108cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 --2- 172.21.15.84:0/2341663124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c06c4b0 0x7f568c106310 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 -- 172.21.15.84:0/2341663124 >> 172.21.15.84:0/2341663124 conn(0x7f568c0fdf30 msgr2=0x7f568c1003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 -- 172.21.15.84:0/2341663124 shutdown_connections 2024-09-21T02:45:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.549+0000 7f5692200640 1 -- 172.21.15.84:0/2341663124 wait complete. 2024-09-21T02:45:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.550+0000 7f5692200640 1 Processor -- start 2024-09-21T02:45:45.553 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.550+0000 7f5692200640 1 -- start start 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f5692200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c06c4b0 0x7f568c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f5692200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c106850 0x7f568c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f5692200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f568c109410 0x7f568c19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f5692200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10f4c0 con 0x7f568c106850 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f5692200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10f340 con 0x7f568c109410 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f5692200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10f640 con 0x7f568c06c4b0 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c106850 0x7f568c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c106850 0x7f568c19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59140/0 (socket says 172.21.15.84:59140) 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568aa00640 1 -- 172.21.15.84:0/1142292281 learned_addr learned my addr 172.21.15.84:0/1142292281 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568b400640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c06c4b0 0x7f568c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568be00640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f568c109410 0x7f568c19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.554 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568aa00640 1 -- 172.21.15.84:0/1142292281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c06c4b0 msgr2=0x7f568c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568aa00640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c06c4b0 0x7f568c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568aa00640 1 -- 172.21.15.84:0/1142292281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f568c109410 msgr2=0x7f568c19b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568aa00640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f568c109410 0x7f568c19b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.551+0000 7f568aa00640 1 -- 172.21.15.84:0/1142292281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c19ba70 con 0x7f568c106850 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.552+0000 7f568aa00640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c106850 0x7f568c19a6a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f567800e9c0 tx=0x7f567800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.552+0000 7f5683e00640 1 -- 172.21.15.84:0/1142292281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567800cd80 con 0x7f568c106850 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.552+0000 7f5683e00640 1 -- 172.21.15.84:0/1142292281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f56780054f0 con 0x7f568c106850 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.552+0000 7f5692200640 1 -- 172.21.15.84:0/1142292281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568c19bd60 con 0x7f568c106850 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.552+0000 7f5683e00640 1 -- 172.21.15.84:0/1142292281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678010690 con 0x7f568c106850 2024-09-21T02:45:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.552+0000 7f5692200640 1 -- 172.21.15.84:0/1142292281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568c1a2450 con 0x7f568c106850 2024-09-21T02:45:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.555+0000 7f5699221740 1 Processor -- start 2024-09-21T02:45:45.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.555+0000 7f5699221740 1 -- start start 2024-09-21T02:45:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f5699221740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a2801b0 0x55dc2a6270d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f5699221740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2572f0 0x55dc2a627740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f5699221740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a25f4d0 0x55dc2a628290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f5699221740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dc2a59a6b0 con 0x55dc2a2801b0 2024-09-21T02:45:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f5699221740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dc2a589ae0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f5699221740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dc2a58d8f0 con 0x55dc2a2572f0 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a2801b0 0x55dc2a6270d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a2801b0 0x55dc2a6270d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59156/0 (socket says 172.21.15.84:59156) 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568be00640 1 -- 172.21.15.84:0/940958883 learned_addr learned my addr 172.21.15.84:0/940958883 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f5683e00640 1 -- 172.21.15.84:0/1142292281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f56780046c0 con 0x7f568c106850 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568b400640 1 --2- 172.21.15.84:0/940958883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2572f0 0x55dc2a627740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568be00640 1 -- 172.21.15.84:0/940958883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2572f0 msgr2=0x55dc2a627740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568be00640 1 --2- 172.21.15.84:0/940958883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2572f0 0x55dc2a627740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568be00640 1 -- 172.21.15.84:0/940958883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a25f4d0 msgr2=0x55dc2a628290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568be00640 1 --2- 172.21.15.84:0/940958883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a25f4d0 0x55dc2a628290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.556+0000 7f568be00640 1 -- 172.21.15.84:0/940958883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2a556780 con 0x55dc2a2801b0 2024-09-21T02:45:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.557+0000 7f568be00640 1 --2- 172.21.15.84:0/940958883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a2801b0 0x55dc2a6270d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5684009fd0 tx=0x7f56840118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2a306f6efdce92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.557+0000 7f5677e00640 1 -- 172.21.15.84:0/940958883 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684004d20 con 0x55dc2a2801b0 2024-09-21T02:45:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.557+0000 7f5677e00640 1 -- 172.21.15.84:0/940958883 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5684004050 con 0x55dc2a2801b0 2024-09-21T02:45:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.557+0000 7f5677e00640 1 -- 172.21.15.84:0/940958883 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684005260 con 0x55dc2a2801b0 2024-09-21T02:45:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.557+0000 7f5683e00640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f56700b6510 0x7f56700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5683e00640 1 -- 172.21.15.84:0/1142292281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f56780e7be0 con 0x7f568c106850 2024-09-21T02:45:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 -- 172.21.15.84:0/940958883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a2801b0 msgr2=0x55dc2a6270d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 --2- 172.21.15.84:0/940958883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a2801b0 0x55dc2a6270d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5684009fd0 tx=0x7f56840118d0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f568b400640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f56700b6510 0x7f56700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 -- 172.21.15.84:0/940958883 shutdown_connections 2024-09-21T02:45:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 --2- 172.21.15.84:0/940958883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2572f0 0x55dc2a627740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 --2- 172.21.15.84:0/940958883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a25f4d0 0x55dc2a628290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 --2- 172.21.15.84:0/940958883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a2801b0 0x55dc2a6270d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 -- 172.21.15.84:0/940958883 >> 172.21.15.84:0/940958883 conn(0x55dc2a274300 msgr2=0x55dc2a622b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 -- 172.21.15.84:0/940958883 shutdown_connections 2024-09-21T02:45:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.558+0000 7f5699221740 1 -- 172.21.15.84:0/940958883 wait complete. 2024-09-21T02:45:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f568b400640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f56700b6510 0x7f56700b8a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f567c004770 tx=0x7f567c031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 1 -- start start 2024-09-21T02:45:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 1 Processor -- start 2024-09-21T02:45:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a634c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a6352d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a635e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dc2a4c1ab0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55dc2a530570 con 0x55dc2a2572f0 2024-09-21T02:45:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dc2a628db0 con 0x55dc2a2801b0 2024-09-21T02:45:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.559+0000 7f5699221740 10 client.0 _ll_register_callbacks cb 0x55dc2a53f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a634c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a6352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a634c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:60624/0 (socket says 172.21.15.84:60624) 2024-09-21T02:45:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568b400640 1 -- 172.21.15.84:0/175198866 learned_addr learned my addr 172.21.15.84:0/175198866 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568be00640 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a635e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568be00640 1 -- 172.21.15.84:0/175198866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 msgr2=0x55dc2a634c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568be00640 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a634c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568be00640 1 -- 172.21.15.84:0/175198866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 msgr2=0x55dc2a6352d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568be00640 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a6352d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.560+0000 7f568be00640 1 -- 172.21.15.84:0/175198866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc2a2eb790 con 0x55dc2a2801b0 2024-09-21T02:45:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f568be00640 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a635e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f568401b040 tx=0x7f5684004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e90fc3786f98eb88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f5674c00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:45:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f5674c00640 1 -- 172.21.15.84:0/175198866 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684028020 con 0x55dc2a2801b0 2024-09-21T02:45:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f5699221740 1 -- 172.21.15.84:0/175198866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5684004050 con 0x55dc2a2801b0 2024-09-21T02:45:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f5674c00640 1 -- 172.21.15.84:0/175198866 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f5684004410 con 0x55dc2a2801b0 2024-09-21T02:45:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f5674c00640 1 -- 172.21.15.84:0/175198866 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5684033050 con 0x55dc2a2801b0 2024-09-21T02:45:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f5699221740 10 client.25843 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f5699221740 1 -- 172.21.15.84:0/175198866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dc2a364620 con 0x55dc2a2801b0 2024-09-21T02:45:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.561+0000 7f5674c00640 1 -- 172.21.15.84:0/175198866 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5684004050 con 0x55dc2a2801b0 2024-09-21T02:45:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.562+0000 7f5674c00640 1 -- 172.21.15.84:0/175198866 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f568400f4e0 con 0x55dc2a2801b0 2024-09-21T02:45:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.562+0000 7f5699221740 10 client.25843 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.562+0000 7f5699221740 10 client.25843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.562+0000 7f5699221740 20 client.25843 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.562+0000 7f5699221740 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55dc2a23ed80 0x55dc2a642150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.562+0000 7f5699221740 4 client.25843 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.562+0000 7f5699221740 1 -- 172.21.15.84:0/175198866 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc2a59c600 con 0x55dc2a23ed80 2024-09-21T02:45:45.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.562+0000 7f568b400640 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55dc2a23ed80 0x55dc2a642150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.563+0000 7f568b400640 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55dc2a23ed80 0x55dc2a642150 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f33dd3a4f62529 server_cookie=f5401dc7b3c9c184 in_seq=0 out_seq=0 2024-09-21T02:45:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.563+0000 7f5674c00640 10 client.25843 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5674c00640 1 -- 172.21.15.84:0/175198866 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc2a59c600 con 0x55dc2a23ed80 2024-09-21T02:45:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5674c00640 10 client.25843 handle_command_reply: tid=0 2024-09-21T02:45:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 client.25843 shutdown 2024-09-21T02:45:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 -- 172.21.15.84:0/175198866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 msgr2=0x55dc2a635e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a635e40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f568401b040 tx=0x7f5684004cf0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 -- 172.21.15.84:0/175198866 shutdown_connections 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a635e40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55dc2a23ed80 0x55dc2a642150 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a6352d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 --2- 172.21.15.84:0/175198866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a634c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5674c00640 0 client.25843 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 -- 172.21.15.84:0/175198866 >> 172.21.15.84:0/175198866 conn(0x55dc2a274300 msgr2=0x55dc2a6210e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 -- 172.21.15.84:0/175198866 shutdown_connections 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 1 -- 172.21.15.84:0/175198866 wait complete. 2024-09-21T02:45:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.564+0000 7f5699221740 20 client.25843 trim_cache size 0 max 16384 2024-09-21T02:45:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.579+0000 7f5699221740 1 Processor -- start 2024-09-21T02:45:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.579+0000 7f5699221740 1 -- start start 2024-09-21T02:45:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f5699221740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a621850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f5699221740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a621d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f5699221740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a62ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f5699221740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1acf50 con 0x55dc2a25f4d0 2024-09-21T02:45:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f5699221740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1aa7c0 con 0x55dc2a2572f0 2024-09-21T02:45:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f5699221740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a8610 con 0x55dc2a2801b0 2024-09-21T02:45:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a621d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a621d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59172/0 (socket says 172.21.15.84:59172) 2024-09-21T02:45:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568aa00640 1 -- 172.21.15.84:0/29334515 learned_addr learned my addr 172.21.15.84:0/29334515 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568be00640 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a62ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568b400640 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a621850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568aa00640 1 -- 172.21.15.84:0/29334515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 msgr2=0x55dc2a62ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568aa00640 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a62ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568aa00640 1 -- 172.21.15.84:0/29334515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 msgr2=0x55dc2a621850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568aa00640 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a621850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.580+0000 7f568aa00640 1 -- 172.21.15.84:0/29334515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2a6424c0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.581+0000 7f568aa00640 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a621d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f56780ad910 tx=0x7f56780ad750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5db684ed7cf5b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.581+0000 7f5677400640 1 -- 172.21.15.84:0/29334515 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56780ad0f0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.581+0000 7f5677400640 1 -- 172.21.15.84:0/29334515 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f56780056a0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.581+0000 7f5677400640 1 -- 172.21.15.84:0/29334515 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56780ac650 con 0x55dc2a25f4d0 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 -- 172.21.15.84:0/29334515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 msgr2=0x55dc2a621d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a621d90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f56780ad910 tx=0x7f56780ad750 comp rx=0 tx=0).stop 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 -- 172.21.15.84:0/29334515 shutdown_connections 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a62ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a621d90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 --2- 172.21.15.84:0/29334515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a621850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 -- 172.21.15.84:0/29334515 >> 172.21.15.84:0/29334515 conn(0x55dc2a274300 msgr2=0x55dc2a61da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 -- 172.21.15.84:0/29334515 shutdown_connections 2024-09-21T02:45:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 -- 172.21.15.84:0/29334515 wait complete. 2024-09-21T02:45:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 -- start start 2024-09-21T02:45:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.582+0000 7f5699221740 1 Processor -- start 2024-09-21T02:45:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f5699221740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a63b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f5699221740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a63b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f5699221740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a63bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f5699221740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a8c80 con 0x55dc2a25f4d0 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f5699221740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1aa0f0 con 0x55dc2a2572f0 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f5699221740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a9350 con 0x55dc2a2801b0 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f5699221740 10 client.0 _ll_register_callbacks cb 0x7f56840093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f568aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a63b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f568aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a63b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59180/0 (socket says 172.21.15.84:59180) 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f568aa00640 1 -- 172.21.15.84:0/2318284896 learned_addr learned my addr 172.21.15.84:0/2318284896 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f568b400640 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a63b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f568be00640 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a63bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f568aa00640 1 -- 172.21.15.84:0/2318284896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 msgr2=0x55dc2a63bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f568aa00640 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a63bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.583+0000 7f568aa00640 1 -- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 msgr2=0x55dc2a63b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f568aa00640 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a63b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f568aa00640 1 -- 172.21.15.84:0/2318284896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc2a63a110 con 0x55dc2a25f4d0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f568b400640 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a63b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f568aa00640 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a63b9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5678004b20 tx=0x7f5678009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5803eac67246d1c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f5674c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f5674c00640 1 -- 172.21.15.84:0/2318284896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56780ad0f0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f5674c00640 1 -- 172.21.15.84:0/2318284896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f56780ac650 con 0x55dc2a25f4d0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f5699221740 1 -- 172.21.15.84:0/2318284896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56780056a0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f5674c00640 1 -- 172.21.15.84:0/2318284896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f56780ad490 con 0x55dc2a25f4d0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f5699221740 10 client.15810 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f5699221740 1 -- 172.21.15.84:0/2318284896 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dc2a6acdb0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.584+0000 7f5674c00640 1 -- 172.21.15.84:0/2318284896 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f56780056a0 con 0x55dc2a25f4d0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.585+0000 7f5674c00640 1 -- 172.21.15.84:0/2318284896 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f56780b3810 con 0x55dc2a25f4d0 2024-09-21T02:45:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.585+0000 7f5699221740 10 client.15810 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.585+0000 7f5699221740 10 client.15810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.585+0000 7f5699221740 20 client.15810 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.585+0000 7f5699221740 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55dc2a2141c0 0x55dc2a6af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.585+0000 7f5699221740 4 client.15810 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.585+0000 7f5699221740 1 -- 172.21.15.84:0/2318284896 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc2a5980b0 con 0x55dc2a2141c0 2024-09-21T02:45:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.585+0000 7f568b400640 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55dc2a2141c0 0x55dc2a6af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.586+0000 7f568b400640 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55dc2a2141c0 0x55dc2a6af680 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce00c0c26edea385 server_cookie=e95d864e50c8ccf in_seq=0 out_seq=0 2024-09-21T02:45:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.586+0000 7f5674c00640 10 client.15810 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5674c00640 1 -- 172.21.15.84:0/2318284896 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc2a5980b0 con 0x55dc2a2141c0 2024-09-21T02:45:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5674c00640 10 client.15810 handle_command_reply: tid=0 2024-09-21T02:45:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 client.15810 shutdown 2024-09-21T02:45:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 -- 172.21.15.84:0/2318284896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 msgr2=0x55dc2a63b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a63b9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5678004b20 tx=0x7f5678009700 comp rx=0 tx=0).stop 2024-09-21T02:45:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 -- 172.21.15.84:0/2318284896 shutdown_connections 2024-09-21T02:45:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc2a2801b0 0x55dc2a63bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55dc2a2141c0 0x55dc2a6af680 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dc2a25f4d0 0x55dc2a63b9a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 --2- 172.21.15.84:0/2318284896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55dc2a2572f0 0x55dc2a63b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5674c00640 0 client.15810 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 -- 172.21.15.84:0/2318284896 >> 172.21.15.84:0/2318284896 conn(0x55dc2a274300 msgr2=0x55dc2a61d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 -- 172.21.15.84:0/2318284896 shutdown_connections 2024-09-21T02:45:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 1 -- 172.21.15.84:0/2318284896 wait complete. 2024-09-21T02:45:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.599+0000 7f5699221740 20 client.15810 trim_cache size 0 max 16384 2024-09-21T02:45:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:45:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:45:45.603 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:45:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:45:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 -- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f56700b6510 msgr2=0x7f56700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f56700b6510 0x7f56700b8a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f567c004770 tx=0x7f567c031510 comp rx=0 tx=0).stop 2024-09-21T02:45:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 -- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c106850 msgr2=0x7f568c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c106850 0x7f568c19a6a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f567800e9c0 tx=0x7f567800ee80 comp rx=0 tx=0).stop 2024-09-21T02:45:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 -- 172.21.15.84:0/1142292281 shutdown_connections 2024-09-21T02:45:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f568c109410 0x7f568c19b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f568c106850 0x7f568c19a6a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f56700b6510 0x7f56700b8a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 --2- 172.21.15.84:0/1142292281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f568c06c4b0 0x7f568c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 -- 172.21.15.84:0/1142292281 >> 172.21.15.84:0/1142292281 conn(0x7f568c0fdf30 msgr2=0x7f568c104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 -- 172.21.15.84:0/1142292281 shutdown_connections 2024-09-21T02:45:45.606 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:45.600+0000 7f5692200640 1 -- 172.21.15.84:0/1142292281 wait complete. 2024-09-21T02:45:47.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:46 smithi172 ceph-mon[35067]: pgmap v500: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 336 KiB/s wr, 152 op/s 2024-09-21T02:45:47.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:46 smithi084 ceph-mon[30747]: pgmap v500: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 336 KiB/s wr, 152 op/s 2024-09-21T02:45:47.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:46 smithi090 ceph-mon[34571]: pgmap v500: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 336 KiB/s wr, 152 op/s 2024-09-21T02:45:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:48 smithi172 ceph-mon[35067]: pgmap v501: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 331 KiB/s wr, 136 op/s 2024-09-21T02:45:49.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:48 smithi084 ceph-mon[30747]: pgmap v501: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 331 KiB/s wr, 136 op/s 2024-09-21T02:45:49.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:48 smithi090 ceph-mon[34571]: pgmap v501: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 331 KiB/s wr, 136 op/s 2024-09-21T02:45:51.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:50 smithi172 ceph-mon[35067]: pgmap v502: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-21T02:45:51.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:50 smithi084 ceph-mon[30747]: pgmap v502: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-21T02:45:51.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:50 smithi090 ceph-mon[34571]: pgmap v502: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-21T02:45:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:52 smithi172 ceph-mon[35067]: pgmap v503: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-21T02:45:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:52 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:45:53.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:52 smithi084 ceph-mon[30747]: pgmap v503: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-21T02:45:53.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:52 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:45:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:52 smithi090 ceph-mon[34571]: pgmap v503: 129 pgs: 129 active+clean; 157 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-21T02:45:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:52 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:45:54.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:53 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:45:54.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:53 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:45:54.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:53 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:45:54.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:53 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:45:54.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:53 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:45:54.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:53 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:45:54.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:53 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:45:54.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:53 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:45:54.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:53 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:45:55.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:55 smithi172 ceph-mon[35067]: pgmap v504: 129 pgs: 129 active+clean; 157 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-21T02:45:55.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:55 smithi084 ceph-mon[30747]: pgmap v504: 129 pgs: 129 active+clean; 157 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-21T02:45:55.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:55 smithi090 ceph-mon[34571]: pgmap v504: 129 pgs: 129 active+clean; 157 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-21T02:45:56.017 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:45:56.395 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 -- 172.21.15.84:0/3238639463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 msgr2=0x7f8c7810b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3238639463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 0x7f8c7810b900 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009900 tx=0x7f8c6402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 -- 172.21.15.84:0/3238639463 shutdown_connections 2024-09-21T02:45:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3238639463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7810be40 0x7f8c78112670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3238639463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 0x7f8c7810b900 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3238639463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c78105bb0 0x7f8c78105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 -- 172.21.15.84:0/3238639463 >> 172.21.15.84:0/3238639463 conn(0x7f8c78101680 msgr2=0x7f8c78103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:57.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 -- 172.21.15.84:0/3238639463 shutdown_connections 2024-09-21T02:45:57.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.055+0000 7f8c77e00640 1 -- 172.21.15.84:0/3238639463 wait complete. 2024-09-21T02:45:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.056+0000 7f8c77e00640 1 Processor -- start 2024-09-21T02:45:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.056+0000 7f8c77e00640 1 -- start start 2024-09-21T02:45:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c77e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c78105bb0 0x7f8c7819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c77e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 0x7f8c7819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c77e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7810be40 0x7f8c781a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c77e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78115c70 con 0x7f8c7810b4f0 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c77e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78115af0 con 0x7f8c78105bb0 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c77e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78115df0 con 0x7f8c7810be40 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c76000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 0x7f8c7819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c76000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 0x7f8c7819cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48970/0 (socket says 172.21.15.84:48970) 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c76000640 1 -- 172.21.15.84:0/3440281372 learned_addr learned my addr 172.21.15.84:0/3440281372 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c76a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c78105bb0 0x7f8c7819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c77400640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7810be40 0x7f8c781a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c76000640 1 -- 172.21.15.84:0/3440281372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7810be40 msgr2=0x7f8c781a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c76000640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7810be40 0x7f8c781a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c76000640 1 -- 172.21.15.84:0/3440281372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c78105bb0 msgr2=0x7f8c7819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:57.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.057+0000 7f8c76000640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c78105bb0 0x7f8c7819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.058+0000 7f8c76000640 1 -- 172.21.15.84:0/3440281372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c781a25d0 con 0x7f8c7810b4f0 2024-09-21T02:45:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.058+0000 7f8c76a00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c78105bb0 0x7f8c7819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.058+0000 7f8c76000640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 0x7f8c7819cc00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c6402a9e0 tx=0x7f8c64003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.058+0000 7f8c6f400640 1 -- 172.21.15.84:0/3440281372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6403f070 con 0x7f8c7810b4f0 2024-09-21T02:45:57.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.058+0000 7f8c6f400640 1 -- 172.21.15.84:0/3440281372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c64031be0 con 0x7f8c7810b4f0 2024-09-21T02:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.058+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c781a2860 con 0x7f8c7810b4f0 2024-09-21T02:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.058+0000 7f8c6f400640 1 -- 172.21.15.84:0/3440281372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64035030 con 0x7f8c7810b4f0 2024-09-21T02:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.058+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c781a9020 con 0x7f8c7810b4f0 2024-09-21T02:45:57.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.060+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c78106e30 con 0x7f8c7810b4f0 2024-09-21T02:45:57.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.062+0000 7f8c6f400640 1 -- 172.21.15.84:0/3440281372 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f8c64042070 con 0x7f8c7810b4f0 2024-09-21T02:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.063+0000 7f8c6f400640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8c5c0b6510 0x7f8c5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.063+0000 7f8c6f400640 1 -- 172.21.15.84:0/3440281372 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f8c64107c70 con 0x7f8c7810b4f0 2024-09-21T02:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.063+0000 7f8c76a00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8c5c0b6510 0x7f8c5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:57.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.064+0000 7f8c76a00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8c5c0b6510 0x7f8c5c0b8a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c680095f0 tx=0x7f8c68005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:57.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.068+0000 7f8c6f400640 1 -- 172.21.15.84:0/3440281372 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c640d24f0 con 0x7f8c7810b4f0 2024-09-21T02:45:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.297+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c7810dc30 con 0x7f8c7810b4f0 2024-09-21T02:45:57.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.298+0000 7f8c6f400640 1 -- 172.21.15.84:0/3440281372 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11913 (secure 0 0 0) 0x7f8c640d7430 con 0x7f8c7810b4f0 2024-09-21T02:45:57.300 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:45:57.300 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":30,"btime":"2024-09-21T02:44:49:769551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:44:49.033686+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:45:57.300 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 30 2024-09-21T02:45:57.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8c5c0b6510 msgr2=0x7f8c5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:57.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8c5c0b6510 0x7f8c5c0b8a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8c680095f0 tx=0x7f8c68005f90 comp rx=0 tx=0).stop 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 msgr2=0x7f8c7819cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 0x7f8c7819cc00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c6402a9e0 tx=0x7f8c64003b90 comp rx=0 tx=0).stop 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 shutdown_connections 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f8c5c0b6510 0x7f8c5c0b8a20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7810be40 0x7f8c781a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c7810b4f0 0x7f8c7819cc00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 --2- 172.21.15.84:0/3440281372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8c78105bb0 0x7f8c7819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 >> 172.21.15.84:0/3440281372 conn(0x7f8c78101680 msgr2=0x7f8c7810abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 shutdown_connections 2024-09-21T02:45:57.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:57.301+0000 7f8c77e00640 1 -- 172.21.15.84:0/3440281372 wait complete. 2024-09-21T02:45:57.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:57 smithi172 ceph-mon[35067]: pgmap v505: 129 pgs: 129 active+clean; 158 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T02:45:57.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:57 smithi084 ceph-mon[30747]: pgmap v505: 129 pgs: 129 active+clean; 158 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T02:45:57.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:57 smithi090 ceph-mon[34571]: pgmap v505: 129 pgs: 129 active+clean; 158 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T02:45:58.264 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --set-id 5fa09fcd --release --await' 2024-09-21T02:45:58.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --set-id 5fa09fcd --release --await 2024-09-21T02:45:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:58 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3440281372' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:58.637 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:45:58.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:58 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3440281372' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:58.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:58 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3440281372' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:45:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 -- 172.21.15.84:0/25254683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104560 msgr2=0x7fa84c104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 --2- 172.21.15.84:0/25254683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104560 0x7fa84c104970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009900 tx=0x7fa83c02a410 comp rx=0 tx=0).stop 2024-09-21T02:45:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 -- 172.21.15.84:0/25254683 shutdown_connections 2024-09-21T02:45:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 --2- 172.21.15.84:0/25254683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa84c104f00 0x7fa84c10b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 --2- 172.21.15.84:0/25254683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104560 0x7fa84c104970 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 --2- 172.21.15.84:0/25254683 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa84c1034e0 0x7fa84c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 -- 172.21.15.84:0/25254683 >> 172.21.15.84:0/25254683 conn(0x7fa84c0fee20 msgr2=0x7fa84c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 -- 172.21.15.84:0/25254683 shutdown_connections 2024-09-21T02:45:58.791 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.789+0000 7fa853200640 1 -- 172.21.15.84:0/25254683 wait complete. 2024-09-21T02:45:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa853200640 1 Processor -- start 2024-09-21T02:45:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa853200640 1 -- start start 2024-09-21T02:45:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa853200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa84c1034e0 0x7fa84c199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa853200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa84c104560 0x7fa84c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa853200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104f00 0x7fa84c19b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa853200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c10f280 con 0x7fa84c104f00 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa853200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c10f100 con 0x7fa84c104560 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa853200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c10f400 con 0x7fa84c1034e0 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa852800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104f00 0x7fa84c19b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.790+0000 7fa852800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104f00 0x7fa84c19b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48992/0 (socket says 172.21.15.84:48992) 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa852800640 1 -- 172.21.15.84:0/2425675356 learned_addr learned my addr 172.21.15.84:0/2425675356 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa851e00640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa84c1034e0 0x7fa84c199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa851400640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa84c104560 0x7fa84c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa852800640 1 -- 172.21.15.84:0/2425675356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa84c1034e0 msgr2=0x7fa84c199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa852800640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa84c1034e0 0x7fa84c199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa852800640 1 -- 172.21.15.84:0/2425675356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa84c104560 msgr2=0x7fa84c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa852800640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa84c104560 0x7fa84c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa852800640 1 -- 172.21.15.84:0/2425675356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84c19b860 con 0x7fa84c104f00 2024-09-21T02:45:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa852800640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104f00 0x7fa84c19b040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa84800eb10 tx=0x7fa84800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.791+0000 7fa846a00640 1 -- 172.21.15.84:0/2425675356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848004b20 con 0x7fa84c104f00 2024-09-21T02:45:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.792+0000 7fa846a00640 1 -- 172.21.15.84:0/2425675356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa848004cc0 con 0x7fa84c104f00 2024-09-21T02:45:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.792+0000 7fa853200640 1 -- 172.21.15.84:0/2425675356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84c19bb50 con 0x7fa84c104f00 2024-09-21T02:45:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.792+0000 7fa846a00640 1 -- 172.21.15.84:0/2425675356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848010720 con 0x7fa84c104f00 2024-09-21T02:45:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.792+0000 7fa853200640 1 -- 172.21.15.84:0/2425675356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84c1a2240 con 0x7fa84c104f00 2024-09-21T02:45:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.795+0000 7fa85b856740 1 Processor -- start 2024-09-21T02:45:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.796+0000 7fa846a00640 1 -- 172.21.15.84:0/2425675356 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fa848005020 con 0x7fa84c104f00 2024-09-21T02:45:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.796+0000 7fa85b856740 1 -- start start 2024-09-21T02:45:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa85b856740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495921b0 0x5597499392b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa85b856740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495692f0 0x559749939920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa85b856740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974993a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa85b856740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5597498ac6b0 con 0x5597495692f0 2024-09-21T02:45:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa85b856740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55974989bae0 con 0x5597495714d0 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa85b856740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55974989f8f0 con 0x5597495921b0 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495692f0 0x559749939920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495692f0 0x559749939920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48996/0 (socket says 172.21.15.84:48996) 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851e00640 1 -- 172.21.15.84:0/3049601863 learned_addr learned my addr 172.21.15.84:0/3049601863 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851400640 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495921b0 0x5597499392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851400640 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974993a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851e00640 1 -- 172.21.15.84:0/3049601863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495921b0 msgr2=0x5597499392b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851e00640 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495921b0 0x5597499392b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851e00640 1 -- 172.21.15.84:0/3049601863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 msgr2=0x55974993a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851e00640 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974993a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851e00640 1 -- 172.21.15.84:0/3049601863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559749868780 con 0x5597495692f0 2024-09-21T02:45:58.800 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.797+0000 7fa851400640 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974993a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T02:45:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.798+0000 7fa851e00640 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495692f0 0x559749939920 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa840009cf0 tx=0x7fa840011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9f09195da3190b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.798+0000 7fa83b000640 1 -- 172.21.15.84:0/3049601863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84001e070 con 0x5597495692f0 2024-09-21T02:45:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.798+0000 7fa83b000640 1 -- 172.21.15.84:0/3049601863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa840019b00 con 0x5597495692f0 2024-09-21T02:45:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.798+0000 7fa83b000640 1 -- 172.21.15.84:0/3049601863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84000ea50 con 0x5597495692f0 2024-09-21T02:45:58.801 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.798+0000 7fa846a00640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa8340b6510 0x7fa8340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.798+0000 7fa846a00640 1 -- 172.21.15.84:0/2425675356 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa8480e7c60 con 0x7fa84c104f00 2024-09-21T02:45:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.798+0000 7fa851400640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa8340b6510 0x7fa8340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 -- 172.21.15.84:0/3049601863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495692f0 msgr2=0x559749939920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495692f0 0x559749939920 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa840009cf0 tx=0x7fa840011810 comp rx=0 tx=0).stop 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 -- 172.21.15.84:0/3049601863 shutdown_connections 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974993a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495692f0 0x559749939920 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 --2- 172.21.15.84:0/3049601863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495921b0 0x5597499392b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 -- 172.21.15.84:0/3049601863 >> 172.21.15.84:0/3049601863 conn(0x559749586300 msgr2=0x559749934d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 -- 172.21.15.84:0/3049601863 shutdown_connections 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa851400640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa8340b6510 0x7fa8340b8a20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000c00 tx=0x7fa83c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.799+0000 7fa85b856740 1 -- 172.21.15.84:0/3049601863 wait complete. 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 1 -- start start 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 1 Processor -- start 2024-09-21T02:45:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x5597499429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x559749943060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749943b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5597497d3ab0 con 0x5597495714d0 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x559749842570 con 0x5597495921b0 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55974993af90 con 0x5597495692f0 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa85b856740 10 client.0 _ll_register_callbacks cb 0x559749851100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa851e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x5597499429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa851400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x559749943060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.800+0000 7fa851e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x5597499429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:42812/0 (socket says 172.21.15.84:42812) 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa851e00640 1 -- 172.21.15.84:0/1926453772 learned_addr learned my addr 172.21.15.84:0/1926453772 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa852800640 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749943b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa851e00640 1 -- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 msgr2=0x559749943b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa851e00640 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749943b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa851e00640 1 -- 172.21.15.84:0/1926453772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 msgr2=0x559749943060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa851e00640 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x559749943060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa851e00640 1 -- 172.21.15.84:0/1926453772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597495fd790 con 0x5597495692f0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa852800640 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749943b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa851400640 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x559749943060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa851e00640 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x5597499429a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa840019660 tx=0x7fa840019690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdb3608c4044eff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.801+0000 7fa82f400640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.802+0000 7fa82f400640 1 -- 172.21.15.84:0/1926453772 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84001e050 con 0x5597495692f0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.802+0000 7fa82f400640 1 -- 172.21.15.84:0/1926453772 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa840005240 con 0x5597495692f0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.802+0000 7fa85b856740 1 -- 172.21.15.84:0/1926453772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa840019b00 con 0x5597495692f0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.802+0000 7fa82f400640 1 -- 172.21.15.84:0/1926453772 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa840033050 con 0x5597495692f0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.802+0000 7fa85b856740 10 client.25867 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.802+0000 7fa85b856740 1 -- 172.21.15.84:0/1926453772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559749676620 con 0x5597495692f0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.802+0000 7fa82f400640 1 -- 172.21.15.84:0/1926453772 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa840019b00 con 0x5597495692f0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.803+0000 7fa82f400640 1 -- 172.21.15.84:0/1926453772 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fa840004750 con 0x5597495692f0 2024-09-21T02:45:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.803+0000 7fa85b856740 10 client.25867 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.803+0000 7fa85b856740 10 client.25867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.803+0000 7fa85b856740 20 client.25867 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.803+0000 7fa85b856740 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559749550d80 0x55974994fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.803+0000 7fa85b856740 4 client.25867 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.803+0000 7fa85b856740 1 -- 172.21.15.84:0/1926453772 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597498ae600 con 0x559749550d80 2024-09-21T02:45:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.803+0000 7fa851400640 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559749550d80 0x55974994fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.804+0000 7fa851400640 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559749550d80 0x55974994fe00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b957df098e4243 server_cookie=d5fc703c886ad2f9 in_seq=0 out_seq=0 2024-09-21T02:45:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.804+0000 7fa82f400640 10 client.25867 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.804+0000 7fa82f400640 1 -- 172.21.15.84:0/1926453772 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597498ae600 con 0x559749550d80 2024-09-21T02:45:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.804+0000 7fa82f400640 10 client.25867 handle_command_reply: tid=0 2024-09-21T02:45:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 client.25867 shutdown 2024-09-21T02:45:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 -- 172.21.15.84:0/1926453772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 msgr2=0x5597499429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x5597499429a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa840019660 tx=0x7fa840019690 comp rx=0 tx=0).stop 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 -- 172.21.15.84:0/1926453772 shutdown_connections 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x559749550d80 0x55974994fe00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749943b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x559749943060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 --2- 172.21.15.84:0/1926453772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x5597499429a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 -- 172.21.15.84:0/1926453772 >> 172.21.15.84:0/1926453772 conn(0x559749586300 msgr2=0x559749935940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa82f400640 0 client.25867 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 -- 172.21.15.84:0/1926453772 shutdown_connections 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 1 -- 172.21.15.84:0/1926453772 wait complete. 2024-09-21T02:45:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.805+0000 7fa85b856740 20 client.25867 trim_cache size 0 max 16384 2024-09-21T02:45:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.820+0000 7fa85b856740 1 Processor -- start 2024-09-21T02:45:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.820+0000 7fa85b856740 1 -- start start 2024-09-21T02:45:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.820+0000 7fa85b856740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x559749941ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.820+0000 7fa85b856740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974994aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.820+0000 7fa85b856740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495921b0 0x559749935e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.820+0000 7fa85b856740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1aefa0 con 0x5597495921b0 2024-09-21T02:45:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.820+0000 7fa85b856740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1ac810 con 0x5597495714d0 2024-09-21T02:45:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.820+0000 7fa85b856740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1aa660 con 0x5597495692f0 2024-09-21T02:45:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa852800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495921b0 0x559749935e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa852800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495921b0 0x559749935e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49004/0 (socket says 172.21.15.84:49004) 2024-09-21T02:45:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa852800640 1 -- 172.21.15.84:0/3906446948 learned_addr learned my addr 172.21.15.84:0/3906446948 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa851400640 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974994aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa851e00640 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x559749941ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa851400640 1 -- 172.21.15.84:0/3906446948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 msgr2=0x559749941ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa851400640 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x559749941ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa851400640 1 -- 172.21.15.84:0/3906446948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495921b0 msgr2=0x559749935e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa851400640 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495921b0 0x559749935e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa851400640 1 -- 172.21.15.84:0/3906446948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559749941980 con 0x5597495714d0 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa852800640 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495921b0 0x559749935e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.821+0000 7fa851400640 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974994aa40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa83c005ab0 tx=0x7fa83c03f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d58525c3dad3a22a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.822+0000 7fa83a600640 1 -- 172.21.15.84:0/3906446948 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c004040 con 0x5597495714d0 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.822+0000 7fa83a600640 1 -- 172.21.15.84:0/3906446948 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa83c0041e0 con 0x5597495714d0 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.822+0000 7fa83a600640 1 -- 172.21.15.84:0/3906446948 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0547a0 con 0x5597495714d0 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 -- 172.21.15.84:0/3906446948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 msgr2=0x55974994aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974994aa40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa83c005ab0 tx=0x7fa83c03f040 comp rx=0 tx=0).stop 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 -- 172.21.15.84:0/3906446948 shutdown_connections 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495921b0 0x559749935e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.825 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495714d0 0x55974994aa40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 --2- 172.21.15.84:0/3906446948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x559749941ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 -- 172.21.15.84:0/3906446948 >> 172.21.15.84:0/3906446948 conn(0x559749586300 msgr2=0x559749935760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 -- 172.21.15.84:0/3906446948 shutdown_connections 2024-09-21T02:45:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.823+0000 7fa85b856740 1 -- 172.21.15.84:0/3906446948 wait complete. 2024-09-21T02:45:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.824+0000 7fa85b856740 1 -- start start 2024-09-21T02:45:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.824+0000 7fa85b856740 1 Processor -- start 2024-09-21T02:45:58.828 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa85b856740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x55974994a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa85b856740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x5597499493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa85b856740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749949930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa85b856740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1aacd0 con 0x5597495714d0 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa85b856740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1ac140 con 0x5597495921b0 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa85b856740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa84c1ab3a0 con 0x5597495692f0 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa85b856740 10 client.0 _ll_register_callbacks cb 0x7fa84001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa851e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x55974994a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa851e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x55974994a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:42822/0 (socket says 172.21.15.84:42822) 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa851e00640 1 -- 172.21.15.84:0/3777258219 learned_addr learned my addr 172.21.15.84:0/3777258219 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:58.829 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa852800640 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749949930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.825+0000 7fa851400640 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x5597499493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa851e00640 1 -- 172.21.15.84:0/3777258219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 msgr2=0x559749949930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa851e00640 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749949930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa851e00640 1 -- 172.21.15.84:0/3777258219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 msgr2=0x5597499493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa851e00640 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x5597499493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa851e00640 1 -- 172.21.15.84:0/3777258219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55974994a0c0 con 0x5597495692f0 2024-09-21T02:45:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa851e00640 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x55974994a710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa840009cf0 tx=0x7fa840011eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=300b385121106efe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa82f400640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa82f400640 1 -- 172.21.15.84:0/3777258219 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84003b070 con 0x5597495692f0 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa85b856740 1 -- 172.21.15.84:0/3777258219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83c0041e0 con 0x5597495692f0 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa82f400640 1 -- 172.21.15.84:0/3777258219 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fa840005040 con 0x5597495692f0 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa82f400640 1 -- 172.21.15.84:0/3777258219 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa840044050 con 0x5597495692f0 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa85b856740 10 client.25873 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.826+0000 7fa85b856740 1 -- 172.21.15.84:0/3777258219 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5597499ba800 con 0x5597495692f0 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa82f400640 1 -- 172.21.15.84:0/3777258219 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa83c0041e0 con 0x5597495692f0 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa82f400640 1 -- 172.21.15.84:0/3777258219 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fa84003e020 con 0x5597495692f0 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa85b856740 10 client.25873 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa85b856740 10 client.25873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:45:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa85b856740 20 client.25873 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa85b856740 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5597495261c0 0x5597499bd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa85b856740 4 client.25873 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:45:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa85b856740 1 -- 172.21.15.84:0/3777258219 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597498aa0b0 con 0x5597495261c0 2024-09-21T02:45:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.827+0000 7fa851400640 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5597495261c0 0x5597499bd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.828+0000 7fa82f400640 10 client.25873 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.828+0000 7fa851400640 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5597495261c0 0x5597499bd1d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7455462743c9bbf server_cookie=eeea0d8ed49bdf8a in_seq=0 out_seq=0 2024-09-21T02:45:58.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.841+0000 7fa82f400640 1 -- 172.21.15.84:0/3777258219 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597498aa0b0 con 0x5597495261c0 2024-09-21T02:45:58.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.841+0000 7fa82f400640 10 client.25873 handle_command_reply: tid=0 2024-09-21T02:45:58.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.841+0000 7fa85b856740 1 client.25873 shutdown 2024-09-21T02:45:58.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.841+0000 7fa85b856740 1 -- 172.21.15.84:0/3777258219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 msgr2=0x55974994a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.841+0000 7fa85b856740 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x55974994a710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa840009cf0 tx=0x7fa840011eb0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.844 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.841+0000 7fa85b856740 1 -- 172.21.15.84:0/3777258219 shutdown_connections 2024-09-21T02:45:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.841+0000 7fa85b856740 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5597495261c0 0x5597499bd1d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa85b856740 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5597495921b0 0x559749949930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa85b856740 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597495714d0 0x5597499493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa85b856740 1 --2- 172.21.15.84:0/3777258219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5597495692f0 0x55974994a710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa82f400640 0 client.25873 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa85b856740 1 -- 172.21.15.84:0/3777258219 >> 172.21.15.84:0/3777258219 conn(0x559749586300 msgr2=0x559749935e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa85b856740 1 -- 172.21.15.84:0/3777258219 shutdown_connections 2024-09-21T02:45:58.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa85b856740 1 -- 172.21.15.84:0/3777258219 wait complete. 2024-09-21T02:45:58.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa85b856740 20 client.25873 trim_cache size 0 max 16384 2024-09-21T02:45:58.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:45:58.846 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:45:58.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:45:58.847 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:45:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa853200640 1 -- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa8340b6510 msgr2=0x7fa8340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa853200640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa8340b6510 0x7fa8340b8a20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa83c000c00 tx=0x7fa83c009260 comp rx=0 tx=0).stop 2024-09-21T02:45:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa853200640 1 -- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104f00 msgr2=0x7fa84c19b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.842+0000 7fa853200640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104f00 0x7fa84c19b040 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa84800eb10 tx=0x7fa84800c2d0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.843+0000 7fa853200640 1 -- 172.21.15.84:0/2425675356 shutdown_connections 2024-09-21T02:45:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.843+0000 7fa853200640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c104f00 0x7fa84c19b040 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.843+0000 7fa853200640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa84c104560 0x7fa84c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.843+0000 7fa853200640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fa8340b6510 0x7fa8340b8a20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.843+0000 7fa853200640 1 --2- 172.21.15.84:0/2425675356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa84c1034e0 0x7fa84c199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.843+0000 7fa853200640 1 -- 172.21.15.84:0/2425675356 >> 172.21.15.84:0/2425675356 conn(0x7fa84c0fee20 msgr2=0x7fa84c107880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.843+0000 7fa853200640 1 -- 172.21.15.84:0/2425675356 shutdown_connections 2024-09-21T02:45:58.850 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:45:58.843+0000 7fa853200640 1 -- 172.21.15.84:0/2425675356 wait complete. 2024-09-21T02:45:59.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 -- 172.21.15.84:0/4239535290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4075dd0 msgr2=0x7fc9b40761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 --2- 172.21.15.84:0/4239535290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4075dd0 0x7fc9b40761e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009900 tx=0x7fc9a002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 -- 172.21.15.84:0/4239535290 shutdown_connections 2024-09-21T02:45:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 --2- 172.21.15.84:0/4239535290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9b4114280 0x7fc9b4116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 --2- 172.21.15.84:0/4239535290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4075dd0 0x7fc9b40761e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 --2- 172.21.15.84:0/4239535290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9b4077380 0x7fc9b40757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 -- 172.21.15.84:0/4239535290 >> 172.21.15.84:0/4239535290 conn(0x7fc9b40ff440 msgr2=0x7fc9b4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 -- 172.21.15.84:0/4239535290 shutdown_connections 2024-09-21T02:45:59.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.368+0000 7fc9ba000640 1 -- 172.21.15.84:0/4239535290 wait complete. 2024-09-21T02:45:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.370+0000 7fc9ba000640 1 Processor -- start 2024-09-21T02:45:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.370+0000 7fc9ba000640 1 -- start start 2024-09-21T02:45:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.370+0000 7fc9ba000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9b4075dd0 0x7fc9b41a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.370+0000 7fc9ba000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9b4077380 0x7fc9b41a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.370+0000 7fc9ba000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4114280 0x7fc9b41a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.370+0000 7fc9ba000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4119fe0 con 0x7fc9b4114280 2024-09-21T02:45:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.370+0000 7fc9ba000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b4119e60 con 0x7fc9b4075dd0 2024-09-21T02:45:59.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.370+0000 7fc9ba000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b411a160 con 0x7fc9b4077380 2024-09-21T02:45:59.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4114280 0x7fc9b41a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9b4075dd0 0x7fc9b41a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b8c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9b4075dd0 0x7fc9b41a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:57994/0 (socket says 172.21.15.84:57994) 2024-09-21T02:45:59.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b8c00640 1 -- 172.21.15.84:0/275585207 learned_addr learned my addr 172.21.15.84:0/275585207 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:59.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9b4077380 0x7fc9b41a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b9600640 1 -- 172.21.15.84:0/275585207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9b4077380 msgr2=0x7fc9b41a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b9600640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9b4077380 0x7fc9b41a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b9600640 1 -- 172.21.15.84:0/275585207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9b4075dd0 msgr2=0x7fc9b41a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b9600640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9b4075dd0 0x7fc9b41a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.371+0000 7fc9b9600640 1 -- 172.21.15.84:0/275585207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b41a6980 con 0x7fc9b4114280 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.372+0000 7fc9b9600640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4114280 0x7fc9b41a6250 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009fd0 tx=0x7fc9ac00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.372+0000 7fc9b1600640 1 -- 172.21.15.84:0/275585207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00ce20 con 0x7fc9b4114280 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.372+0000 7fc9ba000640 1 -- 172.21.15.84:0/275585207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b41a6c70 con 0x7fc9b4114280 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.372+0000 7fc9ba000640 1 -- 172.21.15.84:0/275585207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b41ad3d0 con 0x7fc9b4114280 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.372+0000 7fc9b1600640 1 -- 172.21.15.84:0/275585207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9ac005020 con 0x7fc9b4114280 2024-09-21T02:45:59.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.372+0000 7fc9b1600640 1 -- 172.21.15.84:0/275585207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac010720 con 0x7fc9b4114280 2024-09-21T02:45:59.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.376+0000 7fc9c2279740 1 Processor -- start 2024-09-21T02:45:59.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.376+0000 7fc9b1600640 1 -- 172.21.15.84:0/275585207 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fc9ac004a40 con 0x7fc9b4114280 2024-09-21T02:45:59.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9c2279740 1 -- start start 2024-09-21T02:45:59.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633f96340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f96880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 0x556633f96dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9c2279740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556633f0d290 con 0x556633bce840 2024-09-21T02:45:59.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9c2279740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556633efc6c0 con 0x556633bef520 2024-09-21T02:45:59.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9c2279740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556633f004d0 con 0x556633bc6660 2024-09-21T02:45:59.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9b8c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f96880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9b3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633f96340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9b8c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f96880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:42832/0 (socket says 172.21.15.84:42832) 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9b8c00640 1 -- 172.21.15.84:0/27493708 learned_addr learned my addr 172.21.15.84:0/27493708 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.377+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 0x556633f96dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9b8c00640 1 -- 172.21.15.84:0/27493708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 msgr2=0x556633f96340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633f96340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9b8c00640 1 -- 172.21.15.84:0/27493708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 msgr2=0x556633f96dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 0x556633f96dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9b8c00640 1 -- 172.21.15.84:0/27493708 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556633e89460 con 0x556633bc6660 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633f96340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:59.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f96880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009dc0 tx=0x7fc9a8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5dc429007be597b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:59.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9b1600640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc99c0b6590 0x7fc99c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.378+0000 7fc9a5c00640 1 -- 172.21.15.84:0/27493708 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8005220 con 0x556633bc6660 2024-09-21T02:45:59.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.379+0000 7fc9a5c00640 1 -- 172.21.15.84:0/27493708 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9a8004c70 con 0x556633bc6660 2024-09-21T02:45:59.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.379+0000 7fc9a5c00640 1 -- 172.21.15.84:0/27493708 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8019890 con 0x556633bc6660 2024-09-21T02:45:59.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.379+0000 7fc9b1600640 1 -- 172.21.15.84:0/275585207 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc9ac0e7a60 con 0x7fc9b4114280 2024-09-21T02:45:59.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.379+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc99c0b6590 0x7fc99c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 -- 172.21.15.84:0/27493708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 msgr2=0x556633f96880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc99c0b6590 0x7fc99c0b8aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00314b0 tx=0x7fc9a0041040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f96880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009dc0 tx=0x7fc9a8011810 comp rx=0 tx=0).stop 2024-09-21T02:45:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 -- 172.21.15.84:0/27493708 shutdown_connections 2024-09-21T02:45:59.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f96880 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 0x556633f96dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 --2- 172.21.15.84:0/27493708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633f96340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 -- 172.21.15.84:0/27493708 >> 172.21.15.84:0/27493708 conn(0x556633be3910 msgr2=0x556633f94230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 -- 172.21.15.84:0/27493708 shutdown_connections 2024-09-21T02:45:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.380+0000 7fc9c2279740 1 -- 172.21.15.84:0/27493708 wait complete. 2024-09-21T02:45:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.381+0000 7fc9c2279740 1 -- start start 2024-09-21T02:45:59.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.381+0000 7fc9c2279740 1 Processor -- start 2024-09-21T02:45:59.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633fa1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 0x556633fa2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fadea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9c2279740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556633d5dbb0 con 0x556633bce840 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9c2279740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556633e976c0 con 0x556633bef520 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9c2279740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556633fa4b20 con 0x556633bc6660 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9c2279740 10 client.0 _ll_register_callbacks cb 0x556633eb2490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b9600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fadea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b9600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fadea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58014/0 (socket says 172.21.15.84:58014) 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 0x556633fa2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b9600640 1 -- 172.21.15.84:0/1102092161 learned_addr learned my addr 172.21.15.84:0/1102092161 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633fa1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b9600640 1 -- 172.21.15.84:0/1102092161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 msgr2=0x556633fa1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b9600640 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633fa1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b9600640 1 -- 172.21.15.84:0/1102092161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 msgr2=0x556633fa2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b9600640 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 0x556633fa2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b9600640 1 -- 172.21.15.84:0/1102092161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556633c5ab00 con 0x556633bef520 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.382+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633fa1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:45:59.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.383+0000 7fc9b9600640 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fadea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0a9dd0 tx=0x7fc9ac0ad450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d331b845fdae7f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:59.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.383+0000 7fc99a000640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:45:59.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.383+0000 7fc99a000640 1 -- 172.21.15.84:0/1102092161 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0b2020 con 0x556633bef520 2024-09-21T02:45:59.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.383+0000 7fc99a000640 1 -- 172.21.15.84:0/1102092161 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc9ac0aca60 con 0x556633bef520 2024-09-21T02:45:59.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.383+0000 7fc9c2279740 1 -- 172.21.15.84:0/1102092161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9a8004c70 con 0x556633bef520 2024-09-21T02:45:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.383+0000 7fc99a000640 1 -- 172.21.15.84:0/1102092161 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc9ac0acca0 con 0x556633bef520 2024-09-21T02:45:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc9c2279740 10 client.25859 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc9c2279740 1 -- 172.21.15.84:0/1102092161 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556633cd1960 con 0x556633bef520 2024-09-21T02:45:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc99a000640 1 -- 172.21.15.84:0/1102092161 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9ac0c8e50 con 0x556633bef520 2024-09-21T02:45:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc99a000640 1 -- 172.21.15.84:0/1102092161 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fc9ac0b3470 con 0x556633bef520 2024-09-21T02:45:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc9c2279740 10 client.25859 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc9c2279740 10 client.25859 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc9c2279740 20 client.25859 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc9c2279740 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556633badea0 0x556633fb3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc9c2279740 4 client.25859 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.384+0000 7fc9c2279740 1 -- 172.21.15.84:0/1102092161 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556633f0f1e0 con 0x556633badea0 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.385+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556633badea0 0x556633fb3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.385+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556633badea0 0x556633fb3f40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e8b9fecc733e916 server_cookie=df332849326ab72f in_seq=0 out_seq=0 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.385+0000 7fc99a000640 10 client.25859 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc99a000640 1 -- 172.21.15.84:0/1102092161 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556633f0f1e0 con 0x556633badea0 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc99a000640 10 client.25859 handle_command_reply: tid=0 2024-09-21T02:45:59.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 client.25859 shutdown 2024-09-21T02:45:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 -- 172.21.15.84:0/1102092161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 msgr2=0x556633fadea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fadea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0a9dd0 tx=0x7fc9ac0ad450 comp rx=0 tx=0).stop 2024-09-21T02:45:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 -- 172.21.15.84:0/1102092161 shutdown_connections 2024-09-21T02:45:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556633badea0 0x556633fb3f40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fadea0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bce840 0x556633fa2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 --2- 172.21.15.84:0/1102092161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633fa1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc9c2279740 1 -- 172.21.15.84:0/1102092161 >> 172.21.15.84:0/1102092161 conn(0x556633be3910 msgr2=0x556633f994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:59.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.386+0000 7fc99a000640 0 client.25859 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:59.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.387+0000 7fc9c2279740 1 -- 172.21.15.84:0/1102092161 shutdown_connections 2024-09-21T02:45:59.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.387+0000 7fc9c2279740 1 -- 172.21.15.84:0/1102092161 wait complete. 2024-09-21T02:45:59.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.387+0000 7fc9c2279740 20 client.25859 trim_cache size 0 max 16384 2024-09-21T02:45:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.419+0000 7fc9c2279740 1 Processor -- start 2024-09-21T02:45:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.419+0000 7fc9c2279740 1 -- start start 2024-09-21T02:45:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.419+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f97a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.419+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bce840 0x556633f9eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.419+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bef520 0x556633f9f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.419+0000 7fc9c2279740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc9940124f0 con 0x556633bef520 2024-09-21T02:45:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.419+0000 7fc9c2279740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc99400fd60 con 0x556633bce840 2024-09-21T02:45:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.419+0000 7fc9c2279740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc99400dbb0 con 0x556633bc6660 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bef520 0x556633f9f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b8c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f97a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b9600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bef520 0x556633f9f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49054/0 (socket says 172.21.15.84:49054) 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b9600640 1 -- 172.21.15.84:0/4010197019 learned_addr learned my addr 172.21.15.84:0/4010197019 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bce840 0x556633f9eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b9600640 1 -- 172.21.15.84:0/4010197019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 msgr2=0x556633f97a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b9600640 1 --2- 172.21.15.84:0/4010197019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f97a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b9600640 1 -- 172.21.15.84:0/4010197019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bce840 msgr2=0x556633f9eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:59.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b9600640 1 --2- 172.21.15.84:0/4010197019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bce840 0x556633f9eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b9600640 1 -- 172.21.15.84:0/4010197019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556633fa4420 con 0x556633bef520 2024-09-21T02:45:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.420+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/4010197019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bce840 0x556633f9eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.421+0000 7fc9b9600640 1 --2- 172.21.15.84:0/4010197019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bef520 0x556633f9f410 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ad790 tx=0x7fc9ac0a9090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c80831b0071246 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.421+0000 7fc9a5200640 1 -- 172.21.15.84:0/4010197019 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0b2050 con 0x556633bef520 2024-09-21T02:45:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.421+0000 7fc9a5200640 1 -- 172.21.15.84:0/4010197019 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9ac0c8e50 con 0x556633bef520 2024-09-21T02:45:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.421+0000 7fc9a5200640 1 -- 172.21.15.84:0/4010197019 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0ac4d0 con 0x556633bef520 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 -- 172.21.15.84:0/4010197019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bef520 msgr2=0x556633f9f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 --2- 172.21.15.84:0/4010197019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bef520 0x556633f9f410 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ad790 tx=0x7fc9ac0a9090 comp rx=0 tx=0).stop 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 -- 172.21.15.84:0/4010197019 shutdown_connections 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 --2- 172.21.15.84:0/4010197019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bef520 0x556633f9f410 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 --2- 172.21.15.84:0/4010197019 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bce840 0x556633f9eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 --2- 172.21.15.84:0/4010197019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bc6660 0x556633f97a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 -- 172.21.15.84:0/4010197019 >> 172.21.15.84:0/4010197019 conn(0x556633be3910 msgr2=0x556633f97370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 -- 172.21.15.84:0/4010197019 shutdown_connections 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 -- 172.21.15.84:0/4010197019 wait complete. 2024-09-21T02:45:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.422+0000 7fc9c2279740 1 -- start start 2024-09-21T02:45:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9c2279740 1 Processor -- start 2024-09-21T02:45:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bc6660 0x556633fa6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bce840 0x556633fa7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9c2279740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fa77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9c2279740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc99400e220 con 0x556633bc6660 2024-09-21T02:45:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9c2279740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc99400f690 con 0x556633bef520 2024-09-21T02:45:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9c2279740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc99400e8f0 con 0x556633bce840 2024-09-21T02:45:59.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9c2279740 10 client.0 _ll_register_callbacks cb 0x7fc9ac0a9ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.423+0000 7fc9b8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bc6660 0x556633fa6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bc6660 0x556633fa6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49068/0 (socket says 172.21.15.84:49068) 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b8c00640 1 -- 172.21.15.84:0/3258530767 learned_addr learned my addr 172.21.15.84:0/3258530767 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bce840 0x556633fa7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b9600640 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fa77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b8c00640 1 -- 172.21.15.84:0/3258530767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bce840 msgr2=0x556633fa7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bce840 0x556633fa7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b8c00640 1 -- 172.21.15.84:0/3258530767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 msgr2=0x556633fa77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fa77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b8c00640 1 -- 172.21.15.84:0/3258530767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55663401e910 con 0x556633bc6660 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bce840 0x556633fa7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc9b8c00640 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bc6660 0x556633fa6d30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc9a801b040 tx=0x7fc9a8004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afe2bf89dfae762 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.424+0000 7fc99a000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:45:59.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.425+0000 7fc99a000640 1 -- 172.21.15.84:0/3258530767 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80099d0 con 0x556633bc6660 2024-09-21T02:45:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.425+0000 7fc99a000640 1 -- 172.21.15.84:0/3258530767 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fc9a8004a70 con 0x556633bc6660 2024-09-21T02:45:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.425+0000 7fc9c2279740 1 -- 172.21.15.84:0/3258530767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9ac0c8e50 con 0x556633bc6660 2024-09-21T02:45:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.425+0000 7fc99a000640 1 -- 172.21.15.84:0/3258530767 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc9a803a050 con 0x556633bc6660 2024-09-21T02:45:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.425+0000 7fc9c2279740 10 client.15852 fetch_fsmap learned FSMap version 30 2024-09-21T02:45:59.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.425+0000 7fc9c2279740 1 -- 172.21.15.84:0/3258530767 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55663401fb10 con 0x556633bc6660 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.425+0000 7fc99a000640 1 -- 172.21.15.84:0/3258530767 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9ac0c8e50 con 0x556633bc6660 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.426+0000 7fc99a000640 1 -- 172.21.15.84:0/3258530767 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fc9a8019a00 con 0x556633bc6660 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.426+0000 7fc9c2279740 10 client.15852 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.426+0000 7fc9c2279740 10 client.15852 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.426+0000 7fc9c2279740 20 client.15852 populate_metadata read hostname 'smithi084' 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.426+0000 7fc9c2279740 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556633b83250 0x5566340220e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.426+0000 7fc9c2279740 4 client.15852 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5fa09fcd", "release": true, "await": true}] 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.426+0000 7fc9c2279740 1 -- 172.21.15.84:0/3258530767 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5fa09fcd", "release": true, "await": true}) -- 0x556633f0ac90 con 0x556633b83250 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.426+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556633b83250 0x5566340220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.427+0000 7fc9b3e00640 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556633b83250 0x5566340220e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a17964f8cbc50c27 server_cookie=fa360f49fd771c2e in_seq=0 out_seq=0 2024-09-21T02:45:59.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.427+0000 7fc99a000640 10 client.15852 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:59.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.624+0000 7fc99a000640 1 -- 172.21.15.84:0/3258530767 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556633f0ac90 con 0x556633b83250 2024-09-21T02:45:59.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.624+0000 7fc99a000640 10 client.15852 handle_command_reply: tid=0 2024-09-21T02:45:59.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.624+0000 7fc9c2279740 1 client.15852 shutdown 2024-09-21T02:45:59.627 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:45:59 smithi084 ceph-mon[30747]: pgmap v506: 129 pgs: 129 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 320 KiB/s wr, 73 op/s 2024-09-21T02:45:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc9c2279740 1 -- 172.21.15.84:0/3258530767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bc6660 msgr2=0x556633fa6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc9c2279740 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bc6660 0x556633fa6d30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc9a801b040 tx=0x7fc9a8004650 comp rx=0 tx=0).stop 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc9c2279740 1 -- 172.21.15.84:0/3258530767 shutdown_connections 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc9c2279740 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556633bce840 0x556633fa7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc9c2279740 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556633b83250 0x5566340220e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc9c2279740 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556633bef520 0x556633fa77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc9c2279740 1 --2- 172.21.15.84:0/3258530767 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556633bc6660 0x556633fa6d30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc99a000640 0 client.15852 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.625+0000 7fc9c2279740 1 -- 172.21.15.84:0/3258530767 >> 172.21.15.84:0/3258530767 conn(0x556633be3910 msgr2=0x556633fa3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.626+0000 7fc9c2279740 1 -- 172.21.15.84:0/3258530767 shutdown_connections 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.626+0000 7fc9c2279740 1 -- 172.21.15.84:0/3258530767 wait complete. 2024-09-21T02:45:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.626+0000 7fc9c2279740 20 client.15852 trim_cache size 0 max 16384 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 30, 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 16, 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "5fa09fcd": { 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 16, 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:45:59.630 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 90.0, 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 147.8, 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:45:59.631 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:45:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.627+0000 7fc9ba000640 1 -- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc99c0b6590 msgr2=0x7fc99c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.627+0000 7fc9ba000640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc99c0b6590 0x7fc99c0b8aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00314b0 tx=0x7fc9a0041040 comp rx=0 tx=0).stop 2024-09-21T02:45:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.627+0000 7fc9ba000640 1 -- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4114280 msgr2=0x7fc9b41a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:45:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.627+0000 7fc9ba000640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4114280 0x7fc9b41a6250 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009fd0 tx=0x7fc9ac00ef10 comp rx=0 tx=0).stop 2024-09-21T02:45:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.628+0000 7fc9ba000640 1 -- 172.21.15.84:0/275585207 shutdown_connections 2024-09-21T02:45:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.628+0000 7fc9ba000640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fc99c0b6590 0x7fc99c0b8aa0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.628+0000 7fc9ba000640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9b4077380 0x7fc9b41a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.628+0000 7fc9ba000640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b4114280 0x7fc9b41a6250 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.628+0000 7fc9ba000640 1 --2- 172.21.15.84:0/275585207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9b4075dd0 0x7fc9b41a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:45:59.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.628+0000 7fc9ba000640 1 -- 172.21.15.84:0/275585207 >> 172.21.15.84:0/275585207 conn(0x7fc9b40ff440 msgr2=0x7fc9b4110180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:45:59.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.628+0000 7fc9ba000640 1 -- 172.21.15.84:0/275585207 shutdown_connections 2024-09-21T02:45:59.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:45:59.628+0000 7fc9ba000640 1 -- 172.21.15.84:0/275585207 wait complete. 2024-09-21T02:45:59.668 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:45:59 smithi090 ceph-mon[34571]: pgmap v506: 129 pgs: 129 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 320 KiB/s wr, 73 op/s 2024-09-21T02:45:59.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:45:59 smithi172 ceph-mon[35067]: pgmap v506: 129 pgs: 129 active+clean; 161 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 320 KiB/s wr, 73 op/s 2024-09-21T02:46:00.530 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5fa09fcd', total seconds elapsed: 32.3 2024-09-21T02:46:01.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:01 smithi172 ceph-mon[35067]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 313 KiB/s wr, 67 op/s 2024-09-21T02:46:01.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:01 smithi084 ceph-mon[30747]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 313 KiB/s wr, 67 op/s 2024-09-21T02:46:01.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:01 smithi090 ceph-mon[34571]: pgmap v507: 129 pgs: 129 active+clean; 161 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 313 KiB/s wr, 67 op/s 2024-09-21T02:46:03.572 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:03 smithi084 ceph-mon[30747]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 419 KiB/s wr, 84 op/s 2024-09-21T02:46:03.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:03 smithi172 ceph-mon[35067]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 419 KiB/s wr, 84 op/s 2024-09-21T02:46:03.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:03 smithi090 ceph-mon[34571]: pgmap v508: 129 pgs: 129 active+clean; 161 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 419 KiB/s wr, 84 op/s 2024-09-21T02:46:05.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:05 smithi084 ceph-mon[30747]: pgmap v509: 129 pgs: 129 active+clean; 161 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 418 KiB/s wr, 86 op/s 2024-09-21T02:46:05.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:05 smithi172 ceph-mon[35067]: pgmap v509: 129 pgs: 129 active+clean; 161 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 418 KiB/s wr, 86 op/s 2024-09-21T02:46:05.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:05 smithi090 ceph-mon[34571]: pgmap v509: 129 pgs: 129 active+clean; 161 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 418 KiB/s wr, 86 op/s 2024-09-21T02:46:07.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:07 smithi172 ceph-mon[35067]: pgmap v510: 129 pgs: 129 active+clean; 159 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 427 KiB/s wr, 102 op/s 2024-09-21T02:46:07.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:07 smithi084 ceph-mon[30747]: pgmap v510: 129 pgs: 129 active+clean; 159 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 427 KiB/s wr, 102 op/s 2024-09-21T02:46:07.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:07 smithi090 ceph-mon[34571]: pgmap v510: 129 pgs: 129 active+clean; 159 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 427 KiB/s wr, 102 op/s 2024-09-21T02:46:09.610 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:09 smithi084 ceph-mon[30747]: pgmap v511: 129 pgs: 129 active+clean; 159 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 705 KiB/s wr, 145 op/s 2024-09-21T02:46:09.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:09 smithi172 ceph-mon[35067]: pgmap v511: 129 pgs: 129 active+clean; 159 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 705 KiB/s wr, 145 op/s 2024-09-21T02:46:09.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:09 smithi090 ceph-mon[34571]: pgmap v511: 129 pgs: 129 active+clean; 159 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 705 KiB/s wr, 145 op/s 2024-09-21T02:46:11.662 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-09-21T02:46:11.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:11 smithi084 ceph-mon[30747]: pgmap v512: 129 pgs: 129 active+clean; 159 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 470 KiB/s wr, 105 op/s 2024-09-21T02:46:11.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:11 smithi172 ceph-mon[35067]: pgmap v512: 129 pgs: 129 active+clean; 159 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 470 KiB/s wr, 105 op/s 2024-09-21T02:46:11.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:11 smithi090 ceph-mon[34571]: pgmap v512: 129 pgs: 129 active+clean; 159 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 470 KiB/s wr, 105 op/s 2024-09-21T02:46:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1151085245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd80107110 msgr2=0x7fdd8010dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1151085245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd80107110 0x7fdd8010dab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009ca0 tx=0x7fdd7802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1151085245 shutdown_connections 2024-09-21T02:46:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1151085245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd80107110 0x7fdd8010dab0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1151085245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd80106770 0x7fdd80106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1151085245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd801056f0 0x7fdd80105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1151085245 >> 172.21.15.84:0/1151085245 conn(0x7fdd80101050 msgr2=0x7fdd801034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1151085245 shutdown_connections 2024-09-21T02:46:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.126+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1151085245 wait complete. 2024-09-21T02:46:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.127+0000 7fdd7fe00640 1 Processor -- start 2024-09-21T02:46:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.127+0000 7fdd7fe00640 1 -- start start 2024-09-21T02:46:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7fe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd801056f0 0x7fdd8019bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd80106770 0x7fdd8019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd80107110 0x7fdd8019d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801114e0 con 0x7fdd80107110 2024-09-21T02:46:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7fe00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80111360 con 0x7fdd80106770 2024-09-21T02:46:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7fe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd80111660 con 0x7fdd801056f0 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7ea00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd801056f0 0x7fdd8019bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7ea00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd801056f0 0x7fdd8019bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:35162/0 (socket says 172.21.15.84:35162) 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd76000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd80106770 0x7fdd8019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd80107110 0x7fdd8019d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7ea00640 1 -- 172.21.15.84:0/1383295484 learned_addr learned my addr 172.21.15.84:0/1383295484 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7ea00640 1 -- 172.21.15.84:0/1383295484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd80106770 msgr2=0x7fdd8019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7ea00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd80106770 0x7fdd8019c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7ea00640 1 -- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd80107110 msgr2=0x7fdd8019d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7ea00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd80107110 0x7fdd8019d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.128+0000 7fdd7ea00640 1 -- 172.21.15.84:0/1383295484 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8019da00 con 0x7fdd801056f0 2024-09-21T02:46:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.129+0000 7fdd76000640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd80106770 0x7fdd8019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.129+0000 7fdd7ea00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd801056f0 0x7fdd8019bfc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000e9f0 tx=0x7fdd7000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.129+0000 7fdd77e00640 1 -- 172.21.15.84:0/1383295484 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7000cd80 con 0x7fdd801056f0 2024-09-21T02:46:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.129+0000 7fdd77e00640 1 -- 172.21.15.84:0/1383295484 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd70010900 con 0x7fdd801056f0 2024-09-21T02:46:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.129+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1383295484 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8019dcf0 con 0x7fdd801056f0 2024-09-21T02:46:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.129+0000 7fdd77e00640 1 -- 172.21.15.84:0/1383295484 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd70018920 con 0x7fdd801056f0 2024-09-21T02:46:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.129+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1383295484 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd801a43e0 con 0x7fdd801056f0 2024-09-21T02:46:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.132+0000 7fdd8ca07740 1 Processor -- start 2024-09-21T02:46:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.132+0000 7fdd8ca07740 1 -- start start 2024-09-21T02:46:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.132+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.132+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307a42f0 0x563130b74920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b75470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563130ae76b0 con 0x5631307ac4d0 2024-09-21T02:46:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563130ad6ae0 con 0x5631307cd1b0 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563130ada8f0 con 0x5631307a42f0 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd77e00640 1 -- 172.21.15.84:0/1383295484 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fdd70010ab0 con 0x7fdd801056f0 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7ea00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307a42f0 0x563130b74920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd76000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b75470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:41376/0 (socket says 172.21.15.84:41376) 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7f400640 1 -- 172.21.15.84:0/994541299 learned_addr learned my addr 172.21.15.84:0/994541299 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7f400640 1 -- 172.21.15.84:0/994541299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307a42f0 msgr2=0x563130b74920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7f400640 1 --2- 172.21.15.84:0/994541299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307a42f0 0x563130b74920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7f400640 1 -- 172.21.15.84:0/994541299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 msgr2=0x563130b75470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:12.137 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7f400640 1 --2- 172.21.15.84:0/994541299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b75470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.133+0000 7fdd7f400640 1 -- 172.21.15.84:0/994541299 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563130aa3780 con 0x5631307cd1b0 2024-09-21T02:46:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.134+0000 7fdd7f400640 1 --2- 172.21.15.84:0/994541299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b742b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd78035000 tx=0x7fdd7802f3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837043ba711e1421 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.134+0000 7fdd6fe00640 1 -- 172.21.15.84:0/994541299 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78031650 con 0x5631307cd1b0 2024-09-21T02:46:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.134+0000 7fdd6fe00640 1 -- 172.21.15.84:0/994541299 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd78036030 con 0x5631307cd1b0 2024-09-21T02:46:12.138 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.134+0000 7fdd6fe00640 1 -- 172.21.15.84:0/994541299 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78004710 con 0x5631307cd1b0 2024-09-21T02:46:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.134+0000 7fdd77e00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd640b6510 0x7fdd640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd77e00640 1 -- 172.21.15.84:0/1383295484 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fdd700e7a60 con 0x7fdd801056f0 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd7ea00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd640b6510 0x7fdd640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 -- 172.21.15.84:0/994541299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 msgr2=0x563130b742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/994541299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b742b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd78035000 tx=0x7fdd7802f3a0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 -- 172.21.15.84:0/994541299 shutdown_connections 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/994541299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307a42f0 0x563130b74920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/994541299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b75470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/994541299 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b742b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 -- 172.21.15.84:0/994541299 >> 172.21.15.84:0/994541299 conn(0x5631307c1300 msgr2=0x563130b6fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 -- 172.21.15.84:0/994541299 shutdown_connections 2024-09-21T02:46:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd8ca07740 1 -- 172.21.15.84:0/994541299 wait complete. 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.135+0000 7fdd7ea00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd640b6510 0x7fdd640b8a20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdd700e7d00 tx=0x7fdd700ed530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.136+0000 7fdd8ca07740 1 -- start start 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.136+0000 7fdd8ca07740 1 Processor -- start 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b7ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307cd1b0 0x563130b7e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563130a0eab0 con 0x5631307cd1b0 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563130a7d570 con 0x5631307a42f0 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563130b75db0 con 0x5631307ac4d0 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd8ca07740 10 client.0 _ll_register_callbacks cb 0x563130a8c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd7f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd7f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:41388/0 (socket says 172.21.15.84:41388) 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd7f400640 1 -- 172.21.15.84:0/2434237025 learned_addr learned my addr 172.21.15.84:0/2434237025 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd76000640 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b7ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd7f400640 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307cd1b0 0x563130b7e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd76000640 1 -- 172.21.15.84:0/2434237025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 msgr2=0x563130b7d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd76000640 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd76000640 1 -- 172.21.15.84:0/2434237025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307cd1b0 msgr2=0x563130b7e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.137+0000 7fdd76000640 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307cd1b0 0x563130b7e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd76000640 1 -- 172.21.15.84:0/2434237025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563130838790 con 0x5631307ac4d0 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd76000640 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b7ddf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd68012d00 tx=0x7fdd6800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f44f176e17dddc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd6cc00640 1 -- 172.21.15.84:0/2434237025 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68009d90 con 0x5631307ac4d0 2024-09-21T02:46:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd6cc00640 1 -- 172.21.15.84:0/2434237025 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fdd68012110 con 0x5631307ac4d0 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2434237025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd78036030 con 0x5631307ac4d0 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd6cc00640 1 -- 172.21.15.84:0/2434237025 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdd68004050 con 0x5631307ac4d0 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd8ca07740 10 client.25903 fetch_fsmap learned FSMap version 30 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.138+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2434237025 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5631308b1620 con 0x5631307ac4d0 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd6cc00640 1 -- 172.21.15.84:0/2434237025 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd78036030 con 0x5631307ac4d0 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd6cc00640 1 -- 172.21.15.84:0/2434237025 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fdd68010430 con 0x5631307ac4d0 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd8ca07740 10 client.25903 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd8ca07740 10 client.25903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd8ca07740 20 client.25903 populate_metadata read hostname 'smithi084' 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56313078bd80 0x563130b8af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd8ca07740 4 client.25903 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2434237025 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563130ae9600 con 0x56313078bd80 2024-09-21T02:46:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.139+0000 7fdd7f400640 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56313078bd80 0x563130b8af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.140+0000 7fdd7f400640 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56313078bd80 0x563130b8af80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863869542a36c380 server_cookie=e9007b04191a5c4b in_seq=0 out_seq=0 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.140+0000 7fdd6cc00640 10 client.25903 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd6cc00640 1 -- 172.21.15.84:0/2434237025 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563130ae9600 con 0x56313078bd80 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd6cc00640 10 client.25903 handle_command_reply: tid=0 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 client.25903 shutdown 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2434237025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 msgr2=0x563130b7ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b7ddf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd68012d00 tx=0x7fdd6800f790 comp rx=0 tx=0).stop 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2434237025 shutdown_connections 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b7ddf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x56313078bd80 0x563130b8af80 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307cd1b0 0x563130b7e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2434237025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd6cc00640 0 client.25903 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2434237025 >> 172.21.15.84:0/2434237025 conn(0x5631307c1300 msgr2=0x563130b6e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2434237025 shutdown_connections 2024-09-21T02:46:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2434237025 wait complete. 2024-09-21T02:46:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.141+0000 7fdd8ca07740 20 client.25903 trim_cache size 0 max 16384 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.156+0000 7fdd8ca07740 1 Processor -- start 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.156+0000 7fdd8ca07740 1 -- start start 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.156+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.156+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b73ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307cd1b0 0x563130b743e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801b1040 con 0x5631307ac4d0 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801ae8b0 con 0x5631307a42f0 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801ac700 con 0x5631307cd1b0 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd76000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b73ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd7f400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd76000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b73ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49416/0 (socket says 172.21.15.84:49416) 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd76000640 1 -- 172.21.15.84:0/2759445402 learned_addr learned my addr 172.21.15.84:0/2759445402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd7f400640 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307cd1b0 0x563130b743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd76000640 1 -- 172.21.15.84:0/2759445402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307cd1b0 msgr2=0x563130b743e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd76000640 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307cd1b0 0x563130b743e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd76000640 1 -- 172.21.15.84:0/2759445402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 msgr2=0x563130b7de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd76000640 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd76000640 1 -- 172.21.15.84:0/2759445402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563130b76180 con 0x5631307ac4d0 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.157+0000 7fdd7f400640 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.158+0000 7fdd76000640 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b73ea0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd68001eb0 tx=0x7fdd6800fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf60fa67f2317f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.158+0000 7fdd6f400640 1 -- 172.21.15.84:0/2759445402 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6802d070 con 0x5631307ac4d0 2024-09-21T02:46:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.158+0000 7fdd6f400640 1 -- 172.21.15.84:0/2759445402 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd68009e90 con 0x5631307ac4d0 2024-09-21T02:46:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.158+0000 7fdd6f400640 1 -- 172.21.15.84:0/2759445402 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd680035f0 con 0x5631307ac4d0 2024-09-21T02:46:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2759445402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 msgr2=0x563130b73ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b73ea0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd68001eb0 tx=0x7fdd6800fc90 comp rx=0 tx=0).stop 2024-09-21T02:46:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2759445402 shutdown_connections 2024-09-21T02:46:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307cd1b0 0x563130b743e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307ac4d0 0x563130b73ea0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/2759445402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307a42f0 0x563130b7de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2759445402 >> 172.21.15.84:0/2759445402 conn(0x5631307c1300 msgr2=0x563130b7d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2759445402 shutdown_connections 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 -- 172.21.15.84:0/2759445402 wait complete. 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 -- start start 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.159+0000 7fdd8ca07740 1 Processor -- start 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307a42f0 0x563130b85730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b84410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd8ca07740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b84b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801acd70 con 0x5631307a42f0 2024-09-21T02:46:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801ae1e0 con 0x5631307cd1b0 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd8ca07740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd801ad440 con 0x5631307ac4d0 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd8ca07740 10 client.0 _ll_register_callbacks cb 0x7fdd68009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd76000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b84410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd7f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307a42f0 0x563130b85730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd76000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b84410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:35202/0 (socket says 172.21.15.84:35202) 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd76000640 1 -- 172.21.15.84:0/3846136814 learned_addr learned my addr 172.21.15.84:0/3846136814 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd7f400640 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b84b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd76000640 1 -- 172.21.15.84:0/3846136814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 msgr2=0x563130b84b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd76000640 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b84b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd76000640 1 -- 172.21.15.84:0/3846136814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307a42f0 msgr2=0x563130b85730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd76000640 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307a42f0 0x563130b85730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.160+0000 7fdd76000640 1 -- 172.21.15.84:0/3846136814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563130b82fb0 con 0x5631307ac4d0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.161+0000 7fdd76000640 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b84410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdd68005c20 tx=0x7fdd68010e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999c3377558200b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.161+0000 7fdd6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.161+0000 7fdd6cc00640 1 -- 172.21.15.84:0/3846136814 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6802d040 con 0x5631307ac4d0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.161+0000 7fdd6cc00640 1 -- 172.21.15.84:0/3846136814 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fdd68005480 con 0x5631307ac4d0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.161+0000 7fdd8ca07740 1 -- 172.21.15.84:0/3846136814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd68009e90 con 0x5631307ac4d0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.161+0000 7fdd6cc00640 1 -- 172.21.15.84:0/3846136814 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdd68005680 con 0x5631307ac4d0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.161+0000 7fdd8ca07740 10 client.25909 fetch_fsmap learned FSMap version 30 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.161+0000 7fdd8ca07740 1 -- 172.21.15.84:0/3846136814 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563130bf5ac0 con 0x5631307ac4d0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd6cc00640 1 -- 172.21.15.84:0/3846136814 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd68009e90 con 0x5631307ac4d0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd6cc00640 1 -- 172.21.15.84:0/3846136814 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fdd68038070 con 0x5631307ac4d0 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd8ca07740 10 client.25909 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd8ca07740 10 client.25909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd8ca07740 20 client.25909 populate_metadata read hostname 'smithi084' 2024-09-21T02:46:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5631307611c0 0x563130bf84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd8ca07740 4 client.25909 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:46:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd8ca07740 1 -- 172.21.15.84:0/3846136814 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563130ae50b0 con 0x5631307611c0 2024-09-21T02:46:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.162+0000 7fdd7f400640 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5631307611c0 0x563130bf84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.163+0000 7fdd6cc00640 10 client.25909 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.163+0000 7fdd7f400640 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5631307611c0 0x563130bf84b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d40e3e3e15fb21ed server_cookie=7ebe2a8ff2c49a1 in_seq=0 out_seq=0 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd6cc00640 1 -- 172.21.15.84:0/3846136814 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563130ae50b0 con 0x5631307611c0 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd6cc00640 10 client.25909 handle_command_reply: tid=0 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 client.25909 shutdown 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 -- 172.21.15.84:0/3846136814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 msgr2=0x563130b84410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b84410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdd68005c20 tx=0x7fdd68010e20 comp rx=0 tx=0).stop 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 -- 172.21.15.84:0/3846136814 shutdown_connections 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5631307ac4d0 0x563130b84410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x5631307611c0 0x563130bf84b0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5631307cd1b0 0x563130b84b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 --2- 172.21.15.84:0/3846136814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5631307a42f0 0x563130b85730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd6cc00640 0 client.25909 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 -- 172.21.15.84:0/3846136814 >> 172.21.15.84:0/3846136814 conn(0x5631307c1300 msgr2=0x563130b73ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 -- 172.21.15.84:0/3846136814 shutdown_connections 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.344+0000 7fdd8ca07740 1 -- 172.21.15.84:0/3846136814 wait complete. 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd8ca07740 20 client.25909 trim_cache size 0 max 16384 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:46:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:46:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd640b6510 msgr2=0x7fdd640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd640b6510 0x7fdd640b8a20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdd700e7d00 tx=0x7fdd700ed530 comp rx=0 tx=0).stop 2024-09-21T02:46:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1383295484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd801056f0 msgr2=0x7fdd8019bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd801056f0 0x7fdd8019bfc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000e9f0 tx=0x7fdd7000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1383295484 shutdown_connections 2024-09-21T02:46:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd80107110 0x7fdd8019d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd80106770 0x7fdd8019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fdd640b6510 0x7fdd640b8a20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 --2- 172.21.15.84:0/1383295484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd801056f0 0x7fdd8019bfc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1383295484 >> 172.21.15.84:0/1383295484 conn(0x7fdd80101050 msgr2=0x7fdd80109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1383295484 shutdown_connections 2024-09-21T02:46:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:12.345+0000 7fdd7fe00640 1 -- 172.21.15.84:0/1383295484 wait complete. 2024-09-21T02:46:12.880 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar c linux-4.0.5 2024-09-21T02:46:13.298 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm -rf linux-4.0.5 2024-09-21T02:46:13.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:13 smithi172 ceph-mon[35067]: pgmap v513: 129 pgs: 129 active+clean; 167 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.6 MiB/s wr, 279 op/s 2024-09-21T02:46:13.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:13 smithi084 ceph-mon[30747]: pgmap v513: 129 pgs: 129 active+clean; 167 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.6 MiB/s wr, 279 op/s 2024-09-21T02:46:13.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:13 smithi090 ceph-mon[34571]: pgmap v513: 129 pgs: 129 active+clean; 167 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.6 MiB/s wr, 279 op/s 2024-09-21T02:46:15.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:15 smithi172 ceph-mon[35067]: pgmap v514: 129 pgs: 129 active+clean; 168 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.8 MiB/s wr, 320 op/s 2024-09-21T02:46:15.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:15 smithi084 ceph-mon[30747]: pgmap v514: 129 pgs: 129 active+clean; 168 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.8 MiB/s wr, 320 op/s 2024-09-21T02:46:15.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:15 smithi090 ceph-mon[34571]: pgmap v514: 129 pgs: 129 active+clean; 168 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.8 MiB/s wr, 320 op/s 2024-09-21T02:46:16.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:16 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:46:16.762 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:16 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:46:16.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:16 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:46:17.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:17 smithi172 ceph-mon[35067]: pgmap v515: 129 pgs: 129 active+clean; 172 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 359 op/s 2024-09-21T02:46:17.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:17 smithi084 ceph-mon[30747]: pgmap v515: 129 pgs: 129 active+clean; 172 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 359 op/s 2024-09-21T02:46:17.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:17 smithi090 ceph-mon[34571]: pgmap v515: 129 pgs: 129 active+clean; 172 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 359 op/s 2024-09-21T02:46:19.606 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:19 smithi084 ceph-mon[30747]: pgmap v516: 129 pgs: 129 active+clean; 180 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 457 op/s 2024-09-21T02:46:19.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:19 smithi172 ceph-mon[35067]: pgmap v516: 129 pgs: 129 active+clean; 180 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 457 op/s 2024-09-21T02:46:19.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:19 smithi090 ceph-mon[34571]: pgmap v516: 129 pgs: 129 active+clean; 180 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 457 op/s 2024-09-21T02:46:21.698 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:21 smithi084 ceph-mon[30747]: pgmap v517: 129 pgs: 129 active+clean; 180 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 394 op/s 2024-09-21T02:46:21.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:21 smithi172 ceph-mon[35067]: pgmap v517: 129 pgs: 129 active+clean; 180 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 394 op/s 2024-09-21T02:46:21.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:21 smithi090 ceph-mon[34571]: pgmap v517: 129 pgs: 129 active+clean; 180 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 394 op/s 2024-09-21T02:46:23.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:23 smithi172 ceph-mon[35067]: pgmap v518: 129 pgs: 129 active+clean; 183 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 521 op/s 2024-09-21T02:46:23.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:23 smithi084 ceph-mon[30747]: pgmap v518: 129 pgs: 129 active+clean; 183 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 521 op/s 2024-09-21T02:46:23.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:23 smithi090 ceph-mon[34571]: pgmap v518: 129 pgs: 129 active+clean; 183 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 521 op/s 2024-09-21T02:46:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.539+0000 7f1184a00640 1 -- 172.21.15.84:0/1864254615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11801056f0 msgr2=0x7f1180105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.539+0000 7f1184a00640 1 --2- 172.21.15.84:0/1864254615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11801056f0 0x7f1180105b60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1170009900 tx=0x7f117002a410 comp rx=0 tx=0).stop 2024-09-21T02:46:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.539+0000 7f1184a00640 1 -- 172.21.15.84:0/1864254615 shutdown_connections 2024-09-21T02:46:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.539+0000 7f1184a00640 1 --2- 172.21.15.84:0/1864254615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1180106770 0x7f1180106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.539+0000 7f1184a00640 1 --2- 172.21.15.84:0/1864254615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1180107110 0x7f118010dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.539+0000 7f1184a00640 1 --2- 172.21.15.84:0/1864254615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11801056f0 0x7f1180105b60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.539+0000 7f1184a00640 1 -- 172.21.15.84:0/1864254615 >> 172.21.15.84:0/1864254615 conn(0x7f1180101050 msgr2=0x7f11801034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.540+0000 7f1184a00640 1 -- 172.21.15.84:0/1864254615 shutdown_connections 2024-09-21T02:46:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.540+0000 7f1184a00640 1 -- 172.21.15.84:0/1864254615 wait complete. 2024-09-21T02:46:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1184a00640 1 Processor -- start 2024-09-21T02:46:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1184a00640 1 -- start start 2024-09-21T02:46:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1184a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11801056f0 0x7f118019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1184a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1180106770 0x7f118019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1184a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1180107110 0x7f118019d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1184a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f11801114e0 con 0x7f1180106770 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1184a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1180111360 con 0x7f11801056f0 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1184a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1180111660 con 0x7f1180107110 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1177e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1180106770 0x7f118019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1177e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1180106770 0x7f118019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40698/0 (socket says 172.21.15.84:40698) 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f1177e00640 1 -- 172.21.15.84:0/1045868970 learned_addr learned my addr 172.21.15.84:0/1045868970 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.541+0000 7f117fe00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1180107110 0x7f118019d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f117f400640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11801056f0 0x7f118019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f1177e00640 1 -- 172.21.15.84:0/1045868970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1180107110 msgr2=0x7f118019d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f1177e00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1180107110 0x7f118019d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f1177e00640 1 -- 172.21.15.84:0/1045868970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11801056f0 msgr2=0x7f118019c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.545 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f1177e00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11801056f0 0x7f118019c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f1177e00640 1 -- 172.21.15.84:0/1045868970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118019daa0 con 0x7f1180106770 2024-09-21T02:46:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f1177e00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1180106770 0x7f118019c6d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f116800e9f0 tx=0x7f116800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f117cc00640 1 -- 172.21.15.84:0/1045868970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116800cd80 con 0x7f1180106770 2024-09-21T02:46:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f1184a00640 1 -- 172.21.15.84:0/1045868970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118019dd90 con 0x7f1180106770 2024-09-21T02:46:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f117cc00640 1 -- 172.21.15.84:0/1045868970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11680054f0 con 0x7f1180106770 2024-09-21T02:46:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.542+0000 7f117cc00640 1 -- 172.21.15.84:0/1045868970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1168010690 con 0x7f1180106770 2024-09-21T02:46:25.546 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.543+0000 7f1184a00640 1 -- 172.21.15.84:0/1045868970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11801a4480 con 0x7f1180106770 2024-09-21T02:46:25.547 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.546+0000 7f118cff5740 1 Processor -- start 2024-09-21T02:46:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f118cff5740 1 -- start start 2024-09-21T02:46:25.548 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f118cff5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e6f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f118cff5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f118cff5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e70470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f118cff5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c8c0de26b0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f118cff5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c8c0dd1ae0 con 0x55c8c0aa74d0 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f118cff5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8c0dd58f0 con 0x55c8c0ac81b0 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f117f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f117f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40706/0 (socket says 172.21.15.84:40706) 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f117f400640 1 -- 172.21.15.84:0/2462841667 learned_addr learned my addr 172.21.15.84:0/2462841667 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f117cc00640 1 -- 172.21.15.84:0/1045868970 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f11680046c0 con 0x7f1180106770 2024-09-21T02:46:25.549 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.547+0000 7f117fe00640 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e6f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f117f400640 1 -- 172.21.15.84:0/2462841667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0ac81b0 msgr2=0x55c8c0e6f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f117f400640 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e6f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f117f400640 1 -- 172.21.15.84:0/2462841667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0aa74d0 msgr2=0x55c8c0e70470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f117f400640 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e70470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f117f400640 1 -- 172.21.15.84:0/2462841667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c0d9e780 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f117fe00640 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e6f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f117f400640 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6f920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1170009900 tx=0x7f1170004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c46dfcd11044fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f116fe00640 1 -- 172.21.15.84:0/2462841667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170040070 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.551 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.548+0000 7f116fe00640 1 -- 172.21.15.84:0/2462841667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11700054f0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.549+0000 7f116fe00640 1 -- 172.21.15.84:0/2462841667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170035040 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.549+0000 7f117cc00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f11640b6510 0x7f11640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.549+0000 7f117cc00640 1 -- 172.21.15.84:0/1045868970 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f11680e7a00 con 0x7f1180106770 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.549+0000 7f118cff5740 1 -- 172.21.15.84:0/2462841667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 msgr2=0x55c8c0e6f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.549+0000 7f118cff5740 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6f920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1170009900 tx=0x7f1170004040 comp rx=0 tx=0).stop 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.549+0000 7f117fe00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f11640b6510 0x7f11640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f118cff5740 1 -- 172.21.15.84:0/2462841667 shutdown_connections 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f118cff5740 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e70470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f118cff5740 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6f920 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f118cff5740 1 --2- 172.21.15.84:0/2462841667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e6f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f118cff5740 1 -- 172.21.15.84:0/2462841667 >> 172.21.15.84:0/2462841667 conn(0x55c8c0abc300 msgr2=0x55c8c0e6ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f118cff5740 1 -- 172.21.15.84:0/2462841667 shutdown_connections 2024-09-21T02:46:25.552 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f118cff5740 1 -- 172.21.15.84:0/2462841667 wait complete. 2024-09-21T02:46:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f117fe00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f11640b6510 0x7f11640b8a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1178009fd0 tx=0x7f1178009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.550+0000 7f118cff5740 1 -- start start 2024-09-21T02:46:25.555 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f118cff5740 1 Processor -- start 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f118cff5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e789d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f118cff5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e79090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f118cff5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e79b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f118cff5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c8c0d09ab0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f118cff5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55c8c0d78570 con 0x55c8c0ac81b0 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f118cff5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8c0e70f30 con 0x55c8c0aa74d0 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f118cff5740 10 client.0 _ll_register_callbacks cb 0x55c8c0d87100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f117f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f117f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e789d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40708/0 (socket says 172.21.15.84:40708) 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f117f400640 1 -- 172.21.15.84:0/2618217605 learned_addr learned my addr 172.21.15.84:0/2618217605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.551+0000 7f1177e00640 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e79090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f117fe00640 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e79b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.556 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f117f400640 1 -- 172.21.15.84:0/2618217605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 msgr2=0x55c8c0e79090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f117f400640 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e79090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f117f400640 1 -- 172.21.15.84:0/2618217605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 msgr2=0x55c8c0e79b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f117f400640 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e79b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f117f400640 1 -- 172.21.15.84:0/2618217605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c0b33790 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f117f400640 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e789d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1170009290 tx=0x7f1170009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa87da3ff00f82f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f116cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f116cc00640 1 -- 172.21.15.84:0/2618217605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117004d060 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f116cc00640 1 -- 172.21.15.84:0/2618217605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f1170004970 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.552+0000 7f118cff5740 1 -- 172.21.15.84:0/2618217605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11700054f0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f116cc00640 1 -- 172.21.15.84:0/2618217605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1170054050 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f118cff5740 10 client.15882 fetch_fsmap learned FSMap version 31 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f118cff5740 1 -- 172.21.15.84:0/2618217605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c8c0bac620 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f116cc00640 1 -- 172.21.15.84:0/2618217605 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11700054f0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.557 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f116cc00640 1 -- 172.21.15.84:0/2618217605 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f11700035f0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f118cff5740 10 client.15882 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f118cff5740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f118cff5740 20 client.15882 populate_metadata read hostname 'smithi084' 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f118cff5740 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55c8c0a86d80 0x55c8c0e85c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f118cff5740 4 client.15882 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.553+0000 7f118cff5740 1 -- 172.21.15.84:0/2618217605 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8c0de4600 con 0x55c8c0a86d80 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.554+0000 7f1177e00640 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55c8c0a86d80 0x55c8c0e85c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.554+0000 7f1177e00640 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55c8c0a86d80 0x55c8c0e85c70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0a52ba7951a663 server_cookie=117a28a4901c40a1 in_seq=0 out_seq=0 2024-09-21T02:46:25.558 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.554+0000 7f116cc00640 10 client.15882 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.555+0000 7f116cc00640 1 -- 172.21.15.84:0/2618217605 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8c0de4600 con 0x55c8c0a86d80 2024-09-21T02:46:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.555+0000 7f116cc00640 10 client.15882 handle_command_reply: tid=0 2024-09-21T02:46:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.555+0000 7f118cff5740 1 client.15882 shutdown 2024-09-21T02:46:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 -- 172.21.15.84:0/2618217605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 msgr2=0x55c8c0e789d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.559 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e789d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1170009290 tx=0x7f1170009520 comp rx=0 tx=0).stop 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 -- 172.21.15.84:0/2618217605 shutdown_connections 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e79090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55c8c0a86d80 0x55c8c0e85c70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e79b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 --2- 172.21.15.84:0/2618217605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e789d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f116cc00640 0 client.15882 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 -- 172.21.15.84:0/2618217605 >> 172.21.15.84:0/2618217605 conn(0x55c8c0abc300 msgr2=0x55c8c0e6b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 -- 172.21.15.84:0/2618217605 shutdown_connections 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 1 -- 172.21.15.84:0/2618217605 wait complete. 2024-09-21T02:46:25.560 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.556+0000 7f118cff5740 20 client.15882 trim_cache size 0 max 16384 2024-09-21T02:46:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f118cff5740 1 Processor -- start 2024-09-21T02:46:25.572 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f118cff5740 1 -- start start 2024-09-21T02:46:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f118cff5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f118cff5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e80a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f118cff5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e77bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f118cff5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f11801b10a0 con 0x55c8c0aa74d0 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f118cff5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f11801ae8e0 con 0x55c8c0ac81b0 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f118cff5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f11801ac730 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.571+0000 7f1177e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e80a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f1177e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e80a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40714/0 (socket says 172.21.15.84:40714) 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f1177e00640 1 -- 172.21.15.84:0/4204538189 learned_addr learned my addr 172.21.15.84:0/4204538189 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f117fe00640 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e77bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f117f400640 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f1177e00640 1 -- 172.21.15.84:0/4204538189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0a9f2f0 msgr2=0x55c8c0e6bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f1177e00640 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.574 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f1177e00640 1 -- 172.21.15.84:0/4204538189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 msgr2=0x55c8c0e77bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f1177e00640 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e77bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f1177e00640 1 -- 172.21.15.84:0/4204538189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8c0e79850 con 0x55c8c0aa74d0 2024-09-21T02:46:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f1177e00640 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e80a70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f11680ad770 tx=0x7f1168004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1150b98ad0481698 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f116f400640 1 -- 172.21.15.84:0/4204538189 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11680056a0 con 0x55c8c0aa74d0 2024-09-21T02:46:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f116f400640 1 -- 172.21.15.84:0/4204538189 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11680ad2f0 con 0x55c8c0aa74d0 2024-09-21T02:46:25.575 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.572+0000 7f116f400640 1 -- 172.21.15.84:0/4204538189 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11680aeb10 con 0x55c8c0aa74d0 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 -- 172.21.15.84:0/4204538189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0aa74d0 msgr2=0x55c8c0e80a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e80a70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f11680ad770 tx=0x7f1168004a70 comp rx=0 tx=0).stop 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 -- 172.21.15.84:0/4204538189 shutdown_connections 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e77bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e80a70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 --2- 172.21.15.84:0/4204538189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e6bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 -- 172.21.15.84:0/4204538189 >> 172.21.15.84:0/4204538189 conn(0x55c8c0abc300 msgr2=0x55c8c0e6b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 -- 172.21.15.84:0/4204538189 shutdown_connections 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.573+0000 7f118cff5740 1 -- 172.21.15.84:0/4204538189 wait complete. 2024-09-21T02:46:25.578 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 1 -- start start 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 1 Processor -- start 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e80900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e7f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e7fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f11801acda0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f11801ae210 con 0x55c8c0ac81b0 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f11801ad470 con 0x55c8c0aa74d0 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f118cff5740 10 client.0 _ll_register_callbacks cb 0x7f1178009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.574+0000 7f117f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e80900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e80900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40718/0 (socket says 172.21.15.84:40718) 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117f400640 1 -- 172.21.15.84:0/1436683668 learned_addr learned my addr 172.21.15.84:0/1436683668 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f1177e00640 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e7f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117fe00640 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e7fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117f400640 1 -- 172.21.15.84:0/1436683668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 msgr2=0x55c8c0e7f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117f400640 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e7f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117f400640 1 -- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 msgr2=0x55c8c0e7fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117f400640 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e7fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117f400640 1 -- 172.21.15.84:0/1436683668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8c0e7e180 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117fe00640 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e7fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f117f400640 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e80900 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1170003800 tx=0x7f1170031470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680f4b95681b0cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f116cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f116cc00640 1 -- 172.21.15.84:0/1436683668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170040070 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f116cc00640 1 -- 172.21.15.84:0/1436683668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f1170003c30 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.575+0000 7f118cff5740 1 -- 172.21.15.84:0/1436683668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11680ad2f0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f116cc00640 1 -- 172.21.15.84:0/1436683668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1170069050 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f118cff5740 10 client.15888 fetch_fsmap learned FSMap version 31 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f118cff5740 1 -- 172.21.15.84:0/1436683668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c8c0ef06f0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f116cc00640 1 -- 172.21.15.84:0/1436683668 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11680ad2f0 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f116cc00640 1 -- 172.21.15.84:0/1436683668 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f1170003e30 con 0x55c8c0a9f2f0 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f118cff5740 10 client.15888 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f118cff5740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f118cff5740 20 client.15888 populate_metadata read hostname 'smithi084' 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f118cff5740 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55c8c0a5c1c0 0x55c8c0ef31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f118cff5740 4 client.15888 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.576+0000 7f118cff5740 1 -- 172.21.15.84:0/1436683668 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c8c0e661c0 con 0x55c8c0a5c1c0 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.577+0000 7f1177e00640 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55c8c0a5c1c0 0x55c8c0ef31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.577+0000 7f1177e00640 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55c8c0a5c1c0 0x55c8c0ef31c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42155ee809e97fd server_cookie=df0302920132e972 in_seq=0 out_seq=0 2024-09-21T02:46:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:25.577+0000 7f116cc00640 10 client.15888 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:25.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:25 smithi172 ceph-mon[35067]: pgmap v519: 129 pgs: 129 active+clean; 182 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 368 op/s 2024-09-21T02:46:25.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:25 smithi084 ceph-mon[30747]: pgmap v519: 129 pgs: 129 active+clean; 182 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 368 op/s 2024-09-21T02:46:25.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:25 smithi090 ceph-mon[34571]: pgmap v519: 129 pgs: 129 active+clean; 182 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 368 op/s 2024-09-21T02:46:27.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:27 smithi172 ceph-mon[35067]: pgmap v520: 129 pgs: 129 active+clean; 180 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 342 op/s 2024-09-21T02:46:27.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:27 smithi084 ceph-mon[30747]: pgmap v520: 129 pgs: 129 active+clean; 180 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 342 op/s 2024-09-21T02:46:27.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:27 smithi090 ceph-mon[34571]: pgmap v520: 129 pgs: 129 active+clean; 180 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 342 op/s 2024-09-21T02:46:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.048+0000 7f116cc00640 1 -- 172.21.15.84:0/1436683668 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c8c0e661c0 con 0x55c8c0a5c1c0 2024-09-21T02:46:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.048+0000 7f116cc00640 10 client.15888 handle_command_reply: tid=0 2024-09-21T02:46:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.048+0000 7f118cff5740 1 client.15888 shutdown 2024-09-21T02:46:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 -- 172.21.15.84:0/1436683668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 msgr2=0x55c8c0e80900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e80900 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1170003800 tx=0x7f1170031470 comp rx=0 tx=0).stop 2024-09-21T02:46:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 -- 172.21.15.84:0/1436683668 shutdown_connections 2024-09-21T02:46:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8c0aa74d0 0x55c8c0e7f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55c8c0a5c1c0 0x55c8c0ef31c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c8c0ac81b0 0x55c8c0e7fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 --2- 172.21.15.84:0/1436683668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8c0a9f2f0 0x55c8c0e80900 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f116cc00640 0 client.15888 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 -- 172.21.15.84:0/1436683668 >> 172.21.15.84:0/1436683668 conn(0x55c8c0abc300 msgr2=0x55c8c0e732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 -- 172.21.15.84:0/1436683668 shutdown_connections 2024-09-21T02:46:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 1 -- 172.21.15.84:0/1436683668 wait complete. 2024-09-21T02:46:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.049+0000 7f118cff5740 20 client.15888 trim_cache size 0 max 16384 2024-09-21T02:46:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:46:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:46:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:46:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:46:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 -- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f11640b6510 msgr2=0x7f11640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f11640b6510 0x7f11640b8a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1178009fd0 tx=0x7f1178009500 comp rx=0 tx=0).stop 2024-09-21T02:46:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 -- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1180106770 msgr2=0x7f118019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1180106770 0x7f118019c6d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f116800e9f0 tx=0x7f116800edf0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 -- 172.21.15.84:0/1045868970 shutdown_connections 2024-09-21T02:46:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f11640b6510 0x7f11640b8a20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1180107110 0x7f118019d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1180106770 0x7f118019c6d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 --2- 172.21.15.84:0/1045868970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11801056f0 0x7f118019c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.050+0000 7f1184a00640 1 -- 172.21.15.84:0/1045868970 >> 172.21.15.84:0/1045868970 conn(0x7f1180101050 msgr2=0x7f1180109a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.051+0000 7f1184a00640 1 -- 172.21.15.84:0/1045868970 shutdown_connections 2024-09-21T02:46:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:29.051+0000 7f1184a00640 1 -- 172.21.15.84:0/1045868970 wait complete. 2024-09-21T02:46:29.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:29 smithi172 ceph-mon[35067]: pgmap v521: 129 pgs: 129 active+clean; 176 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-09-21T02:46:29.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:29 smithi084 ceph-mon[30747]: pgmap v521: 129 pgs: 129 active+clean; 176 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-09-21T02:46:29.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:29 smithi090 ceph-mon[34571]: pgmap v521: 129 pgs: 129 active+clean; 176 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 389 op/s 2024-09-21T02:46:30.815 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar xf doc.tar 2024-09-21T02:46:31.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:31 smithi172 ceph-mon[35067]: pgmap v522: 129 pgs: 129 active+clean; 176 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 985 KiB/s wr, 271 op/s 2024-09-21T02:46:31.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:31 smithi084 ceph-mon[30747]: pgmap v522: 129 pgs: 129 active+clean; 176 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 985 KiB/s wr, 271 op/s 2024-09-21T02:46:31.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:31 smithi090 ceph-mon[34571]: pgmap v522: 129 pgs: 129 active+clean; 176 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 985 KiB/s wr, 271 op/s 2024-09-21T02:46:33.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:33 smithi172 ceph-mon[35067]: pgmap v523: 129 pgs: 129 active+clean; 177 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 309 op/s 2024-09-21T02:46:33.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:33 smithi084 ceph-mon[30747]: pgmap v523: 129 pgs: 129 active+clean; 177 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 309 op/s 2024-09-21T02:46:33.766 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:33 smithi090 ceph-mon[34571]: pgmap v523: 129 pgs: 129 active+clean; 177 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.2 MiB/s wr, 309 op/s 2024-09-21T02:46:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:35 smithi172 ceph-mon[35067]: pgmap v524: 129 pgs: 129 active+clean; 177 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 627 KiB/s wr, 193 op/s 2024-09-21T02:46:35.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:35 smithi172 ceph-mon[35067]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:46:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:35 smithi084 ceph-mon[30747]: pgmap v524: 129 pgs: 129 active+clean; 177 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 627 KiB/s wr, 193 op/s 2024-09-21T02:46:35.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:35 smithi084 ceph-mon[30747]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:46:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:35 smithi090 ceph-mon[34571]: pgmap v524: 129 pgs: 129 active+clean; 177 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 627 KiB/s wr, 193 op/s 2024-09-21T02:46:35.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:35 smithi090 ceph-mon[34571]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T02:46:37.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:37 smithi172 ceph-mon[35067]: pgmap v525: 129 pgs: 129 active+clean; 179 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 878 KiB/s wr, 204 op/s 2024-09-21T02:46:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:37 smithi084 ceph-mon[30747]: pgmap v525: 129 pgs: 129 active+clean; 179 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 878 KiB/s wr, 204 op/s 2024-09-21T02:46:37.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:37 smithi090 ceph-mon[34571]: pgmap v525: 129 pgs: 129 active+clean; 179 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 878 KiB/s wr, 204 op/s 2024-09-21T02:46:39.756 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:39 smithi172 ceph-mon[35067]: pgmap v526: 129 pgs: 129 active+clean; 186 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-09-21T02:46:39.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:39 smithi084 ceph-mon[30747]: pgmap v526: 129 pgs: 129 active+clean; 186 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-09-21T02:46:39.767 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:39 smithi090 ceph-mon[34571]: pgmap v526: 129 pgs: 129 active+clean; 186 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-09-21T02:46:39.788 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-09-21T02:46:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:41 smithi172 ceph-mon[35067]: pgmap v527: 129 pgs: 129 active+clean; 186 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-09-21T02:46:42.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:41 smithi084 ceph-mon[30747]: pgmap v527: 129 pgs: 129 active+clean; 186 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-09-21T02:46:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:41 smithi090 ceph-mon[34571]: pgmap v527: 129 pgs: 129 active+clean; 186 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-09-21T02:46:42.243 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 -- 172.21.15.84:0/3050480086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a41034e0 msgr2=0x7f85a4103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.244 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 --2- 172.21.15.84:0/3050480086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a41034e0 0x7f85a4103950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f859c009ca0 tx=0x7f859c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.244 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 -- 172.21.15.84:0/3050480086 shutdown_connections 2024-09-21T02:46:42.244 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 --2- 172.21.15.84:0/3050480086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85a4104f00 0x7f85a410b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.244 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 --2- 172.21.15.84:0/3050480086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a4104560 0x7f85a4104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.244 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 --2- 172.21.15.84:0/3050480086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a41034e0 0x7f85a4103950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.244 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 -- 172.21.15.84:0/3050480086 >> 172.21.15.84:0/3050480086 conn(0x7f85a40fee20 msgr2=0x7f85a41012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:42.244 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 -- 172.21.15.84:0/3050480086 shutdown_connections 2024-09-21T02:46:42.244 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.242+0000 7f85a3e00640 1 -- 172.21.15.84:0/3050480086 wait complete. 2024-09-21T02:46:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.243+0000 7f85a3e00640 1 Processor -- start 2024-09-21T02:46:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.243+0000 7f85a3e00640 1 -- start start 2024-09-21T02:46:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85a41034e0 0x7f85a419c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a4104560 0x7f85a419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a4104f00 0x7f85a419d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85a410f280 con 0x7f85a4104f00 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85a410f100 con 0x7f85a41034e0 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a3e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85a410f400 con 0x7f85a4104560 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a4104560 0x7f85a419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85a41034e0 0x7f85a419c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a4104f00 0x7f85a419d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85a41034e0 0x7f85a419c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52278/0 (socket says 172.21.15.84:52278) 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a4104560 0x7f85a419c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:44242/0 (socket says 172.21.15.84:44242) 2024-09-21T02:46:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2a00640 1 -- 172.21.15.84:0/400978349 learned_addr learned my addr 172.21.15.84:0/400978349 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2a00640 1 -- 172.21.15.84:0/400978349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a4104560 msgr2=0x7f85a419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2a00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a4104560 0x7f85a419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2a00640 1 -- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a4104f00 msgr2=0x7f85a419d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2a00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a4104f00 0x7f85a419d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2a00640 1 -- 172.21.15.84:0/400978349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a419da70 con 0x7f85a41034e0 2024-09-21T02:46:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.244+0000 7f85a2000640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a4104560 0x7f85a419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.245+0000 7f85a3400640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a4104f00 0x7f85a419d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.245+0000 7f85a2a00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85a41034e0 0x7f85a419c030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f859c02ade0 tx=0x7f859c02f3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.245+0000 7f859b400640 1 -- 172.21.15.84:0/400978349 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c003c70 con 0x7f85a41034e0 2024-09-21T02:46:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.245+0000 7f859b400640 1 -- 172.21.15.84:0/400978349 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f859c003e10 con 0x7f85a41034e0 2024-09-21T02:46:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.245+0000 7f85a3e00640 1 -- 172.21.15.84:0/400978349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a419dd00 con 0x7f85a41034e0 2024-09-21T02:46:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.245+0000 7f859b400640 1 -- 172.21.15.84:0/400978349 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c02fcc0 con 0x7f85a41034e0 2024-09-21T02:46:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.245+0000 7f85a3e00640 1 -- 172.21.15.84:0/400978349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a41a4450 con 0x7f85a41034e0 2024-09-21T02:46:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.248+0000 7f85b0c42740 1 Processor -- start 2024-09-21T02:46:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.248+0000 7f85b0c42740 1 -- start start 2024-09-21T02:46:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f859b400640 1 -- 172.21.15.84:0/400978349 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f859c004040 con 0x7f85a41034e0 2024-09-21T02:46:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef55920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef56470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85b0c42740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ae0eec86b0 con 0x55ae0ebae1b0 2024-09-21T02:46:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85b0c42740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ae0eeb7ae0 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85b0c42740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae0eebb8f0 con 0x55ae0eb852f0 2024-09-21T02:46:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef56470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef55920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41582/0 (socket says 172.21.15.84:41582) 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a2000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef56470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52284/0 (socket says 172.21.15.84:52284) 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a3400640 1 -- 172.21.15.84:0/584199347 learned_addr learned my addr 172.21.15.84:0/584199347 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a2000640 1 -- 172.21.15.84:0/584199347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 msgr2=0x55ae0ef55920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a2000640 1 --2- 172.21.15.84:0/584199347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef55920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a2000640 1 -- 172.21.15.84:0/584199347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 msgr2=0x55ae0ef552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a2000640 1 --2- 172.21.15.84:0/584199347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a2000640 1 -- 172.21.15.84:0/584199347 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ee84780 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.249+0000 7f85a3400640 1 --2- 172.21.15.84:0/584199347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:42.253 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.250+0000 7f85a2000640 1 --2- 172.21.15.84:0/584199347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef56470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f858c009fd0 tx=0x7f858c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b90bc927855a26eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.250+0000 7f8593e00640 1 -- 172.21.15.84:0/584199347 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c004030 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.250+0000 7f8593e00640 1 -- 172.21.15.84:0/584199347 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f858c0054f0 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.250+0000 7f8593e00640 1 -- 172.21.15.84:0/584199347 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c004d50 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.250+0000 7f859b400640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f85880b6510 0x7f85880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.250+0000 7f859b400640 1 -- 172.21.15.84:0/400978349 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f859c108a40 con 0x7f85a41034e0 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85a3400640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f85880b6510 0x7f85880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 -- 172.21.15.84:0/584199347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb8d4d0 msgr2=0x55ae0ef56470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 --2- 172.21.15.84:0/584199347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef56470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f858c009fd0 tx=0x7f858c0118d0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 -- 172.21.15.84:0/584199347 shutdown_connections 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 --2- 172.21.15.84:0/584199347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef55920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 --2- 172.21.15.84:0/584199347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef56470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 --2- 172.21.15.84:0/584199347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 -- 172.21.15.84:0/584199347 >> 172.21.15.84:0/584199347 conn(0x55ae0eba2300 msgr2=0x55ae0ef50d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:42.254 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 -- 172.21.15.84:0/584199347 shutdown_connections 2024-09-21T02:46:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85b0c42740 1 -- 172.21.15.84:0/584199347 wait complete. 2024-09-21T02:46:42.255 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.251+0000 7f85a3400640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f85880b6510 0x7f85880b8a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f859400bfd0 tx=0x7f859400b2e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.252+0000 7f85b0c42740 1 -- start start 2024-09-21T02:46:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.252+0000 7f85b0c42740 1 Processor -- start 2024-09-21T02:46:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.252+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb852f0 0x55ae0ef5e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.252+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef5f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.252+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef5fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.252+0000 7f85b0c42740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ae0edefab0 con 0x55ae0eb852f0 2024-09-21T02:46:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.252+0000 7f85b0c42740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ee5e570 con 0x55ae0ebae1b0 2024-09-21T02:46:42.258 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.252+0000 7f85b0c42740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae0ef56f90 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85b0c42740 10 client.0 _ll_register_callbacks cb 0x55ae0ee6d100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb852f0 0x55ae0ef5e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef5f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a3400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef5fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef5f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:44262/0 (socket says 172.21.15.84:44262) 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 -- 172.21.15.84:0/2753999795 learned_addr learned my addr 172.21.15.84:0/2753999795 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 -- 172.21.15.84:0/2753999795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 msgr2=0x55ae0ef5fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef5fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 -- 172.21.15.84:0/2753999795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb852f0 msgr2=0x55ae0ef5e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb852f0 0x55ae0ef5e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 -- 172.21.15.84:0/2753999795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0ec19790 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f85a2000640 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef5f070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f858c000c00 tx=0x7f858c005120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0db1d0ddf520e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:42.259 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.253+0000 7f8590c00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f8590c00640 1 -- 172.21.15.84:0/2753999795 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c029020 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 1 -- 172.21.15.84:0/2753999795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f858c0054f0 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f8590c00640 1 -- 172.21.15.84:0/2753999795 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f858c00f5a0 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f8590c00640 1 -- 172.21.15.84:0/2753999795 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f858c034050 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 10 client.25939 fetch_fsmap learned FSMap version 32 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 1 -- 172.21.15.84:0/2753999795 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ae0ec92620 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f8590c00640 1 -- 172.21.15.84:0/2753999795 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f858c0054f0 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f8590c00640 1 -- 172.21.15.84:0/2753999795 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f858c025590 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 10 client.25939 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 10 client.25939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 20 client.25939 populate_metadata read hostname 'smithi084' 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ae0eb6cd80 0x55ae0ef6bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 4 client.25939 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.254+0000 7f85b0c42740 1 -- 172.21.15.84:0/2753999795 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae0eeca600 con 0x55ae0eb6cd80 2024-09-21T02:46:42.260 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.255+0000 7f85a2a00640 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ae0eb6cd80 0x55ae0ef6bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.255+0000 7f85a2a00640 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ae0eb6cd80 0x55ae0ef6bf00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48fb4191ab2fba04 server_cookie=71bdeb62105aed3e in_seq=0 out_seq=0 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.255+0000 7f8590c00640 10 client.25939 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f8590c00640 1 -- 172.21.15.84:0/2753999795 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae0eeca600 con 0x55ae0eb6cd80 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f8590c00640 10 client.25939 handle_command_reply: tid=0 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 client.25939 shutdown 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 -- 172.21.15.84:0/2753999795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 msgr2=0x55ae0ef5f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef5f070 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f858c000c00 tx=0x7f858c005120 comp rx=0 tx=0).stop 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 -- 172.21.15.84:0/2753999795 shutdown_connections 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef5f070 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ae0eb6cd80 0x55ae0ef6bf00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef5fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f8590c00640 0 client.25939 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:42.261 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2753999795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb852f0 0x55ae0ef5e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 -- 172.21.15.84:0/2753999795 >> 172.21.15.84:0/2753999795 conn(0x55ae0eba2300 msgr2=0x55ae0ef4f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 -- 172.21.15.84:0/2753999795 shutdown_connections 2024-09-21T02:46:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.256+0000 7f85b0c42740 1 -- 172.21.15.84:0/2753999795 wait complete. 2024-09-21T02:46:42.262 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.257+0000 7f85b0c42740 20 client.25939 trim_cache size 0 max 16384 2024-09-21T02:46:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.271+0000 7f85b0c42740 1 Processor -- start 2024-09-21T02:46:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.271+0000 7f85b0c42740 1 -- start start 2024-09-21T02:46:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef50680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef54ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85b0c42740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85a41b1120 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85b0c42740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85a41ae960 con 0x55ae0ebae1b0 2024-09-21T02:46:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85b0c42740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85a41ac7b0 con 0x55ae0eb852f0 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef50680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef54ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef50680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:44274/0 (socket says 172.21.15.84:44274) 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2a00640 1 -- 172.21.15.84:0/2917929042 learned_addr learned my addr 172.21.15.84:0/2917929042 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a3400640 1 --2- 172.21.15.84:0/2917929042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2a00640 1 -- 172.21.15.84:0/2917929042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 msgr2=0x55ae0ef553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2a00640 1 --2- 172.21.15.84:0/2917929042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2a00640 1 -- 172.21.15.84:0/2917929042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb8d4d0 msgr2=0x55ae0ef54ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2a00640 1 --2- 172.21.15.84:0/2917929042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef54ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.272+0000 7f85a2a00640 1 -- 172.21.15.84:0/2917929042 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae0ef5e730 con 0x55ae0eb852f0 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.273+0000 7f85a2a00640 1 --2- 172.21.15.84:0/2917929042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef50680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f859c005e30 tx=0x7f859c108d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6162717586bcfcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.273+0000 7f8593400640 1 -- 172.21.15.84:0/2917929042 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0ce5b0 con 0x55ae0eb852f0 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.273+0000 7f8593400640 1 -- 172.21.15.84:0/2917929042 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f859c036040 con 0x55ae0eb852f0 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.273+0000 7f8593400640 1 -- 172.21.15.84:0/2917929042 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0cdf50 con 0x55ae0eb852f0 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.273+0000 7f85b0c42740 1 -- 172.21.15.84:0/2917929042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 msgr2=0x55ae0ef50680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.273+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2917929042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef50680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f859c005e30 tx=0x7f859c108d70 comp rx=0 tx=0).stop 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 -- 172.21.15.84:0/2917929042 shutdown_connections 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2917929042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2917929042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef54ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 --2- 172.21.15.84:0/2917929042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb852f0 0x55ae0ef50680 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 -- 172.21.15.84:0/2917929042 >> 172.21.15.84:0/2917929042 conn(0x55ae0eba2300 msgr2=0x55ae0ef5dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 -- 172.21.15.84:0/2917929042 shutdown_connections 2024-09-21T02:46:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 -- 172.21.15.84:0/2917929042 wait complete. 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 -- start start 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.274+0000 7f85b0c42740 1 Processor -- start 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb852f0 0x55ae0ef63c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef64300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85b0c42740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef64e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85b0c42740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85a41ace20 con 0x55ae0ebae1b0 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85b0c42740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85a41ae290 con 0x55ae0eb852f0 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85b0c42740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85a41ad4f0 con 0x55ae0eb8d4d0 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85b0c42740 10 client.0 _ll_register_callbacks cb 0x7f859400ba90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb852f0 0x55ae0ef63c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef64300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef64e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb852f0 0x55ae0ef63c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:52294/0 (socket says 172.21.15.84:52294) 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2a00640 1 -- 172.21.15.84:0/3507737134 learned_addr learned my addr 172.21.15.84:0/3507737134 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef64300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:44278/0 (socket says 172.21.15.84:44278) 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2a00640 1 -- 172.21.15.84:0/3507737134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 msgr2=0x55ae0ef64300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2a00640 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef64300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2a00640 1 -- 172.21.15.84:0/3507737134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 msgr2=0x55ae0ef64e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2a00640 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef64e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.275+0000 7f85a2a00640 1 -- 172.21.15.84:0/3507737134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0ef655d0 con 0x55ae0eb852f0 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f85a2a00640 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb852f0 0x55ae0ef63c40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f859c10e240 tx=0x7f859c0d8300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd0be6a1bc785fef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f8590c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f8590c00640 1 -- 172.21.15.84:0/3507737134 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c0ce130 con 0x55ae0eb852f0 2024-09-21T02:46:42.280 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f85b0c42740 1 -- 172.21.15.84:0/3507737134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f859c036040 con 0x55ae0eb852f0 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f8590c00640 1 -- 172.21.15.84:0/3507737134 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f859c0caa50 con 0x55ae0eb852f0 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f8590c00640 1 -- 172.21.15.84:0/3507737134 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f859c0cdf50 con 0x55ae0eb852f0 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f85b0c42740 10 client.25913 fetch_fsmap learned FSMap version 32 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f85b0c42740 1 -- 172.21.15.84:0/3507737134 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ae0ef66980 con 0x55ae0eb852f0 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f8590c00640 1 -- 172.21.15.84:0/3507737134 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f859c036040 con 0x55ae0eb852f0 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.276+0000 7f8590c00640 1 -- 172.21.15.84:0/3507737134 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f859c004330 con 0x55ae0eb852f0 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f85b0c42740 10 client.25913 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f85b0c42740 10 client.25913 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f85b0c42740 20 client.25913 populate_metadata read hostname 'smithi084' 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f85b0c42740 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ae0eb421c0 0x55ae0efd8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f85b0c42740 4 client.25913 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f85b0c42740 1 -- 172.21.15.84:0/3507737134 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae0eec60b0 con 0x55ae0eb421c0 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f85a2000640 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ae0eb421c0 0x55ae0efd8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:42.281 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f85a2000640 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ae0eb421c0 0x55ae0efd8a20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2842c221cca3eec7 server_cookie=ca20b3282924a162 in_seq=0 out_seq=0 2024-09-21T02:46:42.282 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.277+0000 7f8590c00640 10 client.25913 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.706+0000 7f8590c00640 1 -- 172.21.15.84:0/3507737134 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae0eec60b0 con 0x55ae0eb421c0 2024-09-21T02:46:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.706+0000 7f8590c00640 10 client.25913 handle_command_reply: tid=0 2024-09-21T02:46:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.706+0000 7f85b0c42740 1 client.25913 shutdown 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 -- 172.21.15.84:0/3507737134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb852f0 msgr2=0x55ae0ef63c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb852f0 0x55ae0ef63c40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f859c10e240 tx=0x7f859c0d8300 comp rx=0 tx=0).stop 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 -- 172.21.15.84:0/3507737134 shutdown_connections 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae0eb8d4d0 0x55ae0ef64300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x55ae0eb421c0 0x55ae0efd8a20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ae0ebae1b0 0x55ae0ef64e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 --2- 172.21.15.84:0/3507737134 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55ae0eb852f0 0x55ae0ef63c40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f8590c00640 0 client.25913 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 -- 172.21.15.84:0/3507737134 >> 172.21.15.84:0/3507737134 conn(0x55ae0eba2300 msgr2=0x55ae0ef54ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 -- 172.21.15.84:0/3507737134 shutdown_connections 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 1 -- 172.21.15.84:0/3507737134 wait complete. 2024-09-21T02:46:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.707+0000 7f85b0c42740 20 client.25913 trim_cache size 0 max 16384 2024-09-21T02:46:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:46:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:46:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:46:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 -- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f85880b6510 msgr2=0x7f85880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f85880b6510 0x7f85880b8a20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f859400bfd0 tx=0x7f859400b2e0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 -- 172.21.15.84:0/400978349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85a41034e0 msgr2=0x7f85a419c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85a41034e0 0x7f85a419c030 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f859c02ade0 tx=0x7f859c02f3e0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 -- 172.21.15.84:0/400978349 shutdown_connections 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f85880b6510 0x7f85880b8a20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85a4104560 0x7f85a419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f85a4104f00 0x7f85a419d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 --2- 172.21.15.84:0/400978349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85a41034e0 0x7f85a419c030 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 -- 172.21.15.84:0/400978349 >> 172.21.15.84:0/400978349 conn(0x7f85a40fee20 msgr2=0x7f85a40755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 -- 172.21.15.84:0/400978349 shutdown_connections 2024-09-21T02:46:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:42.708+0000 7f85a3e00640 1 -- 172.21.15.84:0/400978349 wait complete. 2024-09-21T02:46:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:43 smithi172 ceph-mon[35067]: pgmap v528: 129 pgs: 129 active+clean; 201 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 349 op/s 2024-09-21T02:46:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:43 smithi084 ceph-mon[30747]: pgmap v528: 129 pgs: 129 active+clean; 201 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 349 op/s 2024-09-21T02:46:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:43 smithi090 ceph-mon[34571]: pgmap v528: 129 pgs: 129 active+clean; 201 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 349 op/s 2024-09-21T02:46:44.114 INFO:tasks.workunit.client.0.smithi084.stderr:+ tar c linux-4.0.5 2024-09-21T02:46:44.634 INFO:tasks.workunit.client.0.smithi084.stdout:Ok 2024-09-21T02:46:44.634 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo Ok 2024-09-21T02:46:44.635 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T02:46:44.635 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T02:46:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:45 smithi172 ceph-mon[35067]: pgmap v529: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 373 op/s 2024-09-21T02:46:46.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:45 smithi084 ceph-mon[30747]: pgmap v529: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 373 op/s 2024-09-21T02:46:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:45 smithi090 ceph-mon[34571]: pgmap v529: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.0 MiB/s wr, 373 op/s 2024-09-21T02:46:48.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:47 smithi172 ceph-mon[35067]: pgmap v530: 129 pgs: 129 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-09-21T02:46:48.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:47 smithi084 ceph-mon[30747]: pgmap v530: 129 pgs: 129 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-09-21T02:46:48.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:47 smithi090 ceph-mon[34571]: pgmap v530: 129 pgs: 129 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-09-21T02:46:50.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:49 smithi172 ceph-mon[35067]: pgmap v531: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 444 op/s 2024-09-21T02:46:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:49 smithi084 ceph-mon[30747]: pgmap v531: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 444 op/s 2024-09-21T02:46:50.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:49 smithi090 ceph-mon[34571]: pgmap v531: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 444 op/s 2024-09-21T02:46:52.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:51 smithi172 ceph-mon[35067]: pgmap v532: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 413 op/s 2024-09-21T02:46:52.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:51 smithi084 ceph-mon[30747]: pgmap v532: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 413 op/s 2024-09-21T02:46:52.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:51 smithi090 ceph-mon[34571]: pgmap v532: 129 pgs: 129 active+clean; 125 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 413 op/s 2024-09-21T02:46:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:53 smithi172 ceph-mon[35067]: pgmap v533: 129 pgs: 129 active+clean; 118 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 548 op/s 2024-09-21T02:46:54.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:53 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:46:54.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:53 smithi084 ceph-mon[30747]: pgmap v533: 129 pgs: 129 active+clean; 118 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 548 op/s 2024-09-21T02:46:54.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:53 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:46:54.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:53 smithi090 ceph-mon[34571]: pgmap v533: 129 pgs: 129 active+clean; 118 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 548 op/s 2024-09-21T02:46:54.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:53 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T02:46:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:46:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:46:55.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:54 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:46:55.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:46:55.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:46:55.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:54 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:46:55.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T02:46:55.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T02:46:55.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:54 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' 2024-09-21T02:46:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 -- 172.21.15.84:0/2528441705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe718104570 msgr2=0x7fe718104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 --2- 172.21.15.84:0/2528441705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe718104570 0x7fe718104980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe704009900 tx=0x7fe70402a3f0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 -- 172.21.15.84:0/2528441705 shutdown_connections 2024-09-21T02:46:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 --2- 172.21.15.84:0/2528441705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe718104f10 0x7fe71810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 --2- 172.21.15.84:0/2528441705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe718104570 0x7fe718104980 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 --2- 172.21.15.84:0/2528441705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7181034f0 0x7fe718103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 -- 172.21.15.84:0/2528441705 >> 172.21.15.84:0/2528441705 conn(0x7fe7180fee30 msgr2=0x7fe7181012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 -- 172.21.15.84:0/2528441705 shutdown_connections 2024-09-21T02:46:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.898+0000 7fe717e00640 1 -- 172.21.15.84:0/2528441705 wait complete. 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.899+0000 7fe717e00640 1 Processor -- start 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717e00640 1 -- start start 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7181034f0 0x7fe71819c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe718104570 0x7fe71819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe718104f10 0x7fe71819d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810f2e0 con 0x7fe7181034f0 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810f160 con 0x7fe718104570 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810f460 con 0x7fe718104f10 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe718104f10 0x7fe71819d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe716a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7181034f0 0x7fe71819c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe718104f10 0x7fe71819d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:38636/0 (socket says 172.21.15.84:38636) 2024-09-21T02:46:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe717400640 1 -- 172.21.15.84:0/4012888671 learned_addr learned my addr 172.21.15.84:0/4012888671 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.900+0000 7fe716000640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe718104570 0x7fe71819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe717400640 1 -- 172.21.15.84:0/4012888671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe718104570 msgr2=0x7fe71819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe717400640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe718104570 0x7fe71819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe717400640 1 -- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7181034f0 msgr2=0x7fe71819c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe717400640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7181034f0 0x7fe71819c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe717400640 1 -- 172.21.15.84:0/4012888671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71819da90 con 0x7fe718104f10 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe717400640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe718104f10 0x7fe71819d270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe71000eb10 tx=0x7fe71000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe71ca00640 1 -- 172.21.15.84:0/4012888671 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710004b20 con 0x7fe718104f10 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe717e00640 1 -- 172.21.15.84:0/4012888671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71819dd80 con 0x7fe718104f10 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe71ca00640 1 -- 172.21.15.84:0/4012888671 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe710004cc0 con 0x7fe718104f10 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe71ca00640 1 -- 172.21.15.84:0/4012888671 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710010720 con 0x7fe718104f10 2024-09-21T02:46:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.901+0000 7fe717e00640 1 -- 172.21.15.84:0/4012888671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7181a4470 con 0x7fe718104f10 2024-09-21T02:46:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.904+0000 7fe725035740 1 Processor -- start 2024-09-21T02:46:55.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.905+0000 7fe71ca00640 1 -- 172.21.15.84:0/4012888671 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fe710005020 con 0x7fe718104f10 2024-09-21T02:46:55.906 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.905+0000 7fe725035740 1 -- start start 2024-09-21T02:46:55.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.905+0000 7fe725035740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.907 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.905+0000 7fe725035740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411bb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.905+0000 7fe725035740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640df34d0 0x5586411bc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.905+0000 7fe725035740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55864112e6b0 con 0x558640df34d0 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.905+0000 7fe725035740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55864111dae0 con 0x558640deb2f0 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.905+0000 7fe725035740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5586411218f0 con 0x558640e141b0 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640df34d0 0x5586411bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411bb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640df34d0 0x5586411bc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41038/0 (socket says 172.21.15.84:41038) 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716000640 1 -- 172.21.15.84:0/1923537885 learned_addr learned my addr 172.21.15.84:0/1923537885 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716a00640 1 -- 172.21.15.84:0/1923537885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 msgr2=0x5586411bb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716a00640 1 --2- 172.21.15.84:0/1923537885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411bb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716a00640 1 -- 172.21.15.84:0/1923537885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640df34d0 msgr2=0x5586411bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716a00640 1 --2- 172.21.15.84:0/1923537885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640df34d0 0x5586411bc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716a00640 1 -- 172.21.15.84:0/1923537885 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586410ea780 con 0x558640deb2f0 2024-09-21T02:46:55.909 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.906+0000 7fe716a00640 1 --2- 172.21.15.84:0/1923537885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411bb920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe708009c20 tx=0x7fe708011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7999d1f15ce70949 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:55.909 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:55 smithi172 ceph-mon[35067]: pgmap v534: 129 pgs: 129 active+clean; 117 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 335 op/s 2024-09-21T02:46:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.907+0000 7fe703e00640 1 -- 172.21.15.84:0/1923537885 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708004050 con 0x558640deb2f0 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.907+0000 7fe703e00640 1 -- 172.21.15.84:0/1923537885 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7080054f0 con 0x558640deb2f0 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.907+0000 7fe703e00640 1 -- 172.21.15.84:0/1923537885 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708004d70 con 0x558640deb2f0 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.907+0000 7fe71ca00640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6fc0b6510 0x7fe6fc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.907+0000 7fe71ca00640 1 -- 172.21.15.84:0/4012888671 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fe7100e7c90 con 0x7fe718104f10 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.907+0000 7fe716000640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6fc0b6510 0x7fe6fc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 -- 172.21.15.84:0/1923537885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 msgr2=0x5586411bb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 --2- 172.21.15.84:0/1923537885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411bb920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe708009c20 tx=0x7fe708011810 comp rx=0 tx=0).stop 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 -- 172.21.15.84:0/1923537885 shutdown_connections 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 --2- 172.21.15.84:0/1923537885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640df34d0 0x5586411bc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 --2- 172.21.15.84:0/1923537885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411bb920 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 --2- 172.21.15.84:0/1923537885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 -- 172.21.15.84:0/1923537885 >> 172.21.15.84:0/1923537885 conn(0x558640e08300 msgr2=0x5586411b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe716000640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6fc0b6510 0x7fe6fc0b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe7040096c0 tx=0x7fe704031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 -- 172.21.15.84:0/1923537885 shutdown_connections 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 -- 172.21.15.84:0/1923537885 wait complete. 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.908+0000 7fe725035740 1 -- start start 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe725035740 1 Processor -- start 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe725035740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe725035740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411c5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe725035740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640e141b0 0x5586411c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe725035740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558641055ab0 con 0x558640deb2f0 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe725035740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5586410c4570 con 0x558640e141b0 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe725035740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5586411bcf90 con 0x558640df34d0 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe725035740 10 client.0 _ll_register_callbacks cb 0x5586410d3100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe716a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe716000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe716000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:38648/0 (socket says 172.21.15.84:38648) 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.909+0000 7fe716000640 1 -- 172.21.15.84:0/81860431 learned_addr learned my addr 172.21.15.84:0/81860431 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe717400640 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640e141b0 0x5586411c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe716a00640 1 -- 172.21.15.84:0/81860431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 msgr2=0x5586411c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe716a00640 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe716a00640 1 -- 172.21.15.84:0/81860431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640e141b0 msgr2=0x5586411c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe716a00640 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640e141b0 0x5586411c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe716a00640 1 -- 172.21.15.84:0/81860431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558640e7f790 con 0x558640deb2f0 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe716a00640 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c4950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe708005e00 tx=0x7fe7080098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d0d3d728c4ee50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe700c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe700c00640 1 -- 172.21.15.84:0/81860431 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708029070 con 0x558640deb2f0 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe725035740 1 -- 172.21.15.84:0/81860431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7080054f0 con 0x558640deb2f0 2024-09-21T02:46:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.910+0000 7fe700c00640 1 -- 172.21.15.84:0/81860431 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fe708004f20 con 0x558640deb2f0 2024-09-21T02:46:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe700c00640 1 -- 172.21.15.84:0/81860431 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe708035050 con 0x558640deb2f0 2024-09-21T02:46:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe725035740 10 client.15918 fetch_fsmap learned FSMap version 32 2024-09-21T02:46:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe725035740 1 -- 172.21.15.84:0/81860431 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558640ef8620 con 0x558640deb2f0 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe700c00640 1 -- 172.21.15.84:0/81860431 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7080054f0 con 0x558640deb2f0 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe700c00640 1 -- 172.21.15.84:0/81860431 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fe708003d20 con 0x558640deb2f0 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe725035740 10 client.15918 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe725035740 10 client.15918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe725035740 20 client.15918 populate_metadata read hostname 'smithi084' 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe725035740 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x558640dd2d80 0x5586411d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe725035740 4 client.15918 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.911+0000 7fe725035740 1 -- 172.21.15.84:0/81860431 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558641130600 con 0x558640dd2d80 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.912+0000 7fe716000640 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x558640dd2d80 0x5586411d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.912+0000 7fe716000640 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x558640dd2d80 0x5586411d1e70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba1af03b94f14ef server_cookie=9bffaf35ee93b32b in_seq=0 out_seq=0 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.912+0000 7fe700c00640 10 client.15918 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:55.917 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe700c00640 1 -- 172.21.15.84:0/81860431 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558641130600 con 0x558640dd2d80 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe700c00640 10 client.15918 handle_command_reply: tid=0 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 client.15918 shutdown 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 -- 172.21.15.84:0/81860431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 msgr2=0x5586411c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c4950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe708005e00 tx=0x7fe7080098f0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 -- 172.21.15.84:0/81860431 shutdown_connections 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x558640dd2d80 0x5586411d1e70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640e141b0 0x5586411c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 --2- 172.21.15.84:0/81860431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c4950 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 -- 172.21.15.84:0/81860431 >> 172.21.15.84:0/81860431 conn(0x558640e08300 msgr2=0x5586411b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe700c00640 0 client.15918 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.913+0000 7fe725035740 1 -- 172.21.15.84:0/81860431 shutdown_connections 2024-09-21T02:46:55.918 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.914+0000 7fe725035740 1 -- 172.21.15.84:0/81860431 wait complete. 2024-09-21T02:46:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.914+0000 7fe725035740 20 client.15918 trim_cache size 0 max 16384 2024-09-21T02:46:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.930+0000 7fe725035740 1 Processor -- start 2024-09-21T02:46:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.930+0000 7fe725035740 1 -- start start 2024-09-21T02:46:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.930+0000 7fe725035740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.930+0000 7fe725035740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640df34d0 0x5586411b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.930+0000 7fe725035740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411baea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe725035740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181b11b0 con 0x558640deb2f0 2024-09-21T02:46:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe725035740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181ae9f0 con 0x558640df34d0 2024-09-21T02:46:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe725035740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181ac840 con 0x558640e141b0 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe716a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe717400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe716a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41050/0 (socket says 172.21.15.84:41050) 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe716a00640 1 -- 172.21.15.84:0/3784520693 learned_addr learned my addr 172.21.15.84:0/3784520693 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe716000640 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640df34d0 0x5586411b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe717400640 1 -- 172.21.15.84:0/3784520693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640df34d0 msgr2=0x5586411b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe717400640 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640df34d0 0x5586411b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe717400640 1 -- 172.21.15.84:0/3784520693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 msgr2=0x5586411c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe717400640 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe717400640 1 -- 172.21.15.84:0/3784520693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586411c2ae0 con 0x558640e141b0 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe716a00640 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.931+0000 7fe717400640 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411baea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7100ad9c0 tx=0x7fe7100ad800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a65a4b7d4abd80f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe703400640 1 -- 172.21.15.84:0/3784520693 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7100a91a0 con 0x558640e141b0 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe703400640 1 -- 172.21.15.84:0/3784520693 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7100ad540 con 0x558640e141b0 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe703400640 1 -- 172.21.15.84:0/3784520693 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710005310 con 0x558640e141b0 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe725035740 1 -- 172.21.15.84:0/3784520693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 msgr2=0x5586411baea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe725035740 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411baea0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7100ad9c0 tx=0x7fe7100ad800 comp rx=0 tx=0).stop 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe725035740 1 -- 172.21.15.84:0/3784520693 shutdown_connections 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe725035740 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640e141b0 0x5586411baea0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe725035740 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640df34d0 0x5586411b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe725035740 1 --2- 172.21.15.84:0/3784520693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640deb2f0 0x5586411c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe725035740 1 -- 172.21.15.84:0/3784520693 >> 172.21.15.84:0/3784520693 conn(0x558640e08300 msgr2=0x5586411c2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.932+0000 7fe725035740 1 -- 172.21.15.84:0/3784520693 shutdown_connections 2024-09-21T02:46:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.933+0000 7fe725035740 1 -- 172.21.15.84:0/3784520693 wait complete. 2024-09-21T02:46:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.933+0000 7fe725035740 1 -- start start 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.933+0000 7fe725035740 1 Processor -- start 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.933+0000 7fe725035740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.933+0000 7fe725035740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.933+0000 7fe725035740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640e141b0 0x5586411cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.933+0000 7fe725035740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181aceb0 con 0x558640e141b0 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe725035740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181ae320 con 0x558640deb2f0 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe725035740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181ad580 con 0x558640df34d0 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe725035740 10 client.0 _ll_register_callbacks cb 0x7fe7100093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:38656/0 (socket says 172.21.15.84:38656) 2024-09-21T02:46:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716000640 1 -- 172.21.15.84:0/3885716032 learned_addr learned my addr 172.21.15.84:0/3885716032 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe717400640 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640e141b0 0x5586411cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716a00640 1 -- 172.21.15.84:0/3885716032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 msgr2=0x5586411ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716a00640 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716a00640 1 -- 172.21.15.84:0/3885716032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640e141b0 msgr2=0x5586411cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716a00640 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640e141b0 0x5586411cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716a00640 1 -- 172.21.15.84:0/3885716032 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586411cb280 con 0x558640deb2f0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe716a00640 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411c9960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5586411b69c0 tx=0x7fe708023980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74df3610013462f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.934+0000 7fe700c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe700c00640 1 -- 172.21.15.84:0/3885716032 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708029040 con 0x558640deb2f0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe700c00640 1 -- 172.21.15.84:0/3885716032 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fe708004770 con 0x558640deb2f0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 1 -- 172.21.15.84:0/3885716032 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7100ad540 con 0x558640deb2f0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe700c00640 1 -- 172.21.15.84:0/3885716032 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe708004970 con 0x558640deb2f0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 10 client.25931 fetch_fsmap learned FSMap version 32 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 1 -- 172.21.15.84:0/3885716032 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5586411cc570 con 0x558640deb2f0 2024-09-21T02:46:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe700c00640 1 -- 172.21.15.84:0/3885716032 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7100ad540 con 0x558640deb2f0 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe700c00640 1 -- 172.21.15.84:0/3885716032 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fe708004d20 con 0x558640deb2f0 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 10 client.25931 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 10 client.25931 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 20 client.25931 populate_metadata read hostname 'smithi084' 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x558640da81c0 0x55864123ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 4 client.25931 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.935+0000 7fe725035740 1 -- 172.21.15.84:0/3885716032 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55864112c0b0 con 0x558640da81c0 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.936+0000 7fe716000640 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x558640da81c0 0x55864123ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.936+0000 7fe700c00640 10 client.25931 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:55.936+0000 7fe716000640 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x558640da81c0 0x55864123ea10 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8180f328ebb65396 server_cookie=cd70475756f9c903 in_seq=0 out_seq=0 2024-09-21T02:46:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.005+0000 7fe700c00640 1 -- 172.21.15.84:0/3885716032 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55864112c0b0 con 0x558640da81c0 2024-09-21T02:46:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.005+0000 7fe700c00640 10 client.25931 handle_command_reply: tid=0 2024-09-21T02:46:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.005+0000 7fe725035740 1 client.25931 shutdown 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.005+0000 7fe725035740 1 -- 172.21.15.84:0/3885716032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 msgr2=0x5586411c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.005+0000 7fe725035740 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411c9960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x5586411b69c0 tx=0x7fe708023980 comp rx=0 tx=0).stop 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.005+0000 7fe725035740 1 -- 172.21.15.84:0/3885716032 shutdown_connections 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.005+0000 7fe725035740 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558640df34d0 0x5586411ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.006+0000 7fe725035740 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x558640da81c0 0x55864123ea10 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.006+0000 7fe725035740 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558640e141b0 0x5586411cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.006+0000 7fe725035740 1 --2- 172.21.15.84:0/3885716032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x558640deb2f0 0x5586411c9960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.006+0000 7fe700c00640 0 client.25931 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.006+0000 7fe725035740 1 -- 172.21.15.84:0/3885716032 >> 172.21.15.84:0/3885716032 conn(0x558640e08300 msgr2=0x5586411bf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.006+0000 7fe725035740 1 -- 172.21.15.84:0/3885716032 shutdown_connections 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.006+0000 7fe725035740 1 -- 172.21.15.84:0/3885716032 wait complete. 2024-09-21T02:46:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.006+0000 7fe725035740 20 client.25931 trim_cache size 0 max 16384 2024-09-21T02:46:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:{ 2024-09-21T02:46:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "message": "", 2024-09-21T02:46:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout: "return_code": 0 2024-09-21T02:46:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stdout:} 2024-09-21T02:46:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 -- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6fc0b6510 msgr2=0x7fe6fc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6fc0b6510 0x7fe6fc0b8a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe7040096c0 tx=0x7fe704031510 comp rx=0 tx=0).stop 2024-09-21T02:46:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 -- 172.21.15.84:0/4012888671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe718104f10 msgr2=0x7fe71819d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe718104f10 0x7fe71819d270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe71000eb10 tx=0x7fe71000c2d0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 -- 172.21.15.84:0/4012888671 shutdown_connections 2024-09-21T02:46:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fe6fc0b6510 0x7fe6fc0b8a20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe718104f10 0x7fe71819d270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.010 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe718104570 0x7fe71819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 --2- 172.21.15.84:0/4012888671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7181034f0 0x7fe71819c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 -- 172.21.15.84:0/4012888671 >> 172.21.15.84:0/4012888671 conn(0x7fe7180fee30 msgr2=0x7fe7180755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 -- 172.21.15.84:0/4012888671 shutdown_connections 2024-09-21T02:46:56.011 INFO:teuthology.task.background_exec.ubuntu@smithi084.front.sepia.ceph.com.smithi084.stderr:2024-09-21T02:46:56.007+0000 7fe717e00640 1 -- 172.21.15.84:0/4012888671 wait complete. 2024-09-21T02:46:56.014 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:55 smithi084 ceph-mon[30747]: pgmap v534: 129 pgs: 129 active+clean; 117 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 335 op/s 2024-09-21T02:46:56.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:55 smithi090 ceph-mon[34571]: pgmap v534: 129 pgs: 129 active+clean; 117 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 335 op/s 2024-09-21T02:46:57.400 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-21T02:46:57.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T02:46:57.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:57 smithi084 ceph-mon[30747]: pgmap v535: 129 pgs: 129 active+clean; 113 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 312 op/s 2024-09-21T02:46:58.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:57 smithi172 ceph-mon[35067]: pgmap v535: 129 pgs: 129 active+clean; 113 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 312 op/s 2024-09-21T02:46:58.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:57 smithi090 ceph-mon[34571]: pgmap v535: 129 pgs: 129 active+clean; 113 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 312 op/s 2024-09-21T02:46:58.557 DEBUG:teuthology.parallel:result is None 2024-09-21T02:46:58.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T02:46:58.620 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T02:46:58.620 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T02:46:58.629 INFO:tasks.quiescer:joining Quiescers 2024-09-21T02:46:58.630 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T02:46:58.630 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:46:58.999 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:46:59.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.609+0000 7f75b9800640 1 -- 172.21.15.84:0/948211517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b41092f0 msgr2=0x7f75b4109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:59.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.609+0000 7f75b9800640 1 --2- 172.21.15.84:0/948211517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b41092f0 0x7f75b4109700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009900 tx=0x7f75a002a3f0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.610+0000 7f75b9800640 1 -- 172.21.15.84:0/948211517 shutdown_connections 2024-09-21T02:46:59.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.610+0000 7f75b9800640 1 --2- 172.21.15.84:0/948211517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75b4109c40 0x7f75b4110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.610+0000 7f75b9800640 1 --2- 172.21.15.84:0/948211517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b41092f0 0x7f75b4109700 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.610+0000 7f75b9800640 1 --2- 172.21.15.84:0/948211517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75b41039b0 0x7f75b4103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.610+0000 7f75b9800640 1 -- 172.21.15.84:0/948211517 >> 172.21.15.84:0/948211517 conn(0x7f75b40ff440 msgr2=0x7f75b4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:59.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.610+0000 7f75b9800640 1 -- 172.21.15.84:0/948211517 shutdown_connections 2024-09-21T02:46:59.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.610+0000 7f75b9800640 1 -- 172.21.15.84:0/948211517 wait complete. 2024-09-21T02:46:59.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.611+0000 7f75b9800640 1 Processor -- start 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.611+0000 7f75b9800640 1 -- start start 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.611+0000 7f75b9800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75b41039b0 0x7f75b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.611+0000 7f75b9800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75b41092f0 0x7f75b4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.611+0000 7f75b9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109c40 0x7f75b4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.611+0000 7f75b9800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f75b4113a20 con 0x7f75b4109c40 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.611+0000 7f75b9800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75b41138a0 con 0x7f75b41092f0 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.611+0000 7f75b9800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75b4113ba0 con 0x7f75b41039b0 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109c40 0x7f75b4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109c40 0x7f75b4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41072/0 (socket says 172.21.15.84:41072) 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b8e00640 1 -- 172.21.15.84:0/1025952577 learned_addr learned my addr 172.21.15.84:0/1025952577 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b3e00640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75b41039b0 0x7f75b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:59.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b3400640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75b41092f0 0x7f75b4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b8e00640 1 -- 172.21.15.84:0/1025952577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75b41039b0 msgr2=0x7f75b4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b8e00640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75b41039b0 0x7f75b4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b8e00640 1 -- 172.21.15.84:0/1025952577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75b41092f0 msgr2=0x7f75b4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b8e00640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75b41092f0 0x7f75b4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b8e00640 1 -- 172.21.15.84:0/1025952577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b41a8690 con 0x7f75b4109c40 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.612+0000 7f75b3400640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75b41092f0 0x7f75b4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.613+0000 7f75b8e00640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109c40 0x7f75b4076190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00eb10 tx=0x7f75ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.613+0000 7f75b0c00640 1 -- 172.21.15.84:0/1025952577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac004b20 con 0x7f75b4109c40 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.613+0000 7f75b0c00640 1 -- 172.21.15.84:0/1025952577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75ac004cc0 con 0x7f75b4109c40 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.613+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b41a8980 con 0x7f75b4109c40 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.613+0000 7f75b0c00640 1 -- 172.21.15.84:0/1025952577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac010720 con 0x7f75b4109c40 2024-09-21T02:46:59.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.613+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b41a8e40 con 0x7f75b4109c40 2024-09-21T02:46:59.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.614+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b4103dc0 con 0x7f75b4109c40 2024-09-21T02:46:59.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.617+0000 7f75b0c00640 1 -- 172.21.15.84:0/1025952577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f75ac0108c0 con 0x7f75b4109c40 2024-09-21T02:46:59.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.620+0000 7f75b0c00640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f75980b6510 0x7f75980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:46:59.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.620+0000 7f75b0c00640 1 -- 172.21.15.84:0/1025952577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f75ac0e7ea0 con 0x7f75b4109c40 2024-09-21T02:46:59.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.620+0000 7f75b3e00640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f75980b6510 0x7f75980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:46:59.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.621+0000 7f75b3e00640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f75980b6510 0x7f75980b8a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f75b4077160 tx=0x7f75a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:46:59.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.622+0000 7f75b0c00640 1 -- 172.21.15.84:0/1025952577 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75ac056710 con 0x7f75b4109c40 2024-09-21T02:46:59.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:46:59 smithi084 ceph-mon[30747]: pgmap v536: 129 pgs: 129 active+clean; 112 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 405 op/s 2024-09-21T02:46:59.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.848+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75b4076a10 con 0x7f75b4109c40 2024-09-21T02:46:59.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.848+0000 7f75b0c00640 1 -- 172.21.15.84:0/1025952577 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11916 (secure 0 0 0) 0x7f75b4076a10 con 0x7f75b4109c40 2024-09-21T02:46:59.850 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:46:59.850 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":32,"btime":"2024-09-21T02:46:34:361445+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:46:34.308556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:46:59.850 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 32 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f75980b6510 msgr2=0x7f75980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f75980b6510 0x7f75980b8a20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f75b4077160 tx=0x7f75a4005f90 comp rx=0 tx=0).stop 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109c40 msgr2=0x7f75b4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109c40 0x7f75b4076190 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00eb10 tx=0x7f75ac00c2d0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 shutdown_connections 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75b4109c40 0x7f75b4076190 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75b41092f0 0x7f75b4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f75980b6510 0x7f75980b8a20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 --2- 172.21.15.84:0/1025952577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75b41039b0 0x7f75b4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 >> 172.21.15.84:0/1025952577 conn(0x7f75b40ff440 msgr2=0x7f75b4101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 shutdown_connections 2024-09-21T02:46:59.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:46:59.851+0000 7f75b9800640 1 -- 172.21.15.84:0/1025952577 wait complete. 2024-09-21T02:47:00.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:46:59 smithi172 ceph-mon[35067]: pgmap v536: 129 pgs: 129 active+clean; 112 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 405 op/s 2024-09-21T02:47:00.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:46:59 smithi090 ceph-mon[34571]: pgmap v536: 129 pgs: 129 active+clean; 112 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 405 op/s 2024-09-21T02:47:00.687 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24704 quiesce db --cancel --all' 2024-09-21T02:47:00.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24704 quiesce db --cancel --all 2024-09-21T02:47:01.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:00 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1025952577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:01.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:00 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1025952577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:01.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:00 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1025952577' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:01.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 -- 172.21.15.84:0/4185314032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc1025d0 msgr2=0x7f79fc1029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 --2- 172.21.15.84:0/4185314032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc1025d0 0x7f79fc1029e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009900 tx=0x7f79ec02a480 comp rx=0 tx=0).stop 2024-09-21T02:47:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 -- 172.21.15.84:0/4185314032 shutdown_connections 2024-09-21T02:47:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 --2- 172.21.15.84:0/4185314032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79fc102f20 0x7f79fc10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 --2- 172.21.15.84:0/4185314032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79fc110180 0x7f79fc1125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 --2- 172.21.15.84:0/4185314032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc1025d0 0x7f79fc1029e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 -- 172.21.15.84:0/4185314032 >> 172.21.15.84:0/4185314032 conn(0x7f79fc079760 msgr2=0x7f79fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 -- 172.21.15.84:0/4185314032 shutdown_connections 2024-09-21T02:47:01.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.666+0000 7f7a02200640 1 -- 172.21.15.84:0/4185314032 wait complete. 2024-09-21T02:47:01.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.667+0000 7f7a02200640 1 Processor -- start 2024-09-21T02:47:01.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.667+0000 7f7a02200640 1 -- start start 2024-09-21T02:47:01.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.667+0000 7f7a02200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79fc1025d0 0x7f79fc19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.667+0000 7f7a02200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc102f20 0x7f79fc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.667+0000 7f7a02200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79fc110180 0x7f79fc1a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.667+0000 7f7a02200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc115d90 con 0x7f79fc102f20 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.667+0000 7f7a02200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc115c10 con 0x7f79fc1025d0 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.667+0000 7f7a02200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc115f10 con 0x7f79fc110180 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79faa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc102f20 0x7f79fc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79fb400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79fc1025d0 0x7f79fc19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79faa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc102f20 0x7f79fc19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47270/0 (socket says 172.21.15.84:47270) 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79faa00640 1 -- 172.21.15.84:0/2845619992 learned_addr learned my addr 172.21.15.84:0/2845619992 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79fbe00640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79fc110180 0x7f79fc1a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79faa00640 1 -- 172.21.15.84:0/2845619992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79fc110180 msgr2=0x7f79fc1a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79faa00640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79fc110180 0x7f79fc1a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79faa00640 1 -- 172.21.15.84:0/2845619992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79fc1025d0 msgr2=0x7f79fc19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79faa00640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79fc1025d0 0x7f79fc19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.668+0000 7f79faa00640 1 -- 172.21.15.84:0/2845619992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc1a2730 con 0x7f79fc102f20 2024-09-21T02:47:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.669+0000 7f79faa00640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc102f20 0x7f79fc19cd60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f79e800e9f0 tx=0x7f79e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.669+0000 7f79f3e00640 1 -- 172.21.15.84:0/2845619992 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e800cd80 con 0x7f79fc102f20 2024-09-21T02:47:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.669+0000 7f79f3e00640 1 -- 172.21.15.84:0/2845619992 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79e80054f0 con 0x7f79fc102f20 2024-09-21T02:47:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.669+0000 7f7a02200640 1 -- 172.21.15.84:0/2845619992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc1a2a20 con 0x7f79fc102f20 2024-09-21T02:47:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.669+0000 7f79f3e00640 1 -- 172.21.15.84:0/2845619992 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8010690 con 0x7f79fc102f20 2024-09-21T02:47:01.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.669+0000 7f7a02200640 1 -- 172.21.15.84:0/2845619992 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc1a9180 con 0x7f79fc102f20 2024-09-21T02:47:01.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.672+0000 7f7a08def740 1 Processor -- start 2024-09-21T02:47:01.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.672+0000 7f7a08def740 1 -- start start 2024-09-21T02:47:01.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f7a08def740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x55680408b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f7a08def740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680408b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f7a08def740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680408bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f7a08def740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556804002ff0 con 0x556803ce52d0 2024-09-21T02:47:01.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f7a08def740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556803ff2420 con 0x556803cc45f0 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f7a08def740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556803ff6230 con 0x556803cbc410 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79f3e00640 1 -- 172.21.15.84:0/2845619992 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f79e8004f30 con 0x7f79fc102f20 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79fbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x55680408b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79fbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x55680408b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47286/0 (socket says 172.21.15.84:47286) 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79fbe00640 1 -- 172.21.15.84:0/3679941482 learned_addr learned my addr 172.21.15.84:0/3679941482 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79fb400640 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680408b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79faa00640 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680408bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79fbe00640 1 -- 172.21.15.84:0/3679941482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 msgr2=0x55680408b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79fbe00640 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680408b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.673+0000 7f79fbe00640 1 -- 172.21.15.84:0/3679941482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 msgr2=0x55680408bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.674+0000 7f79fbe00640 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680408bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.674+0000 7f79fbe00640 1 -- 172.21.15.84:0/3679941482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556803d508b0 con 0x556803ce52d0 2024-09-21T02:47:01.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.674+0000 7f79fb400640 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680408b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:01.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.674+0000 7f79faa00640 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680408bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:47:01.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.674+0000 7f79fbe00640 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x55680408b290 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009f90 tx=0x7f79f4010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbfb61b739e8cde server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.674+0000 7f79e7e00640 1 -- 172.21.15.84:0/3679941482 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f4011700 con 0x556803ce52d0 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.674+0000 7f79e7e00640 1 -- 172.21.15.84:0/3679941482 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79f4011d70 con 0x556803ce52d0 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.674+0000 7f79e7e00640 1 -- 172.21.15.84:0/3679941482 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f4018380 con 0x556803ce52d0 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f7a08def740 1 -- 172.21.15.84:0/3679941482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 msgr2=0x55680408b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f7a08def740 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x55680408b290 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009f90 tx=0x7f79f4010860 comp rx=0 tx=0).stop 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f79f3e00640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79e00b6590 0x7f79e00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f7a08def740 1 -- 172.21.15.84:0/3679941482 shutdown_connections 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f7a08def740 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680408b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f7a08def740 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680408bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f7a08def740 1 --2- 172.21.15.84:0/3679941482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x55680408b290 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f7a08def740 1 -- 172.21.15.84:0/3679941482 >> 172.21.15.84:0/3679941482 conn(0x556803cd96c0 msgr2=0x556804089180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f79f3e00640 1 -- 172.21.15.84:0/2845619992 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f79e80e7760 con 0x7f79fc102f20 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f7a08def740 1 -- 172.21.15.84:0/3679941482 shutdown_connections 2024-09-21T02:47:01.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.675+0000 7f79fb400640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79e00b6590 0x7f79e00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.676+0000 7f7a08def740 1 -- 172.21.15.84:0/3679941482 wait complete. 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.676+0000 7f7a08def740 1 -- start start 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.676+0000 7f79fb400640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79e00b6590 0x7f79e00b8aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009230 tx=0x7f79ec0058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.676+0000 7f7a08def740 1 Processor -- start 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f7a08def740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804096870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f7a08def740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cc45f0 0x556804096db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f7a08def740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x5568040972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f7a08def740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556803e53810 con 0x556803ce52d0 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f7a08def740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x556803f8d550 con 0x556803cbc410 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f7a08def740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556804099a70 con 0x556803cc45f0 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f7a08def740 10 client.0 _ll_register_callbacks cb 0x556803f9d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f79fbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x5568040972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f79fb400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804096870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f79faa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cc45f0 0x556804096db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f79fb400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804096870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58730/0 (socket says 172.21.15.84:58730) 2024-09-21T02:47:01.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.677+0000 7f79fb400640 1 -- 172.21.15.84:0/2454695750 learned_addr learned my addr 172.21.15.84:0/2454695750 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:01.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79faa00640 1 -- 172.21.15.84:0/2454695750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 msgr2=0x556804096870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:01.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79faa00640 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804096870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79faa00640 1 -- 172.21.15.84:0/2454695750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 msgr2=0x5568040972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:01.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79faa00640 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x5568040972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79faa00640 1 -- 172.21.15.84:0/2454695750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556803f7f200 con 0x556803cc45f0 2024-09-21T02:47:01.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79faa00640 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cc45f0 0x556804096db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f79e80e4e70 tx=0x7f79e80ad390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f65bbf322975757 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:01.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T02:47:01.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79e4c00640 1 -- 172.21.15.84:0/2454695750 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80ad010 con 0x556803cc45f0 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f7a08def740 1 -- 172.21.15.84:0/2454695750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79f4011d70 con 0x556803cc45f0 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.678+0000 7f79e4c00640 1 -- 172.21.15.84:0/2454695750 <== mon.1 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f79e80e7430 con 0x556803cc45f0 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f79e4c00640 1 -- 172.21.15.84:0/2454695750 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f79e80adc00 con 0x556803cc45f0 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f7a08def740 10 client.25981 fetch_fsmap learned FSMap version 32 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f7a08def740 1 -- 172.21.15.84:0/2454695750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5568040a5750 con 0x556803cc45f0 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f79e4c00640 1 -- 172.21.15.84:0/2454695750 <== mon.1 v2:172.21.15.172:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79f4011d70 con 0x556803cc45f0 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f79e4c00640 1 -- 172.21.15.84:0/2454695750 <== mon.1 v2:172.21.15.172:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f79e80ac1d0 con 0x556803cc45f0 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f7a08def740 10 client.25981 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f7a08def740 10 client.25981 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f7a08def740 20 client.25981 populate_metadata read hostname 'smithi084' 2024-09-21T02:47:01.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f7a08def740 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556803ca3c50 0x5568040a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f7a08def740 4 client.25981 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T02:47:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.679+0000 7f7a08def740 1 -- 172.21.15.84:0/2454695750 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556804004f40 con 0x556803ca3c50 2024-09-21T02:47:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.680+0000 7f79fb400640 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556803ca3c50 0x5568040a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.680+0000 7f79fb400640 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556803ca3c50 0x5568040a8c20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84c6050cb5d52ed9 server_cookie=a27924db74e36c26 in_seq=0 out_seq=0 2024-09-21T02:47:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.680+0000 7f79e4c00640 10 client.25981 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:47:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f79e4c00640 1 -- 172.21.15.84:0/2454695750 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556804004f40 con 0x556803ca3c50 2024-09-21T02:47:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f79e4c00640 10 client.25981 handle_command_reply: tid=0 2024-09-21T02:47:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 client.25981 shutdown 2024-09-21T02:47:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 -- 172.21.15.84:0/2454695750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cc45f0 msgr2=0x556804096db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cc45f0 0x556804096db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f79e80e4e70 tx=0x7f79e80ad390 comp rx=0 tx=0).stop 2024-09-21T02:47:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 -- 172.21.15.84:0/2454695750 shutdown_connections 2024-09-21T02:47:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cc45f0 0x556804096db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556803ca3c50 0x5568040a8c20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x5568040972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 --2- 172.21.15.84:0/2454695750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804096870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f7a08def740 1 -- 172.21.15.84:0/2454695750 >> 172.21.15.84:0/2454695750 conn(0x556803cd96c0 msgr2=0x55680408e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.681+0000 7f79e4c00640 0 client.25981 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:47:01.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.682+0000 7f7a08def740 1 -- 172.21.15.84:0/2454695750 shutdown_connections 2024-09-21T02:47:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.682+0000 7f7a08def740 1 -- 172.21.15.84:0/2454695750 wait complete. 2024-09-21T02:47:01.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.682+0000 7f7a08def740 20 client.25981 trim_cache size 0 max 16384 2024-09-21T02:47:01.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.699+0000 7f7a08def740 1 Processor -- start 2024-09-21T02:47:01.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f7a08def740 1 -- start start 2024-09-21T02:47:01.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f7a08def740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804098860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f7a08def740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803cc45f0 0x556804093a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f7a08def740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803ce52d0 0x556804093fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f7a08def740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc012490 con 0x556803cc45f0 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f7a08def740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc00fcd0 con 0x556803cbc410 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f7a08def740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc00db20 con 0x556803ce52d0 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f79faa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803cc45f0 0x556804093a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f79faa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803cc45f0 0x556804093a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47292/0 (socket says 172.21.15.84:47292) 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f79faa00640 1 -- 172.21.15.84:0/3774997489 learned_addr learned my addr 172.21.15.84:0/3774997489 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f79fb400640 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804098860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.700+0000 7f79fbe00640 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803ce52d0 0x556804093fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79faa00640 1 -- 172.21.15.84:0/3774997489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803ce52d0 msgr2=0x556804093fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79faa00640 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803ce52d0 0x556804093fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79faa00640 1 -- 172.21.15.84:0/3774997489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 msgr2=0x556804098860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:01.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79faa00640 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804098860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79faa00640 1 -- 172.21.15.84:0/3774997489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55680408f3a0 con 0x556803cc45f0 2024-09-21T02:47:01.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79fb400640 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804098860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:01.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79faa00640 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803cc45f0 0x556804093a60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f79e8005820 tx=0x7f79e80ad400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402e43baba094bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:01.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79e7400640 1 -- 172.21.15.84:0/3774997489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80acc70 con 0x556803cc45f0 2024-09-21T02:47:01.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79e7400640 1 -- 172.21.15.84:0/3774997489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79e80ad010 con 0x556803cc45f0 2024-09-21T02:47:01.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.701+0000 7f79e7400640 1 -- 172.21.15.84:0/3774997489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80b31f0 con 0x556803cc45f0 2024-09-21T02:47:01.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 -- 172.21.15.84:0/3774997489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803cc45f0 msgr2=0x556804093a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803cc45f0 0x556804093a60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f79e8005820 tx=0x7f79e80ad400 comp rx=0 tx=0).stop 2024-09-21T02:47:01.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 -- 172.21.15.84:0/3774997489 shutdown_connections 2024-09-21T02:47:01.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803ce52d0 0x556804093fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803cc45f0 0x556804093a60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 --2- 172.21.15.84:0/3774997489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cbc410 0x556804098860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 -- 172.21.15.84:0/3774997489 >> 172.21.15.84:0/3774997489 conn(0x556803cd96c0 msgr2=0x5568040a2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 -- 172.21.15.84:0/3774997489 shutdown_connections 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.702+0000 7f7a08def740 1 -- 172.21.15.84:0/3774997489 wait complete. 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.703+0000 7f7a08def740 1 -- start start 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.703+0000 7f7a08def740 1 Processor -- start 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.703+0000 7f7a08def740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680409d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.703+0000 7f7a08def740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680409da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f7a08def740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x556804112680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f7a08def740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc00e190 con 0x556803ce52d0 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f7a08def740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc00f600 con 0x556803cc45f0 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f7a08def740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc00e860 con 0x556803cbc410 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f7a08def740 10 client.0 _ll_register_callbacks cb 0x7f79e80a93a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79fbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x556804112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79faa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680409da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79fbe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x556804112680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47296/0 (socket says 172.21.15.84:47296) 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79fbe00640 1 -- 172.21.15.84:0/3638847551 learned_addr learned my addr 172.21.15.84:0/3638847551 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79fb400640 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680409d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79faa00640 1 -- 172.21.15.84:0/3638847551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 msgr2=0x55680409d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79faa00640 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680409d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79faa00640 1 -- 172.21.15.84:0/3638847551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 msgr2=0x556804112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79faa00640 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x556804112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.704+0000 7f79faa00640 1 -- 172.21.15.84:0/3638847551 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556804112c10 con 0x556803cc45f0 2024-09-21T02:47:01.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f79faa00640 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680409da30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79e80ac4c0 tx=0x7f79e8004d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c4bfef0f16e5986 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:01.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f79e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-09-21T02:47:01.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f79e4c00640 1 -- 172.21.15.84:0/3638847551 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80cc070 con 0x556803cc45f0 2024-09-21T02:47:01.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f79e4c00640 1 -- 172.21.15.84:0/3638847551 <== mon.2 v2:172.21.15.90:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f79e80c8d50 con 0x556803cc45f0 2024-09-21T02:47:01.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f7a08def740 1 -- 172.21.15.84:0/3638847551 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79e80ad010 con 0x556803cc45f0 2024-09-21T02:47:01.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f79e4c00640 1 -- 172.21.15.84:0/3638847551 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f79e80acc70 con 0x556803cc45f0 2024-09-21T02:47:01.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f7a08def740 10 client.25955 fetch_fsmap learned FSMap version 32 2024-09-21T02:47:01.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f7a08def740 1 -- 172.21.15.84:0/3638847551 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556804113e70 con 0x556803cc45f0 2024-09-21T02:47:01.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.705+0000 7f79e4c00640 1 -- 172.21.15.84:0/3638847551 <== mon.2 v2:172.21.15.90:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79e80ad010 con 0x556803cc45f0 2024-09-21T02:47:01.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f79e4c00640 1 -- 172.21.15.84:0/3638847551 <== mon.2 v2:172.21.15.90:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f79e80cf020 con 0x556803cc45f0 2024-09-21T02:47:01.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f7a08def740 10 client.25955 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T02:47:01.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f7a08def740 10 client.25955 resolve_mds: validated gid 24704 aka daemon mds.b 2024-09-21T02:47:01.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f7a08def740 20 client.25955 populate_metadata read hostname 'smithi084' 2024-09-21T02:47:01.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f7a08def740 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556803c79000 0x556804116440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:01.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f7a08def740 4 client.25955 mds_command: new command op to 24704 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f7a08def740 1 -- 172.21.15.84:0/3638847551 --> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5568040009f0 con 0x556803c79000 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f79fb400640 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556803c79000 0x556804116440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f79fb400640 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556803c79000 0x556804116440 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dadfbfbb43cdcfb3 server_cookie=1b84aa1c57661f9e in_seq=0 out_seq=0 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.706+0000 7f79e4c00640 10 client.25955 ms_handle_connect on v2:172.21.15.90:6838/3427873852 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f79e4c00640 1 -- 172.21.15.84:0/3638847551 <== mds.0 v2:172.21.15.90:6838/3427873852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5568040009f0 con 0x556803c79000 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f79e4c00640 10 client.25955 handle_command_reply: tid=0 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 client.25955 shutdown 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 -- 172.21.15.84:0/3638847551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 msgr2=0x55680409da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680409da30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f79e80ac4c0 tx=0x7f79e8004d50 comp rx=0 tx=0).stop 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 -- 172.21.15.84:0/3638847551 shutdown_connections 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.90:6838/3427873852,v1:172.21.15.90:6839/3427873852] conn(0x556803c79000 0x556804116440 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556803ce52d0 0x556804112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556803cc45f0 0x55680409da30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 --2- 172.21.15.84:0/3638847551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556803cbc410 0x55680409d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 -- 172.21.15.84:0/3638847551 >> 172.21.15.84:0/3638847551 conn(0x556803cd96c0 msgr2=0x5568040a2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f79e4c00640 0 client.25955 ms_handle_reset on v2:172.21.15.90:6838/3427873852 2024-09-21T02:47:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 -- 172.21.15.84:0/3638847551 shutdown_connections 2024-09-21T02:47:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.707+0000 7f7a08def740 1 -- 172.21.15.84:0/3638847551 wait complete. 2024-09-21T02:47:01.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a08def740 20 client.25955 trim_cache size 0 max 16384 2024-09-21T02:47:01.714 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:47:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 32, 2024-09-21T02:47:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 24704, 2024-09-21T02:47:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 16, 2024-09-21T02:47:01.715 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": {} 2024-09-21T02:47:01.715 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 -- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79e00b6590 msgr2=0x7f79e00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79e00b6590 0x7f79e00b8aa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009230 tx=0x7f79ec0058d0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 -- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc102f20 msgr2=0x7f79fc19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc102f20 0x7f79fc19cd60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f79e800e9f0 tx=0x7f79e800edf0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 -- 172.21.15.84:0/2845619992 shutdown_connections 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f79e00b6590 0x7f79e00b8aa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79fc110180 0x7f79fc1a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79fc102f20 0x7f79fc19cd60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 --2- 172.21.15.84:0/2845619992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79fc1025d0 0x7f79fc19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.708+0000 7f7a02200640 1 -- 172.21.15.84:0/2845619992 >> 172.21.15.84:0/2845619992 conn(0x7f79fc079760 msgr2=0x7f79fc109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.709+0000 7f7a02200640 1 -- 172.21.15.84:0/2845619992 shutdown_connections 2024-09-21T02:47:01.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:01.709+0000 7f7a02200640 1 -- 172.21.15.84:0/2845619992 wait complete. 2024-09-21T02:47:01.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:01 smithi084 ceph-mon[30747]: pgmap v537: 129 pgs: 129 active+clean; 112 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 325 op/s 2024-09-21T02:47:02.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:01 smithi172 ceph-mon[35067]: pgmap v537: 129 pgs: 129 active+clean; 112 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 325 op/s 2024-09-21T02:47:02.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:01 smithi090 ceph-mon[34571]: pgmap v537: 129 pgs: 129 active+clean; 112 MiB data, 1017 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 325 op/s 2024-09-21T02:47:02.662 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T02:47:02.663 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T02:47:02.673 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:47:02.684 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T02:47:02.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T02:47:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 -- 172.21.15.84:0/1721270145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cb4104530 msgr2=0x7f3cb4104940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/1721270145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cb4104530 0x7f3cb4104940 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009900 tx=0x7f3ca002a410 comp rx=0 tx=0).stop 2024-09-21T02:47:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 -- 172.21.15.84:0/1721270145 shutdown_connections 2024-09-21T02:47:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/1721270145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb4104ed0 0x7f3cb410b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/1721270145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cb4104530 0x7f3cb4104940 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/1721270145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb41034b0 0x7f3cb4103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 -- 172.21.15.84:0/1721270145 >> 172.21.15.84:0/1721270145 conn(0x7f3cb40fedf0 msgr2=0x7f3cb41012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 -- 172.21.15.84:0/1721270145 shutdown_connections 2024-09-21T02:47:02.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.942+0000 7f3cb3e00640 1 -- 172.21.15.84:0/1721270145 wait complete. 2024-09-21T02:47:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.943+0000 7f3cb3e00640 1 Processor -- start 2024-09-21T02:47:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.943+0000 7f3cb3e00640 1 -- start start 2024-09-21T02:47:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.943+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb41034b0 0x7f3cb4076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cb4104530 0x7f3cb4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb4104ed0 0x7f3cb4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb3e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb410f2a0 con 0x7f3cb4104530 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb3e00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb410f120 con 0x7f3cb41034b0 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb3e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb410f420 con 0x7f3cb4104ed0 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb41034b0 0x7f3cb4076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb41034b0 0x7f3cb4076e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58776/0 (socket says 172.21.15.84:58776) 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 -- 172.21.15.84:0/2642694663 learned_addr learned my addr 172.21.15.84:0/2642694663 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2000640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cb4104530 0x7f3cb4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb3400640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb4104ed0 0x7f3cb4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 -- 172.21.15.84:0/2642694663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb4104ed0 msgr2=0x7f3cb4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb4104ed0 0x7f3cb4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 -- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cb4104530 msgr2=0x7f3cb4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cb4104530 0x7f3cb4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 -- 172.21.15.84:0/2642694663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb4076380 con 0x7f3cb41034b0 2024-09-21T02:47:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.944+0000 7f3cb2a00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb41034b0 0x7f3cb4076e50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400e9f0 tx=0x7f3ca400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.945+0000 7f3cab400640 1 -- 172.21.15.84:0/2642694663 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400cd80 con 0x7f3cb41034b0 2024-09-21T02:47:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.945+0000 7f3cab400640 1 -- 172.21.15.84:0/2642694663 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3ca4010900 con 0x7f3cb41034b0 2024-09-21T02:47:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.945+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb41a3e60 con 0x7f3cb41034b0 2024-09-21T02:47:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.945+0000 7f3cab400640 1 -- 172.21.15.84:0/2642694663 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4018920 con 0x7f3cb41034b0 2024-09-21T02:47:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.945+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb41a4270 con 0x7f3cb41034b0 2024-09-21T02:47:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.946+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb4103920 con 0x7f3cb41034b0 2024-09-21T02:47:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.948+0000 7f3cab400640 1 -- 172.21.15.84:0/2642694663 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f3ca4010ab0 con 0x7f3cb41034b0 2024-09-21T02:47:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.950+0000 7f3cab400640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3c980b6510 0x7f3c980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.950+0000 7f3cab400640 1 -- 172.21.15.84:0/2642694663 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f3ca40e7fa0 con 0x7f3cb41034b0 2024-09-21T02:47:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.950+0000 7f3cb2000640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3c980b6510 0x7f3c980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.951+0000 7f3cb2000640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3c980b6510 0x7f3c980b8a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0004770 tx=0x7f3ca0031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:02.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:02.952+0000 7f3cab400640 1 -- 172.21.15.84:0/2642694663 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ca40ae440 con 0x7f3cb41034b0 2024-09-21T02:47:03.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.148+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cb410a680 con 0x7f3cb41034b0 2024-09-21T02:47:03.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.150+0000 7f3cab400640 1 -- 172.21.15.84:0/2642694663 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24819 (secure 0 0 0) 0x7f3cb410a680 con 0x7f3cb41034b0 2024-09-21T02:47:03.152 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:47:03.152 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:41:44.334281+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:47:03.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.152+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3c980b6510 msgr2=0x7f3c980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.152+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3c980b6510 0x7f3c980b8a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0004770 tx=0x7f3ca0031510 comp rx=0 tx=0).stop 2024-09-21T02:47:03.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.152+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb41034b0 msgr2=0x7f3cb4076e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.152+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb41034b0 0x7f3cb4076e50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400e9f0 tx=0x7f3ca400eeb0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.152+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 shutdown_connections 2024-09-21T02:47:03.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.152+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f3c980b6510 0x7f3c980b8a20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.153+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb4104ed0 0x7f3cb4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.153+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3cb4104530 0x7f3cb4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.153+0000 7f3cb3e00640 1 --2- 172.21.15.84:0/2642694663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cb41034b0 0x7f3cb4076e50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.153+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 >> 172.21.15.84:0/2642694663 conn(0x7f3cb40fedf0 msgr2=0x7f3cb4107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:03.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.153+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 shutdown_connections 2024-09-21T02:47:03.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.153+0000 7f3cb3e00640 1 -- 172.21.15.84:0/2642694663 wait complete. 2024-09-21T02:47:03.177 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T02:34:41.799617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T02:39:42.063636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T02:39:44.892150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T02:39:54.907352+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T02:47:03.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T02:47:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 -- 172.21.15.84:0/3705093980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 msgr2=0x7f79a41038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 --2- 172.21.15.84:0/3705093980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 0x7f79a41038f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7998009ca0 tx=0x7f799802a8c0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 -- 172.21.15.84:0/3705093980 shutdown_connections 2024-09-21T02:47:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 --2- 172.21.15.84:0/3705093980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79a4104ea0 0x7f79a410b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 --2- 172.21.15.84:0/3705093980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79a4104500 0x7f79a4104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 --2- 172.21.15.84:0/3705093980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 0x7f79a41038f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 -- 172.21.15.84:0/3705093980 >> 172.21.15.84:0/3705093980 conn(0x7f79a40feda0 msgr2=0x7f79a4101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 -- 172.21.15.84:0/3705093980 shutdown_connections 2024-09-21T02:47:03.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.396+0000 7f79aa800640 1 -- 172.21.15.84:0/3705093980 wait complete. 2024-09-21T02:47:03.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.397+0000 7f79aa800640 1 Processor -- start 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79aa800640 1 -- start start 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79aa800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 0x7f79a419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79aa800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79a4104500 0x7f79a419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79aa800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79a4104ea0 0x7f79a419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79aa800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79a410f220 con 0x7f79a4103480 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79aa800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f79a410f0a0 con 0x7f79a4104ea0 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79aa800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79a410f3a0 con 0x7f79a4104500 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79a9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 0x7f79a419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79a8a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79a4104500 0x7f79a419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79a9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 0x7f79a419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47336/0 (socket says 172.21.15.84:47336) 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79a9400640 1 -- 172.21.15.84:0/2692862955 learned_addr learned my addr 172.21.15.84:0/2692862955 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.398+0000 7f79a9e00640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79a4104ea0 0x7f79a419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:03.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a8a00640 1 -- 172.21.15.84:0/2692862955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79a4104ea0 msgr2=0x7f79a419d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a8a00640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79a4104ea0 0x7f79a419d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a8a00640 1 -- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 msgr2=0x7f79a419bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a8a00640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 0x7f79a419bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a8a00640 1 -- 172.21.15.84:0/2692862955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a419d9e0 con 0x7f79a4104500 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a9400640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 0x7f79a419bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a8a00640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79a4104500 0x7f79a419c610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f799000e9f0 tx=0x7f799000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a2000640 1 -- 172.21.15.84:0/2692862955 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799000ccc0 con 0x7f79a4104500 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a419dcd0 con 0x7f79a4104500 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a2000640 1 -- 172.21.15.84:0/2692862955 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7990010900 con 0x7f79a4104500 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79a2000640 1 -- 172.21.15.84:0/2692862955 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990018920 con 0x7f79a4104500 2024-09-21T02:47:03.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.399+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a41a43c0 con 0x7f79a4104500 2024-09-21T02:47:03.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.400+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a41038f0 con 0x7f79a4104500 2024-09-21T02:47:03.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.403+0000 7f79a2000640 1 -- 172.21.15.84:0/2692862955 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f7990010ab0 con 0x7f79a4104500 2024-09-21T02:47:03.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.405+0000 7f79a2000640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f798c0b6510 0x7f798c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:03.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.405+0000 7f79a2000640 1 -- 172.21.15.84:0/2692862955 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f79900e7d60 con 0x7f79a4104500 2024-09-21T02:47:03.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.406+0000 7f79a9400640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f798c0b6510 0x7f798c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:03.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.406+0000 7f79a9400640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f798c0b6510 0x7f798c0b8a20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f79980094e0 tx=0x7f7998033000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:03.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.406+0000 7f79a2000640 1 -- 172.21.15.84:0/2692862955 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79900b25e0 con 0x7f79a4104500 2024-09-21T02:47:03.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.594+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f79a41a4650 con 0x7f79a4104500 2024-09-21T02:47:03.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.596+0000 7f79a2000640 1 -- 172.21.15.84:0/2692862955 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f79900b7520 con 0x7f79a4104500 2024-09-21T02:47:03.597 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-09-21T02:47:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f798c0b6510 msgr2=0x7f798c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f798c0b6510 0x7f798c0b8a20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f79980094e0 tx=0x7f7998033000 comp rx=0 tx=0).stop 2024-09-21T02:47:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79a4104500 msgr2=0x7f79a419c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79a4104500 0x7f79a419c610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f799000e9f0 tx=0x7f799000eeb0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 shutdown_connections 2024-09-21T02:47:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f798c0b6510 0x7f798c0b8a20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79a4104500 0x7f79a419c610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f79a4104ea0 0x7f79a419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 --2- 172.21.15.84:0/2692862955 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79a4103480 0x7f79a419bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.598+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 >> 172.21.15.84:0/2692862955 conn(0x7f79a40feda0 msgr2=0x7f79a40755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.599+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 shutdown_connections 2024-09-21T02:47:03.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.599+0000 7f79aa800640 1 -- 172.21.15.84:0/2692862955 wait complete. 2024-09-21T02:47:03.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T02:47:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 -- 172.21.15.84:0/1364831436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13541025a0 msgr2=0x7f1354102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 --2- 172.21.15.84:0/1364831436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13541025a0 0x7f1354102a10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1344009ca0 tx=0x7f134402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 -- 172.21.15.84:0/1364831436 shutdown_connections 2024-09-21T02:47:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 --2- 172.21.15.84:0/1364831436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1354103620 0x7f1354103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 --2- 172.21.15.84:0/1364831436 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1354103fc0 0x7f135410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 --2- 172.21.15.84:0/1364831436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13541025a0 0x7f1354102a10 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 -- 172.21.15.84:0/1364831436 >> 172.21.15.84:0/1364831436 conn(0x7f13540fdee0 msgr2=0x7f1354100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 -- 172.21.15.84:0/1364831436 shutdown_connections 2024-09-21T02:47:03.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.846+0000 7f135b400640 1 -- 172.21.15.84:0/1364831436 wait complete. 2024-09-21T02:47:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.847+0000 7f135b400640 1 Processor -- start 2024-09-21T02:47:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f135b400640 1 -- start start 2024-09-21T02:47:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f135b400640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13541025a0 0x7f1354106190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f135b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1354103620 0x7f1354104a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:03.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f135b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1354103fc0 0x7f1354104f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f135b400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f135410e340 con 0x7f1354103620 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f135b400640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f135410e1c0 con 0x7f13541025a0 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f135b400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f135410e4c0 con 0x7f1354103fc0 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f134be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1354103620 0x7f1354104a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f1358a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13541025a0 0x7f1354106190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f134be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1354103620 0x7f1354104a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47354/0 (socket says 172.21.15.84:47354) 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f134be00640 1 -- 172.21.15.84:0/2973484576 learned_addr learned my addr 172.21.15.84:0/2973484576 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.848+0000 7f1359400640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1354103fc0 0x7f1354104f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f134be00640 1 -- 172.21.15.84:0/2973484576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1354103fc0 msgr2=0x7f1354104f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f134be00640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1354103fc0 0x7f1354104f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f134be00640 1 -- 172.21.15.84:0/2973484576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13541025a0 msgr2=0x7f1354106190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f134be00640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13541025a0 0x7f1354106190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f134be00640 1 -- 172.21.15.84:0/2973484576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13541056c0 con 0x7f1354103620 2024-09-21T02:47:03.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f134be00640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1354103620 0x7f1354104a50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f133c00e9f0 tx=0x7f133c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:03.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f1352000640 1 -- 172.21.15.84:0/2973484576 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c00cd80 con 0x7f1354103620 2024-09-21T02:47:03.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13541a4090 con 0x7f1354103620 2024-09-21T02:47:03.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f1352000640 1 -- 172.21.15.84:0/2973484576 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f133c010900 con 0x7f1354103620 2024-09-21T02:47:03.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.849+0000 7f1352000640 1 -- 172.21.15.84:0/2973484576 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c0188d0 con 0x7f1354103620 2024-09-21T02:47:03.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.850+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13541a4530 con 0x7f1354103620 2024-09-21T02:47:03.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.851+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13541a4790 con 0x7f1354103620 2024-09-21T02:47:03.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.853+0000 7f1352000640 1 -- 172.21.15.84:0/2973484576 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f133c010ab0 con 0x7f1354103620 2024-09-21T02:47:03.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.855+0000 7f1352000640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13380b6510 0x7f13380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:03.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.855+0000 7f1352000640 1 -- 172.21.15.84:0/2973484576 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f133c0e7f80 con 0x7f1354103620 2024-09-21T02:47:03.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.855+0000 7f1358a00640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13380b6510 0x7f13380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:03.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.855+0000 7f1358a00640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13380b6510 0x7f13380b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1344000f80 tx=0x7f1344009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:03.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:03.857+0000 7f1352000640 1 -- 172.21.15.84:0/2973484576 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f133c0b2800 con 0x7f1354103620 2024-09-21T02:47:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:03 smithi172 ceph-mon[35067]: pgmap v538: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-09-21T02:47:04.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:03 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2642694663' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:47:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:03 smithi084 ceph-mon[30747]: pgmap v538: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-09-21T02:47:04.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:03 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2642694663' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:47:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:03 smithi090 ceph-mon[34571]: pgmap v538: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-09-21T02:47:04.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:03 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2642694663' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:47:04.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.044+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f13541a4960 con 0x7f1354103620 2024-09-21T02:47:04.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.045+0000 7f1352000640 1 -- 172.21.15.84:0/2973484576 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f133c0b7740 con 0x7f1354103620 2024-09-21T02:47:04.047 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-09-21T02:47:04.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13380b6510 msgr2=0x7f13380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13380b6510 0x7f13380b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1344000f80 tx=0x7f1344009360 comp rx=0 tx=0).stop 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1354103620 msgr2=0x7f1354104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1354103620 0x7f1354104a50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f133c00e9f0 tx=0x7f133c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 shutdown_connections 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f13380b6510 0x7f13380b8a20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1354103fc0 0x7f1354104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1354103620 0x7f1354104a50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 --2- 172.21.15.84:0/2973484576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13541025a0 0x7f1354106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 >> 172.21.15.84:0/2973484576 conn(0x7f13540fdee0 msgr2=0x7f135406b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 shutdown_connections 2024-09-21T02:47:04.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.047+0000 7f135b400640 1 -- 172.21.15.84:0/2973484576 wait complete. 2024-09-21T02:47:04.075 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T02:47:04.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 -- 172.21.15.84:0/2847004176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c106920 msgr2=0x7f722c106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 --2- 172.21.15.84:0/2847004176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c106920 0x7f722c106d30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7218009900 tx=0x7f721802a410 comp rx=0 tx=0).stop 2024-09-21T02:47:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 -- 172.21.15.84:0/2847004176 shutdown_connections 2024-09-21T02:47:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 --2- 172.21.15.84:0/2847004176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f722c1072c0 0x7f722c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 --2- 172.21.15.84:0/2847004176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c106920 0x7f722c106d30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 --2- 172.21.15.84:0/2847004176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c1058a0 0x7f722c105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 -- 172.21.15.84:0/2847004176 >> 172.21.15.84:0/2847004176 conn(0x7f722c101220 msgr2=0x7f722c103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 -- 172.21.15.84:0/2847004176 shutdown_connections 2024-09-21T02:47:04.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.303+0000 7f7233c00640 1 -- 172.21.15.84:0/2847004176 wait complete. 2024-09-21T02:47:04.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.304+0000 7f7233c00640 1 Processor -- start 2024-09-21T02:47:04.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.304+0000 7f7233c00640 1 -- start start 2024-09-21T02:47:04.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.304+0000 7f7233c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f722c1058a0 0x7f722c19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:04.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.304+0000 7f7233c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c106920 0x7f722c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.304+0000 7f7233c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c1072c0 0x7f722c19d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.304+0000 7f7233c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f722c111640 con 0x7f722c1072c0 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.304+0000 7f7233c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f722c1114c0 con 0x7f722c1058a0 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.304+0000 7f7233c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f722c1117c0 con 0x7f722c106920 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f722c1058a0 0x7f722c19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c1072c0 0x7f722c19d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f722be00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c106920 0x7f722c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f722c1058a0 0x7f722c19c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58840/0 (socket says 172.21.15.84:58840) 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231200640 1 -- 172.21.15.84:0/3071479552 learned_addr learned my addr 172.21.15.84:0/3071479552 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231c00640 1 -- 172.21.15.84:0/3071479552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c106920 msgr2=0x7f722c19c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c106920 0x7f722c19c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231c00640 1 -- 172.21.15.84:0/3071479552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f722c1058a0 msgr2=0x7f722c19c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f722c1058a0 0x7f722c19c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231c00640 1 -- 172.21.15.84:0/3071479552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722c19dc60 con 0x7f722c1072c0 2024-09-21T02:47:04.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231200640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f722c1058a0 0x7f722c19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:04.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.305+0000 7f7231c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c1072c0 0x7f722c19d440 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f722400ec50 tx=0x7f722400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:04.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.306+0000 7f7229600640 1 -- 172.21.15.84:0/3071479552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224003b70 con 0x7f722c1072c0 2024-09-21T02:47:04.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.306+0000 7f7229600640 1 -- 172.21.15.84:0/3071479552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7224003d10 con 0x7f722c1072c0 2024-09-21T02:47:04.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.306+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722c19df50 con 0x7f722c1072c0 2024-09-21T02:47:04.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.306+0000 7f7229600640 1 -- 172.21.15.84:0/3071479552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72240108b0 con 0x7f722c1072c0 2024-09-21T02:47:04.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.306+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722c1a4640 con 0x7f722c1072c0 2024-09-21T02:47:04.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.307+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f722c105d10 con 0x7f722c1072c0 2024-09-21T02:47:04.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.310+0000 7f7229600640 1 -- 172.21.15.84:0/3071479552 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f7224004b40 con 0x7f722c1072c0 2024-09-21T02:47:04.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.311+0000 7f7229600640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72140b6510 0x7f72140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:04.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.312+0000 7f7229600640 1 -- 172.21.15.84:0/3071479552 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f72240e7cc0 con 0x7f722c1072c0 2024-09-21T02:47:04.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.312+0000 7f7231200640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72140b6510 0x7f72140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.313+0000 7f7231200640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72140b6510 0x7f72140b8a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7220011500 tx=0x7f7220005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:04.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.313+0000 7f7229600640 1 -- 172.21.15.84:0/3071479552 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72240ae1f0 con 0x7f722c1072c0 2024-09-21T02:47:04.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.499+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f722c02e640 con 0x7f722c1072c0 2024-09-21T02:47:04.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.500+0000 7f7229600640 1 -- 172.21.15.84:0/3071479552 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f72240b25d0 con 0x7f722c1072c0 2024-09-21T02:47:04.502 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-09-21T02:47:04.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72140b6510 msgr2=0x7f72140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72140b6510 0x7f72140b8a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7220011500 tx=0x7f7220005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c1072c0 msgr2=0x7f722c19d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c1072c0 0x7f722c19d440 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f722400ec50 tx=0x7f722400c6a0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 shutdown_connections 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f72140b6510 0x7f72140b8a20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f722c106920 0x7f722c19c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f722c1072c0 0x7f722c19d440 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 --2- 172.21.15.84:0/3071479552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f722c1058a0 0x7f722c19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 >> 172.21.15.84:0/3071479552 conn(0x7f722c101220 msgr2=0x7f722c109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 shutdown_connections 2024-09-21T02:47:04.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.502+0000 7f7233c00640 1 -- 172.21.15.84:0/3071479552 wait complete. 2024-09-21T02:47:04.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1431214997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c1072c0 msgr2=0x7ff29c10dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1431214997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c1072c0 0x7ff29c10dc60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff294009ca0 tx=0x7ff29402a8c0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1431214997 shutdown_connections 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1431214997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c1072c0 0x7ff29c10dc60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1431214997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff29c106920 0x7ff29c106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1431214997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff29c1058a0 0x7ff29c105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1431214997 >> 172.21.15.84:0/1431214997 conn(0x7ff29c101220 msgr2=0x7ff29c103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1431214997 shutdown_connections 2024-09-21T02:47:04.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.747+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1431214997 wait complete. 2024-09-21T02:47:04.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.748+0000 7ff2a3c00640 1 Processor -- start 2024-09-21T02:47:04.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.748+0000 7ff2a3c00640 1 -- start start 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.748+0000 7ff2a3c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff29c1058a0 0x7ff29c19c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.748+0000 7ff2a3c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c106920 0x7ff29c19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff2a3c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff29c1072c0 0x7ff29c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff2a3c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c111690 con 0x7ff29c1072c0 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff2a3c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c111510 con 0x7ff29c106920 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff2a3c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c111810 con 0x7ff29c1058a0 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff29be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c106920 0x7ff29c19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff2a1200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff29c1058a0 0x7ff29c19c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff2a1c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff29c1072c0 0x7ff29c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff29be00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c106920 0x7ff29c19c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:58864/0 (socket says 172.21.15.84:58864) 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff29be00640 1 -- 172.21.15.84:0/1346235964 learned_addr learned my addr 172.21.15.84:0/1346235964 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff29be00640 1 -- 172.21.15.84:0/1346235964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff29c1058a0 msgr2=0x7ff29c19c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff29be00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff29c1058a0 0x7ff29c19c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff29be00640 1 -- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff29c1072c0 msgr2=0x7ff29c19d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff29be00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff29c1072c0 0x7ff29c19d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff29be00640 1 -- 172.21.15.84:0/1346235964 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c19dbc0 con 0x7ff29c106920 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.749+0000 7ff2a1c00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff29c1072c0 0x7ff29c19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.750+0000 7ff29be00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c106920 0x7ff29c19c7f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff28800ea60 tx=0x7ff28800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.750+0000 7ff299600640 1 -- 172.21.15.84:0/1346235964 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28800cde0 con 0x7ff29c106920 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.750+0000 7ff299600640 1 -- 172.21.15.84:0/1346235964 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff2880035f0 con 0x7ff29c106920 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.750+0000 7ff299600640 1 -- 172.21.15.84:0/1346235964 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288010690 con 0x7ff29c106920 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.750+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29c19deb0 con 0x7ff29c106920 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.750+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29c1a45a0 con 0x7ff29c106920 2024-09-21T02:47:04.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.751+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff29c105d10 con 0x7ff29c106920 2024-09-21T02:47:04.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.754+0000 7ff299600640 1 -- 172.21.15.84:0/1346235964 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7ff2880037a0 con 0x7ff29c106920 2024-09-21T02:47:04.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.756+0000 7ff299600640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2840b6510 0x7ff2840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:04.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.756+0000 7ff299600640 1 -- 172.21.15.84:0/1346235964 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7ff2880e7af0 con 0x7ff29c106920 2024-09-21T02:47:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.756+0000 7ff2a1200640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2840b6510 0x7ff2840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.757+0000 7ff2a1200640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2840b6510 0x7ff2840b8a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff290009bd0 tx=0x7ff290005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:04.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.757+0000 7ff299600640 1 -- 172.21.15.84:0/1346235964 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2880ae020 con 0x7ff29c106920 2024-09-21T02:47:04.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.945+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff29c02e640 con 0x7ff29c106920 2024-09-21T02:47:04.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.946+0000 7ff299600640 1 -- 172.21.15.84:0/1346235964 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) ==== 103+0+11 (secure 0 0 0) 0x7ff2880b2400 con 0x7ff29c106920 2024-09-21T02:47:04.948 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-09-21T02:47:04.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2840b6510 msgr2=0x7ff2840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2840b6510 0x7ff2840b8a20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff290009bd0 tx=0x7ff290005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:04.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c106920 msgr2=0x7ff29c19c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:04.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c106920 0x7ff29c19c7f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff28800ea60 tx=0x7ff28800ef20 comp rx=0 tx=0).stop 2024-09-21T02:47:04.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 shutdown_connections 2024-09-21T02:47:04.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff29c1072c0 0x7ff29c19d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff29c106920 0x7ff29c19c7f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7ff2840b6510 0x7ff2840b8a20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 --2- 172.21.15.84:0/1346235964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff29c1058a0 0x7ff29c19c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:04.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 >> 172.21.15.84:0/1346235964 conn(0x7ff29c101220 msgr2=0x7ff29c109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:04.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 shutdown_connections 2024-09-21T02:47:04.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:04.949+0000 7ff2a3c00640 1 -- 172.21.15.84:0/1346235964 wait complete. 2024-09-21T02:47:04.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:04 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2692862955' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:47:04.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:04 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2973484576' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T02:47:04.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:04 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3071479552' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T02:47:04.978 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T02:47:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:04 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2692862955' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:47:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:04 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2973484576' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T02:47:05.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:04 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3071479552' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T02:47:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:04 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2692862955' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T02:47:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:04 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2973484576' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T02:47:05.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:04 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3071479552' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T02:47:05.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 -- 172.21.15.84:0/1992124996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 msgr2=0x7fb8d4105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 --2- 172.21.15.84:0/1992124996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 0x7fb8d4105d20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009900 tx=0x7fb8c402a410 comp rx=0 tx=0).stop 2024-09-21T02:47:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 -- 172.21.15.84:0/1992124996 shutdown_connections 2024-09-21T02:47:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 --2- 172.21.15.84:0/1992124996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8d41072d0 0x7fb8d410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 --2- 172.21.15.84:0/1992124996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8d4106930 0x7fb8d4106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 --2- 172.21.15.84:0/1992124996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 0x7fb8d4105d20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 -- 172.21.15.84:0/1992124996 >> 172.21.15.84:0/1992124996 conn(0x7fb8d41011f0 msgr2=0x7fb8d41036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 -- 172.21.15.84:0/1992124996 shutdown_connections 2024-09-21T02:47:05.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.194+0000 7fb8da600640 1 -- 172.21.15.84:0/1992124996 wait complete. 2024-09-21T02:47:05.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.195+0000 7fb8da600640 1 Processor -- start 2024-09-21T02:47:05.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.195+0000 7fb8da600640 1 -- start start 2024-09-21T02:47:05.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8da600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 0x7fb8d419c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:05.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8da600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8d4106930 0x7fb8d419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:05.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8da600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8d41072d0 0x7fb8d419d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:05.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8da600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d41116a0 con 0x7fb8d41058b0 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8da600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4111520 con 0x7fb8d41072d0 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8da600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4111820 con 0x7fb8d4106930 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 0x7fb8d419c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 0x7fb8d419c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47418/0 (socket says 172.21.15.84:47418) 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3400640 1 -- 172.21.15.84:0/1931245053 learned_addr learned my addr 172.21.15.84:0/1931245053 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3e00640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8d41072d0 0x7fb8d419d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8caa00640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8d4106930 0x7fb8d419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3400640 1 -- 172.21.15.84:0/1931245053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8d4106930 msgr2=0x7fb8d419c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3400640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8d4106930 0x7fb8d419c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:05.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3400640 1 -- 172.21.15.84:0/1931245053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8d41072d0 msgr2=0x7fb8d419d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3400640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8d41072d0 0x7fb8d419d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3400640 1 -- 172.21.15.84:0/1931245053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d419dc10 con 0x7fb8d41058b0 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.196+0000 7fb8d3e00640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8d41072d0 0x7fb8d419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.197+0000 7fb8d3400640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 0x7fb8d419c1d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40314b0 tx=0x7fb8c4032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.197+0000 7fb8d0c00640 1 -- 172.21.15.84:0/1931245053 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c403f030 con 0x7fb8d41058b0 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.197+0000 7fb8d0c00640 1 -- 172.21.15.84:0/1931245053 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8c4032e30 con 0x7fb8d41058b0 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.197+0000 7fb8d0c00640 1 -- 172.21.15.84:0/1931245053 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4035070 con 0x7fb8d41058b0 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.197+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d419dea0 con 0x7fb8d41058b0 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.197+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d41a45f0 con 0x7fb8d41058b0 2024-09-21T02:47:05.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.198+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d4105d20 con 0x7fb8d41058b0 2024-09-21T02:47:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.200+0000 7fb8d0c00640 1 -- 172.21.15.84:0/1931245053 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fb8c4042030 con 0x7fb8d41058b0 2024-09-21T02:47:05.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.202+0000 7fb8d0c00640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb8b80b6590 0x7fb8b80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:05.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.202+0000 7fb8d0c00640 1 -- 172.21.15.84:0/1931245053 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fb8c4107d80 con 0x7fb8d41058b0 2024-09-21T02:47:05.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.202+0000 7fb8caa00640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb8b80b6590 0x7fb8b80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:05.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.203+0000 7fb8caa00640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb8b80b6590 0x7fb8b80b8aa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0095f0 tx=0x7fb8bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.204+0000 7fb8d0c00640 1 -- 172.21.15.84:0/1931245053 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8c40d2600 con 0x7fb8d41058b0 2024-09-21T02:47:05.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.449+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fb8d402e640 con 0x7fb8d41058b0 2024-09-21T02:47:05.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.460+0000 7fb8d0c00640 1 -- 172.21.15.84:0/1931245053 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+833521 (secure 0 0 0) 0x7fb8c40d7540 con 0x7fb8d41058b0 2024-09-21T02:47:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:47:05.474 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:47:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 20, 2024-09-21T02:47:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "active_gid": 14152, 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "active_name": "x", 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "active_addrs": { 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:6800", 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2416519122 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:6801", 2024-09-21T02:47:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2416519122 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "active_addr": "172.21.15.84:6801/2416519122", 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "active_change": "2024-09-21T02:31:41.471537+0000", 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "available": true, 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "standbys": [ 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "gid": 24124, 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "z", 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr_features": 4540719139924082687, 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T02:47:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T02:47:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T02:47:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T02:47:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T02:47:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:47:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T02:47:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T02:47:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T02:47:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T02:47:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T02:47:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T02:47:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T02:47:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T02:47:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T02:47:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T02:47:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T02:47:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T02:47:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T02:47:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T02:47:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T02:47:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T02:47:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T02:47:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T02:47:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T02:47:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T02:47:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T02:47:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T02:47:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T02:47:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T02:47:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T02:47:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T02:47:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T02:47:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T02:47:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T02:47:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T02:47:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T02:47:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T02:47:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T02:47:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:05.684 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T02:47:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.720 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.721 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.722 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.723 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.725 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T02:47:05.726 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T02:47:05.727 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.728 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.729 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.730 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.731 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.732 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.733 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.735 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.736 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.737 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.738 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.739 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.740 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.741 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.742 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.743 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.744 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.745 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.747 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.748 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.750 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.751 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T02:47:05.752 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.753 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.754 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.755 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.756 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.757 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.758 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.759 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.760 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.761 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.762 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.763 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.766 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.767 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.768 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.769 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.770 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.771 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.772 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.773 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.774 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.776 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.776 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.777 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.777 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.777 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.777 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.778 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.779 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.780 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.781 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.782 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T02:47:05.783 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T02:47:05.784 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.785 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.786 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.787 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.788 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.789 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.790 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.791 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.792 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.793 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.795 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T02:47:05.796 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.797 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.798 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.799 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T02:47:05.803 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.804 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:05.805 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.806 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.807 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.808 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T02:47:05.809 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:05.810 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.811 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.812 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.813 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.814 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.815 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.817 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.818 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.819 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.820 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T02:47:05.821 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T02:47:05.822 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.823 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.824 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.825 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.827 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T02:47:05.828 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.829 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.830 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.831 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.832 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.833 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.834 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.835 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.836 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.837 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.838 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T02:47:05.839 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.840 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.842 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.843 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.844 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.845 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.846 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T02:47:05.847 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.848 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.849 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.852 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.854 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.855 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.856 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.857 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.858 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.859 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.860 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.861 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:05.862 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.863 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.864 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.865 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.866 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T02:47:05.867 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.869 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.870 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.871 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.872 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.873 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T02:47:05.874 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.875 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.876 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.877 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.878 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.879 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.880 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.881 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.882 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.883 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.884 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.885 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.887 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.888 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.889 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.890 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.891 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.892 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.893 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.894 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.895 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.896 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.897 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T02:47:05.898 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.899 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.902 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.903 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.904 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T02:47:05.905 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T02:47:05.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.907 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.908 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.911 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.912 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.913 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.914 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.915 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.916 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.917 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.918 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.919 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.920 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.922 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.923 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.924 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.925 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.927 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.928 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.929 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.930 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.931 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.932 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.933 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.934 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.935 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.936 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.937 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.938 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.939 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.940 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.941 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.944 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.945 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.946 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.947 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:05.948 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.949 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.950 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.951 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.952 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.953 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.955 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T02:47:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T02:47:05.957 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.958 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: "gid": 24134, 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "y", 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr_features": 4540719139924082687, 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.959 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.960 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.961 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.962 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.964 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.965 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.966 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.968 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T02:47:05.969 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T02:47:05.970 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T02:47:05.971 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T02:47:05.972 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T02:47:05.973 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.974 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.976 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T02:47:05.977 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.978 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T02:47:05.979 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T02:47:05.980 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T02:47:05.981 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.982 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T02:47:05.983 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.984 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.985 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.986 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:05.987 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:05.988 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T02:47:05.989 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T02:47:05.990 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T02:47:05.991 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.992 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.993 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.994 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:05.995 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.996 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:05.997 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:05.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.000 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.001 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.002 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T02:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.004 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.005 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.006 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T02:47:06.008 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T02:47:06.009 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T02:47:06.010 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.011 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.012 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.014 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.015 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.016 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.017 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.018 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T02:47:06.019 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.020 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.021 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T02:47:06.022 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T02:47:06.023 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:06.024 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.025 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.026 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.026 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T02:47:06.026 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.026 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.026 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.026 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.026 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.027 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.028 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.029 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.030 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.031 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.032 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.033 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.034 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.035 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.036 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.037 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.039 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.040 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.041 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T02:47:06.042 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.043 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.044 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.045 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.046 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T02:47:06.047 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.048 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.049 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.050 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.051 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.052 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T02:47:06.053 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T02:47:06.054 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.055 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.056 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.057 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.058 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.059 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T02:47:06.060 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.061 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.062 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T02:47:06.063 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T02:47:06.064 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.065 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.066 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.067 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.069 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.070 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.071 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.072 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.073 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.074 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T02:47:06.075 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.076 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T02:47:06.077 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.078 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.079 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.080 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.081 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.082 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.083 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.084 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.085 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.086 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.087 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.088 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T02:47:06.089 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.091 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.092 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T02:47:06.093 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.095 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.096 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.097 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.098 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.099 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.100 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.101 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.102 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.103 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.106 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.107 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.108 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T02:47:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T02:47:06.110 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T02:47:06.111 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T02:47:06.112 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.113 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.115 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.118 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.119 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.120 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.121 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.122 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.123 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.124 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.125 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.126 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.127 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.129 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.130 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.131 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T02:47:06.132 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.133 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.134 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.135 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.136 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.137 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.138 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.140 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T02:47:06.141 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T02:47:06.142 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.144 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.145 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T02:47:06.146 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T02:47:06.147 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.149 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.150 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.151 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.152 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.153 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.154 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.155 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.156 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.157 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.158 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.160 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.161 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.162 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.163 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T02:47:06.164 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.165 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.166 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.167 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.168 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.169 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.170 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.171 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.172 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.173 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.174 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.175 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.180 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.181 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.182 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.183 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.184 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.186 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.187 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.188 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.189 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T02:47:06.190 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.192 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.193 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.194 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.195 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.196 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.197 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.199 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.200 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.201 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.202 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.203 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.204 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.205 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.207 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.208 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.209 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.210 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.211 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.212 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.213 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.214 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.215 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.216 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.217 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.218 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.219 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.220 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.221 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.222 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.223 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.224 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.225 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.226 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.227 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.228 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.229 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.230 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.231 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.232 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.234 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.235 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.236 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.237 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.240 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.241 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.242 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.243 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.244 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.245 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.246 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.247 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.248 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T02:47:06.249 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.251 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.252 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.253 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.254 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.255 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.256 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.257 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.258 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.259 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.260 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.261 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.262 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.263 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.264 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.266 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.267 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.268 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T02:47:06.271 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.272 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.273 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.274 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.275 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.277 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.278 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.279 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T02:47:06.280 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.281 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.283 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.284 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.285 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.286 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.287 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.288 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.289 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.290 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.291 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.293 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.294 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.295 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.296 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.297 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.298 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.299 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.300 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.301 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.302 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.303 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.304 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.305 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T02:47:06.306 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.307 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.308 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.309 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.311 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.312 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.313 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.314 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.315 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.316 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.318 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.319 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.320 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.323 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.324 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.325 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.326 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.331 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.332 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.333 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.334 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.335 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.336 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.337 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.339 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.340 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.341 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.342 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.343 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.344 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.345 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.346 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.350 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.351 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.352 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.353 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.354 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.355 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.356 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.357 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.358 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.359 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.360 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.361 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.362 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.363 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.364 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.365 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.366 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.367 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.368 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.369 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.370 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.371 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.372 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T02:47:06.373 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.374 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.375 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.376 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.377 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.378 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.379 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.380 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.381 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.382 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.383 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.384 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.385 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.387 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.387 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.387 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.387 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.387 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.387 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.387 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.387 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.388 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.389 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.390 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.391 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.392 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.393 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.395 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.396 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.398 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.399 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.400 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.401 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.406 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.407 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.408 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.409 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.410 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.411 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.412 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.413 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T02:47:06.414 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.415 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.418 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.419 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.420 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.421 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.422 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.423 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.425 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.426 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.427 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.428 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.429 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.430 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.430 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.430 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.430 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.430 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.430 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.430 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.431 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.432 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.433 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.434 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.435 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.436 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.437 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.438 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.439 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T02:47:06.440 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T02:47:06.441 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T02:47:06.442 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.444 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:06.445 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T02:47:06.446 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.447 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.448 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.449 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.450 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.451 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.453 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T02:47:06.454 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.455 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T02:47:06.456 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.457 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: "modules": [ 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: "dashboard", 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: "iostat", 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: "nfs", 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: "restful" 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.458 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T02:47:06.459 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.460 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.461 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.462 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.463 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.464 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.466 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.467 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.468 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.469 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.470 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.471 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.472 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.473 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T02:47:06.474 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.476 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.477 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.478 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.479 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T02:47:06.480 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T02:47:06.481 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.482 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.483 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.484 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.485 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.486 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.487 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.488 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.489 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.490 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.491 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.493 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.494 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T02:47:06.496 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.497 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.498 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.499 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.500 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.501 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.502 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.503 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.504 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T02:47:06.505 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T02:47:06.506 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.507 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.508 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.509 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.510 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.511 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T02:47:06.512 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.513 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T02:47:06.514 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:06.515 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T02:47:06.516 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.517 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.518 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.519 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T02:47:06.520 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.521 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.522 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.523 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.524 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.525 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T02:47:06.527 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T02:47:06.528 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T02:47:06.529 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T02:47:06.530 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T02:47:06.531 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T02:47:06.532 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.534 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.535 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.536 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.537 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.538 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T02:47:06.540 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T02:47:06.541 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T02:47:06.542 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T02:47:06.543 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.544 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T02:47:06.545 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T02:47:06.547 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T02:47:06.548 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T02:47:06.549 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T02:47:06.550 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T02:47:06.551 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T02:47:06.552 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.553 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T02:47:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T02:47:06.555 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T02:47:06.556 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.557 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.558 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.561 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.562 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.563 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.564 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.565 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.567 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T02:47:06.568 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.569 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T02:47:06.570 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.572 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.573 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.574 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.575 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.576 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.577 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.578 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.579 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.580 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.581 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.594 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.595 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.598 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.599 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.600 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.601 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.603 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.604 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.605 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T02:47:06.606 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.607 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.608 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.609 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.610 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.611 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.612 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T02:47:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T02:47:06.614 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T02:47:06.615 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T02:47:06.616 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T02:47:06.617 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T02:47:06.618 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T02:47:06.619 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T02:47:06.620 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T02:47:06.621 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T02:47:06.622 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.623 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.625 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.626 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.627 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T02:47:06.628 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T02:47:06.629 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.631 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.632 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.633 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.634 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.635 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.636 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.637 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.638 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.639 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.640 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.641 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.642 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.643 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.644 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.645 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.646 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.647 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.648 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.649 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.650 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.653 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.654 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.655 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.656 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.657 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.658 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.659 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.660 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.661 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.662 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.663 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T02:47:06.664 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.669 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.670 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.671 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.672 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T02:47:06.673 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T02:47:06.674 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.675 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T02:47:06.676 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T02:47:06.677 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T02:47:06.678 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.679 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.680 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.681 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.682 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.683 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.684 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.685 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.686 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.687 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.688 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.690 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.691 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.693 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.696 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.697 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.698 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.699 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.700 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.701 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.702 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.703 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.704 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.705 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.706 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T02:47:06.708 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.709 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.710 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.711 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.712 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.713 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.714 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.715 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.716 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.717 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.718 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.720 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.721 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.722 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.723 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.724 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.725 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.726 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.727 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.728 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.730 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.731 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.732 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.733 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.734 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.735 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.737 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.738 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.740 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.741 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.742 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.743 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.744 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.747 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.748 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.749 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.750 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.751 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.752 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.753 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.754 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.755 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.756 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.757 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.758 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.760 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.761 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.762 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.763 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.764 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.765 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.767 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.768 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.769 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.770 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.771 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.772 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.773 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.774 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.775 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.776 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.777 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.778 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T02:47:06.779 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T02:47:06.780 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T02:47:06.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.782 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.783 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.784 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.785 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.786 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.787 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.788 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.789 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.790 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.791 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.793 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.794 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.795 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.796 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.797 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.798 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.799 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.800 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.801 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.802 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.803 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.804 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T02:47:06.805 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T02:47:06.806 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T02:47:06.807 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.808 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.809 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.810 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.811 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.812 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.813 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.814 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.815 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.816 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.817 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.818 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.819 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.820 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.822 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.823 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.824 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.825 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.826 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.827 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.828 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.829 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.830 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.831 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.832 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.833 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.834 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.835 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.836 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.837 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.838 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.839 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.840 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.841 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.842 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.843 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.844 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.845 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.846 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.847 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.848 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.850 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T02:47:06.851 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T02:47:06.852 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T02:47:06.853 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.854 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.855 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.856 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.859 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.860 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.861 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T02:47:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.876 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.877 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.878 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.879 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.880 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T02:47:06.881 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T02:47:06.882 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T02:47:06.883 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.884 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T02:47:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T02:47:06.886 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T02:47:06.887 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T02:47:06.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T02:47:06.889 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.890 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T02:47:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T02:47:06.892 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T02:47:06.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.894 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.895 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.896 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.897 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.898 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.899 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.900 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.901 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.902 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.903 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.904 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.909 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.910 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.912 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.913 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.914 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.915 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.916 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T02:47:06.918 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.919 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.921 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.922 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.923 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T02:47:06.925 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T02:47:06.926 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T02:47:06.927 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.928 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.929 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.930 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.931 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T02:47:06.932 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "services": { 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "dashboard": "https://172.21.15.84:8443/" 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "always_on_modules": { 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "octopus": [ 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T02:47:06.933 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "pacific": [ 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T02:47:06.934 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "quincy": [ 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T02:47:06.935 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "reef": [ 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T02:47:06.936 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "squid": [ 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T02:47:06.937 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: "last_failure_osd_epoch": 3, 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: "active_clients": [ 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3005732966 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.938 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "libcephsqlite", 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 816984279 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.939 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3562517394 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 253908522 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:06.940 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:06.941 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T02:47:06.941 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:47:06.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb8b80b6590 msgr2=0x7fb8b80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:06.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb8b80b6590 0x7fb8b80b8aa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc0095f0 tx=0x7fb8bc005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:06.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 msgr2=0x7fb8d419c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:06.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 0x7fb8d419c1d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40314b0 tx=0x7fb8c4032c40 comp rx=0 tx=0).stop 2024-09-21T02:47:06.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 shutdown_connections 2024-09-21T02:47:06.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb8b80b6590 0x7fb8b80b8aa0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:06.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8d4106930 0x7fb8d419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:06.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8d41072d0 0x7fb8d419d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:06.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 --2- 172.21.15.84:0/1931245053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8d41058b0 0x7fb8d419c1d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:06.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 >> 172.21.15.84:0/1931245053 conn(0x7fb8d41011f0 msgr2=0x7fb8d4109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:06.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 shutdown_connections 2024-09-21T02:47:06.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:05.468+0000 7fb8da600640 1 -- 172.21.15.84:0/1931245053 wait complete. 2024-09-21T02:47:06.987 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T02:47:06.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T02:47:06.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:05 smithi084 ceph-mon[30747]: pgmap v539: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 813 KiB/s wr, 289 op/s 2024-09-21T02:47:06.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:05 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1346235964' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T02:47:06.988 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:05 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/1931245053' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T02:47:06.989 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:05 smithi090 ceph-mon[34571]: pgmap v539: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 813 KiB/s wr, 289 op/s 2024-09-21T02:47:06.989 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:05 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1346235964' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T02:47:06.989 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:05 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/1931245053' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T02:47:06.989 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:05 smithi172 ceph-mon[35067]: pgmap v539: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 813 KiB/s wr, 289 op/s 2024-09-21T02:47:06.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:05 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1346235964' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T02:47:06.990 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:05 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/1931245053' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T02:47:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:07.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:07 smithi084 ceph-mon[30747]: pgmap v540: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 813 KiB/s wr, 266 op/s 2024-09-21T02:47:08.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:07 smithi172 ceph-mon[35067]: pgmap v540: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 813 KiB/s wr, 266 op/s 2024-09-21T02:47:08.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:07 smithi090 ceph-mon[34571]: pgmap v540: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 813 KiB/s wr, 266 op/s 2024-09-21T02:47:08.393 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:47:08.393 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 129, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 124, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 811056, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 76048, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.038299861, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.015962673, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.028874094, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 123, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.010046473, 2024-09-21T02:47:08.394 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000081678 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 811056, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 76048 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 95, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 160, 2024-09-21T02:47:08.395 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 96960, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.012925943, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.009554441, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.002091486, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 93, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.006185660, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000066512 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:08.396 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 96960 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 4, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 4, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 2992, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 448, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.003913224, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000055062, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.003791428, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:08.397 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.006232110, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.002077370 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T02:47:08.398 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:08.399 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:08.400 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 149854, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 28, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:08.401 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T02:47:08.402 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 130, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 792879, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 130, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T02:47:08.403 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 130, 2024-09-21T02:47:08.404 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 792879, 2024-09-21T02:47:08.404 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T02:47:08.404 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:08.404 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:08.404 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:08.404 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:08.404 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:08.404 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:47:09.222 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T02:47:09.222 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T02:47:09.222 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T02:47:09.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T02:47:09.592 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:09.899 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:09 smithi084 ceph-mon[30747]: pgmap v541: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 811 KiB/s wr, 230 op/s 2024-09-21T02:47:10.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:09 smithi172 ceph-mon[35067]: pgmap v541: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 811 KiB/s wr, 230 op/s 2024-09-21T02:47:10.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:09 smithi090 ceph-mon[34571]: pgmap v541: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 811 KiB/s wr, 230 op/s 2024-09-21T02:47:10.338 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:47:10.338 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 134, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 129, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 812416, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 79248, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.037184870, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.014657500, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.029972355, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 128, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.009278520, 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000072488 2024-09-21T02:47:10.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 812416, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 79248 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 99, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 160, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 97664, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-21T02:47:10.340 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.014347861, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.011061558, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.001825022, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 97, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.007188237, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000074105 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.341 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 97664 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 4, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 4, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 2992, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 448, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.003495583, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000063781, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.003378688, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:10.342 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.005671589, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001890529 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T02:47:10.343 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:10.344 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:10.345 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 148823, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 27, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:10.346 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:10.347 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 135, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 793529, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 135, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 135, 2024-09-21T02:47:10.348 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 793529, 2024-09-21T02:47:10.349 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T02:47:10.349 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:10.349 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:10.349 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:10.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:10.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:10.349 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:47:11.959 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:11 smithi084 ceph-mon[30747]: pgmap v542: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 216 KiB/s wr, 103 op/s 2024-09-21T02:47:12.004 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T02:47:12.004 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T02:47:12.004 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T02:47:12.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T02:47:12.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:11 smithi172 ceph-mon[35067]: pgmap v542: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 216 KiB/s wr, 103 op/s 2024-09-21T02:47:12.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:11 smithi090 ceph-mon[34571]: pgmap v542: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 216 KiB/s wr, 103 op/s 2024-09-21T02:47:12.379 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:13.812 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:13 smithi084 ceph-mon[30747]: pgmap v543: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 216 KiB/s wr, 105 op/s 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 0, 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 0, 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 0, 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.003831959, 2024-09-21T02:47:13.990 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000662116, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:13.991 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 136, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 129, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 814928, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 77936, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.036165730, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.015003152, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.030404231, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:13.992 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 129, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.014636585, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000113461 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 814928, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 77936 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1, 2024-09-21T02:47:13.993 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 97, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 160, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 97312, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.012763031, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.009811221, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.001612990, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 95, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.006073539, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000063931 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.994 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 97312 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:13.995 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:13.996 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:13.997 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 149854, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 28, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:13.998 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T02:47:13.999 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 133, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 793333, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 133, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 133, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 793333, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:14.000 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:47:14.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:13 smithi172 ceph-mon[35067]: pgmap v543: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 216 KiB/s wr, 105 op/s 2024-09-21T02:47:14.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:13 smithi090 ceph-mon[34571]: pgmap v543: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 216 KiB/s wr, 105 op/s 2024-09-21T02:47:14.837 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T02:47:14.838 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T02:47:14.838 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T02:47:14.838 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T02:47:15.212 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:15.970 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:15 smithi084 ceph-mon[30747]: pgmap v544: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 0, 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 0, 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 0, 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.003262285, 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T02:47:15.972 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000740948, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.973 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 142, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 135, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 816560, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 81776, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.033730976, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.011515071, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.032159775, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 135, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.016255564, 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000120411 2024-09-21T02:47:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 816560, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 81776 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 101, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 160, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 98016, 2024-09-21T02:47:15.975 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.015285402, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.011562472, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.002214246, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 99, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.007404523, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000074793 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:15.976 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 98016 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:15.977 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:15.978 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:15.979 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 148823, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 27, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:15.980 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 139, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 794113, 2024-09-21T02:47:15.981 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 139, 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 139, 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 794113, 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T02:47:15.982 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T02:47:16.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:15 smithi172 ceph-mon[35067]: pgmap v544: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T02:47:16.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:15 smithi090 ceph-mon[34571]: pgmap v544: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T02:47:16.896 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T02:47:16.896 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T02:47:16.896 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T02:47:16.897 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T02:47:17.158 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:47:17.648 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T02:47:17.648 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:17.648 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 10145, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 6590, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 3536076, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 12471578, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 50, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 4, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.654654201, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.298369036, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.393298851, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.055901041, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 6589, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.500627484, 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000227747 2024-09-21T02:47:17.649 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 13111, 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.002036560, 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000155 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 33424, 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 2304 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 8132, 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 17856, 2024-09-21T02:47:17.650 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 2709846, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 12207373, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 30, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 6, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.802398470, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.487262497, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.281406309, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.065990960, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 17854, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 2.185578987, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000122413 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.651 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 12804, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.003081113, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000240 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 57008, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 288752 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 2077, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 2222, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 1482583, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 2293616, 2024-09-21T02:47:17.652 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 12, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 6, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.202432077, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.088622068, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.086572458, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.037490887, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2221, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.389816955, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000625761 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1135, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000293346, 2024-09-21T02:47:17.653 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000258 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 887824, 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 86048 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 1, 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-MDSRank": { 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1493, 2024-09-21T02:47:17.654 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 3.591800364, 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.002405760 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-PurgeQueue": { 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 791, 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.082463922, 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000104252 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": { 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "request": 4300, 2024-09-21T02:47:17.655 INFO:teuthology.orchestra.run.smithi090.stdout: "reply": 4017, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "reply_latency": { 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 4017, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 21.268216353, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.005294552 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_reply": 0, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "forward": 283, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_complete": 1, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_keys": 0, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_commit": 296, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_split": 3, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_merge": 2, 2024-09-21T02:47:17.656 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes": 53, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_top": 25, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_bottom": 17, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pin_tail": 11, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pinned": 17, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_expired": 3083, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_with_caps": 2, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": 2, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "subtrees": 3, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse": 4891, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_hit": 4459, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_forward": 279, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_discover": 7, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_dir_fetch": 0, 2024-09-21T02:47:17.657 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_remote_ino": 0, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_lock": 0, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "load_cent": 0, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "q": 0, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "exported": 197, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "exported_inodes": 2805, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "imported": 17, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "imported_inodes": 358, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_dir_fetch": 0, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_backtrace_fetch": 0, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_peer_discover": 0, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rfiles": 4, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rbytes": 234, 2024-09-21T02:47:17.658 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rsnaps": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_set_tag": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_inotable_repaired": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_inodes": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_file_inodes": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_inode_file_caps": 8, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_revoke": 509, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_grant": 3471, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T02:47:17.659 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps": 1319, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps_dirty": 961, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_cap_release": 32, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "process_request_cap_release": 1081 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_cache": { 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update": 0, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update_receipt": 0, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_try_discover": 0, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_send_discover": 7, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_handle_discover": 194, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays": 2, 2024-09-21T02:47:17.660 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_delayed": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_enqueuing": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_created": 390, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_enqueued": 388, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_reintegrated": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_migrated": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_processing": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_enqueued": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_prioritized": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_started": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_completed": 0, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_path": 4, 2024-09-21T02:47:17.661 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_inode": 358, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_exportdir": 198, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_flush": 0, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragmentdir": 5, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragstats": 0, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_inodestats": 0, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_started": 0, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_succeeded": 0, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_write_failed": 0 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_log": { 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "evlrg": 0, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "evadd": 5601, 2024-09-21T02:47:17.662 INFO:teuthology.orchestra.run.smithi090.stdout: "evex": 5383, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "evtrm": 5383, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "ev": 218, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "evexg": 0, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "evexd": 581, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "segadd": 25, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "segex": 24, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "segtrm": 24, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "seg": 1, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "segmjr": 1, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "segexg": 0, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "segexd": 2, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "expos": 16817322, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "wrpos": 17187288, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "rdpos": 0, 2024-09-21T02:47:17.663 INFO:teuthology.orchestra.run.smithi090.stdout: "jlat": { 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 750, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 10.739435884, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.014319247 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "replayed": 0 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_mem": { 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ino": 27, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ino+": 3286, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "ino-": 3259, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "dir": 29, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "dir+": 343, 2024-09-21T02:47:17.664 INFO:teuthology.orchestra.run.smithi090.stdout: "dir-": 314, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "dn": 53, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "dn+": 4045, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "dn-": 3992, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "cap": 2, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "cap+": 3346, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "cap-": 3344, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "rss": 142416, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "heap": 369963008 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_server": { 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_client_request": 4452, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_server_request": 49, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_request": 4300, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_session": 194, 2024-09-21T02:47:17.665 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_peer_request": 155, 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "req_create_latency": { 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2854, 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 10.988233959, 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.003850117 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getattr_latency": { 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 29, 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.023165893, 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000798823 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getfilelock_latency": { 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.666 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "req_link_latency": { 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookup_latency": { 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 429, 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 9.313234345, 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.021709170 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookuphash_latency": { 2024-09-21T02:47:17.667 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupino_latency": { 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000403080, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000403080 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupname_latency": { 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.668 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupparent_latency": { 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupsnap_latency": { 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.669 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lssnap_latency": { 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mkdir_latency": { 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 257, 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.309818024, 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001205517 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mknod_latency": { 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.670 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mksnap_latency": { 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "req_open_latency": { 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2, 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000797581, 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000398790 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "req_readdir_latency": { 2024-09-21T02:47:17.671 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 37, 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.027397494, 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000740472 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rename_latency": { 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2, 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.003550295, 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001775147 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "req_renamesnap_latency": { 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.672 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "req_snapdiff_latency": { 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmdir_latency": { 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 9, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.113016014, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.012557334 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmsnap_latency": { 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.673 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmxattr_latency": { 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setattr_latency": { 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 5, 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.010247507, 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.002049501 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setdirlayout_latency": { 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.674 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setfilelock_latency": { 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setlayout_latency": { 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.675 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setxattr_latency": { 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 11, 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.028661443, 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.002605585 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "req_symlink_latency": { 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "req_unlink_latency": { 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 381, 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.449690718, 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001180290 2024-09-21T02:47:17.676 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_revoke_eviction": 0, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition_throttle": 0, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getvxattr_latency": { 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_sessions": { 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "session_count": 1, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "session_add": 4, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "session_remove": 3, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_open": 1, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_stale": 0, 2024-09-21T02:47:17.677 INFO:teuthology.orchestra.run.smithi090.stdout: "total_load": 2405, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "average_load": 2405, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "avg_session_uptime": 277, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "mdthresh_evicted": 0 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 360, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 360, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:17.678 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:17.679 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:17.680 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 294351, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 97, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 8856, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 166, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:17.681 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 140367, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 1150, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "objecter": { 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "op_active": 0, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "op_laggy": 0, 2024-09-21T02:47:17.682 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send": 4787, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send_bytes": 15579134, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "op_resend": 37, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "op_reply": 4787, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "op_latency": { 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 4787, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 187.541940285, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.039177342 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "op_inflight": 0, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "oplen_avg": { 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 4787, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 8663 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.683 INFO:teuthology.orchestra.run.smithi090.stdout: "op": 4787, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "op_r": 29, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "op_w": 4758, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "op_rmw": 0, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "op_pg": 0, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_stat": 197, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_create": 2164, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_read": 28, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_write": 778, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writefull": 80, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writesame": 0, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_append": 0, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_zero": 0, 2024-09-21T02:47:17.684 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_truncate": 3, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_delete": 1317, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_mapext": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_sparse_read": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_clonerange": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_getxattr": 1, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_setxattr": 3288, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_cmpxattr": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_rmxattr": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_resetxattrs": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_call": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_watch": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_notify": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T02:47:17.685 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls_filter": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_other": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_active": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_send": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_resend": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_ping": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_active": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_send": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_resend": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_active": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_send": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_resend": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_active": 0, 2024-09-21T02:47:17.686 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_send": 0, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_resend": 0, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "command_active": 0, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "command_send": 0, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "command_resend": 0, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "map_epoch": 88, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "map_full": 0, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "map_inc": 11, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_sessions": 12, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_open": 12, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_close": 0, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_laggy": 0, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_wr": 746, 2024-09-21T02:47:17.687 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_rd": 2, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_del": 59 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "oft": { 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_objs": 1, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_kv_pairs": 0, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_updates": 0, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_removes": 0 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "purge_queue": { 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops": 0, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops_high_water": 21, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing": 0, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_high_water": 9, 2024-09-21T02:47:17.688 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed_ops": 793, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed": 388, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_item_in_journal": 0 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 20350, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 5973872, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 20350, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:17.689 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 20350, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 5973872, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_bytes": { 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:17.690 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 4787, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 15621354, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 4787, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 15621354, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_ops": { 2024-09-21T02:47:17.691 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 1024, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 4787, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 4787, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 4787, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 4787, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.692 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle": { 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 388, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 42236, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 388, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 28, 2024-09-21T02:47:17.693 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 42236, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle-0x55fe3d1e12b0": { 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 5601, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 12992984, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 5601, 2024-09-21T02:47:17.694 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 750, 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 12992984, 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "trackedop": { 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_ops_count": 362 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:17.695 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T02:47:17.957 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:17 smithi090 ceph-mon[34571]: pgmap v545: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T02:47:18.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:17 smithi172 ceph-mon[35067]: pgmap v545: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T02:47:18.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:17 smithi084 ceph-mon[30747]: pgmap v545: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-21T02:47:18.622 INFO:tasks.check_counter:Daemon mds.b mds.exported=197 2024-09-21T02:47:18.622 INFO:tasks.check_counter:Daemon mds.b mds.imported=17 2024-09-21T02:47:18.622 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T02:47:18.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T02:47:18.866 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:47:19.355 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T02:47:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 426, 2024-09-21T02:47:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 428, 2024-09-21T02:47:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 37861851, 2024-09-21T02:47:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 135532, 2024-09-21T02:47:19.355 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 7, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 3, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.065494588, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.019800579, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.030707670, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.010849230, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 426, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.073979774, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000173661 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.356 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 446, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 434, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 34489195, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 175545, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 5, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 4, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.081162345, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.023908004, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.052763673, 2024-09-21T02:47:19.357 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.009681201, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 433, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.018889643, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000043625 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 859264, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 82048 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:19.358 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 617, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 714, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 34966124, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 432744, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 6, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 5, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.102584219, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.038065257, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.037665020, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.020050068, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 713, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.039290594, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000055106 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.359 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 238128 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 1, 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-MDSRank": { 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-21T02:47:19.360 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 2181, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.062507462, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000028660 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-PurgeQueue": { 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": { 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "request": 0, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "reply": 0, 2024-09-21T02:47:19.361 INFO:teuthology.orchestra.run.smithi090.stdout: "reply_latency": { 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_reply": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "forward": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_complete": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_keys": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_commit": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_split": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_merge": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes": 11263, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_top": 0, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_bottom": 11263, 2024-09-21T02:47:19.362 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pin_tail": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pinned": 11263, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_expired": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_with_caps": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "subtrees": 1, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_hit": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_forward": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_discover": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_dir_fetch": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_remote_ino": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_lock": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "load_cent": 0, 2024-09-21T02:47:19.363 INFO:teuthology.orchestra.run.smithi090.stdout: "q": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "exported": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "exported_inodes": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "imported": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "imported_inodes": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_dir_fetch": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_backtrace_fetch": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_peer_discover": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rfiles": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rbytes": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rsnaps": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_set_tag": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T02:47:19.364 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_inotable_repaired": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_inodes": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_file_inodes": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_inode_file_caps": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_grant": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps_dirty": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_cap_release": 0, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "process_request_cap_release": 0 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.365 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_cache": { 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update_receipt": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_try_discover": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_send_discover": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_handle_discover": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_delayed": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_enqueuing": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_created": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_enqueued": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_reintegrated": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_migrated": 0, 2024-09-21T02:47:19.366 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_processing": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_enqueued": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_prioritized": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_started": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_completed": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_path": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_inode": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_exportdir": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_flush": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragmentdir": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragstats": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_inodestats": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_started": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_succeeded": 0, 2024-09-21T02:47:19.367 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_write_failed": 0 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_log": { 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "evlrg": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "evadd": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "evex": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "evtrm": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "ev": 52341, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "evexg": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "evexd": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "segadd": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "segex": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "segtrm": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "seg": 67, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "segmjr": 6, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "segexg": 0, 2024-09-21T02:47:19.368 INFO:teuthology.orchestra.run.smithi090.stdout: "segexd": 0, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "expos": 4194304, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "wrpos": 110271835, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "rdpos": 110270697, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "jlat": { 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "replayed": 52341 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_mem": { 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "ino": 26, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "ino+": 11413, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "ino-": 11387, 2024-09-21T02:47:19.369 INFO:teuthology.orchestra.run.smithi090.stdout: "dir": 24, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "dir+": 753, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "dir-": 729, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "dn": 11263, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "dn+": 18744, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "dn-": 7481, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "cap": 0, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "cap+": 0, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "cap-": 0, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "rss": 130524, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "heap": 346624000 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_server": { 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_client_request": 0, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_server_request": 0, 2024-09-21T02:47:19.370 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_request": 0, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_session": 0, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_peer_request": 0, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "req_create_latency": { 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getattr_latency": { 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.371 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getfilelock_latency": { 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "req_link_latency": { 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookup_latency": { 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.372 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookuphash_latency": { 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupino_latency": { 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupname_latency": { 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.373 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupparent_latency": { 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupsnap_latency": { 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lssnap_latency": { 2024-09-21T02:47:19.374 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mkdir_latency": { 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.375 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mknod_latency": { 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mksnap_latency": { 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "req_open_latency": { 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "req_readdir_latency": { 2024-09-21T02:47:19.376 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rename_latency": { 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "req_renamesnap_latency": { 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "req_snapdiff_latency": { 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.377 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmdir_latency": { 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmsnap_latency": { 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmxattr_latency": { 2024-09-21T02:47:19.378 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setattr_latency": { 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setdirlayout_latency": { 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.379 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setfilelock_latency": { 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setlayout_latency": { 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setxattr_latency": { 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.380 INFO:teuthology.orchestra.run.smithi090.stdout: "req_symlink_latency": { 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "req_unlink_latency": { 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_revoke_eviction": 0, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition_throttle": 0, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getvxattr_latency": { 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.381 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_sessions": { 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "session_count": 1, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "session_add": 3, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "session_remove": 2, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_open": 1, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_stale": 0, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "total_load": 0, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "average_load": 0, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "avg_session_uptime": 1813, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "mdthresh_evicted": 0 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-09-21T02:47:19.382 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:19.383 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:19.384 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 222864, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 80, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:19.385 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 8856, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 166, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 7754441, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 48216, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-09-21T02:47:19.386 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "objecter": { 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "op_active": 0, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "op_laggy": 0, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send": 1332, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send_bytes": 21, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "op_resend": 3, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "op_reply": 1332, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "op_latency": { 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1332, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 2.179964521, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001636610 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.387 INFO:teuthology.orchestra.run.smithi090.stdout: "op_inflight": 0, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "oplen_avg": { 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1332, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1333 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "op": 1332, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "op_r": 1332, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "op_w": 0, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "op_rmw": 0, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "op_pg": 0, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_stat": 815, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_create": 0, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_read": 515, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_write": 0, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writefull": 0, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writesame": 0, 2024-09-21T02:47:19.388 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_append": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_zero": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_truncate": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_delete": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_mapext": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_sparse_read": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_clonerange": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_getxattr": 1, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_setxattr": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_cmpxattr": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_rmxattr": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_resetxattrs": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_call": 0, 2024-09-21T02:47:19.389 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_watch": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_notify": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls_filter": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_other": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_active": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_send": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_resend": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_ping": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_active": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_send": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_resend": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_active": 0, 2024-09-21T02:47:19.390 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_send": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_resend": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_active": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_send": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_resend": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "command_active": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "command_send": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "command_resend": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "map_epoch": 88, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "map_full": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "map_inc": 3, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_sessions": 9, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_open": 9, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_close": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_laggy": 0, 2024-09-21T02:47:19.391 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_wr": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_rd": 2, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_del": 0 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "oft": { 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_objs": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_kv_pairs": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_updates": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_removes": 0 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "purge_queue": { 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_high_water": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed_ops": 0, 2024-09-21T02:47:19.392 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed": 0, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_item_in_journal": 0 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 1485, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 107172803, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 1485, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1485, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 107172803, 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:19.393 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_bytes": { 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 1332, 2024-09-21T02:47:19.394 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 106081508, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1332, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 106081508, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_ops": { 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 1024, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:19.395 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 1332, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 1332, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1332, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 1332, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle": { 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle-0x555876e21520": { 2024-09-21T02:47:19.397 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:19.398 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "trackedop": { 2024-09-21T02:47:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_ops_count": 0 2024-09-21T02:47:19.399 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:19.399 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T02:47:19.983 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:19 smithi090 ceph-mon[34571]: pgmap v546: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:47:20.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:19 smithi172 ceph-mon[35067]: pgmap v546: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:47:20.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:19 smithi084 ceph-mon[30747]: pgmap v546: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T02:47:20.053 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T02:47:20.053 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T02:47:20.053 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T02:47:20.053 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T02:47:20.298 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 1153, 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 1155, 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 2853405, 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 366661, 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 6, 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:20.800 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.111556768, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.047651933, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.025747363, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.030590013, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1153, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.041126452, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000035669 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.801 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 152, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 140, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 859276, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 81466, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 3, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.027497586, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.011249555, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.023530766, 2024-09-21T02:47:20.802 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000054546, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 139, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.008403957, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000060460 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 858720, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 80768 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.803 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 6, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 102, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 3420, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 239902, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 4, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 3, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.009901708, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.005740272, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.003200502, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000024850, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 101, 2024-09-21T02:47:20.804 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.011072255, 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000109626 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 239584 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 1, 2024-09-21T02:47:20.805 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-MDSRank": { 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1995, 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.049551014, 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000024837 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "finisher-PurgeQueue": { 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "queue_len": 0, 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "complete_latency": { 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.806 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": { 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "request": 0, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "reply": 0, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "reply_latency": { 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_reply": 0, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "forward": 0, 2024-09-21T02:47:20.807 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_complete": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_fetch_keys": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_commit": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_split": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_merge": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes": 432, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_top": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_bottom": 432, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pin_tail": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_pinned": 432, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_expired": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "inodes_with_caps": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": 0, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "subtrees": 1, 2024-09-21T02:47:20.808 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_hit": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_forward": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_discover": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_dir_fetch": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_remote_ino": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "traverse_lock": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "load_cent": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "q": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "exported": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "exported_inodes": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "imported": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "imported_inodes": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_dir_fetch": 0, 2024-09-21T02:47:20.809 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_backtrace_fetch": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "openino_peer_discover": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rfiles": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rbytes": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "root_rsnaps": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_set_tag": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_inotable_repaired": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_inodes": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "scrub_file_inodes": 0, 2024-09-21T02:47:20.810 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_inode_file_caps": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_grant": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_caps_dirty": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_cap_release": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "process_request_cap_release": 0 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_cache": { 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_update_receipt": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_try_discover": 0, 2024-09-21T02:47:20.811 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_send_discover": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "dir_handle_discover": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_delayed": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "num_strays_enqueuing": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_created": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_enqueued": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_reintegrated": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "strays_migrated": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_processing": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_enqueued": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "num_recovering_prioritized": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_started": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "recovery_completed": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_path": 0, 2024-09-21T02:47:20.812 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_quiesce_inode": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_exportdir": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_flush": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragmentdir": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_fragstats": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "ireq_inodestats": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_started": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_succeeded": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "uninline_write_failed": 0 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_log": { 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "evlrg": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "evadd": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "evex": 0, 2024-09-21T02:47:20.813 INFO:teuthology.orchestra.run.smithi090.stdout: "evtrm": 0, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "ev": 1450, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "evexg": 0, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "evexd": 0, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "segadd": 0, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "segex": 0, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "segtrm": 0, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "seg": 3, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "segmjr": 2, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "segexg": 0, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "segexd": 0, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "expos": 4194304, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "wrpos": 6721366, 2024-09-21T02:47:20.814 INFO:teuthology.orchestra.run.smithi090.stdout: "rdpos": 6720228, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "jlat": { 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "replayed": 1450 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_mem": { 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "ino": 5, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "ino+": 501, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "ino-": 496, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "dir": 3, 2024-09-21T02:47:20.815 INFO:teuthology.orchestra.run.smithi090.stdout: "dir+": 93, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "dir-": 90, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "dn": 432, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "dn+": 882, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "dn-": 450, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "cap": 0, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "cap+": 0, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "cap-": 0, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "rss": 120940, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "heap": 319565824 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_server": { 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_client_request": 0, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "dispatch_server_request": 0, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_request": 0, 2024-09-21T02:47:20.816 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_client_session": 0, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "handle_peer_request": 0, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "req_create_latency": { 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getattr_latency": { 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getfilelock_latency": { 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.817 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "req_link_latency": { 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookup_latency": { 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookuphash_latency": { 2024-09-21T02:47:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupino_latency": { 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupname_latency": { 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.819 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupparent_latency": { 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lookupsnap_latency": { 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "req_lssnap_latency": { 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.820 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mkdir_latency": { 2024-09-21T02:47:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.821 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mknod_latency": { 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "req_mksnap_latency": { 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.822 INFO:teuthology.orchestra.run.smithi090.stdout: "req_open_latency": { 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "req_readdir_latency": { 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rename_latency": { 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.823 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "req_renamesnap_latency": { 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "req_snapdiff_latency": { 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmdir_latency": { 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.824 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmsnap_latency": { 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "req_rmxattr_latency": { 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setattr_latency": { 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.825 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setdirlayout_latency": { 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setfilelock_latency": { 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setlayout_latency": { 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.826 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "req_setxattr_latency": { 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "req_symlink_latency": { 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "req_unlink_latency": { 2024-09-21T02:47:20.827 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_revoke_eviction": 0, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "cap_acquisition_throttle": 0, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "req_getvxattr_latency": { 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_sessions": { 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "session_count": 1, 2024-09-21T02:47:20.828 INFO:teuthology.orchestra.run.smithi090.stdout: "session_add": 3, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "session_remove": 2, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_open": 2, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "sessions_stale": 0, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "total_load": 0, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "average_load": 0, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "avg_session_uptime": 3345, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "mdthresh_evicted": 0 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:20.829 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:20.830 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:20.831 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 181137, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 44, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 8856, 2024-09-21T02:47:20.832 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 166, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 309560, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 1768, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "objecter": { 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "op_active": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "op_laggy": 0, 2024-09-21T02:47:20.833 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send": 1156, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "op_send_bytes": 21, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "op_resend": 3, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "op_reply": 1156, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "op_latency": { 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1156, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1.806970547, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.001563123 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "op_inflight": 0, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "oplen_avg": { 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 1156, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 1157 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.834 INFO:teuthology.orchestra.run.smithi090.stdout: "op": 1156, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "op_r": 1156, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "op_w": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "op_rmw": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "op_pg": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_stat": 704, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_create": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_read": 450, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_write": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writefull": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_writesame": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_append": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_zero": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_truncate": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_delete": 0, 2024-09-21T02:47:20.835 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_mapext": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_sparse_read": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_clonerange": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_getxattr": 1, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_setxattr": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_cmpxattr": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_rmxattr": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_resetxattrs": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_call": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_watch": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_notify": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls": 0, 2024-09-21T02:47:20.836 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_pgls_filter": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "osdop_other": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_active": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_send": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_resend": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "linger_ping": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_active": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_send": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "poolop_resend": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_active": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_send": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "poolstat_resend": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_active": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_send": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "statfs_resend": 0, 2024-09-21T02:47:20.837 INFO:teuthology.orchestra.run.smithi090.stdout: "command_active": 0, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "command_send": 0, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "command_resend": 0, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "map_epoch": 88, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "map_full": 0, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "map_inc": 3, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_sessions": 4, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_open": 4, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_session_close": 0, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_laggy": 0, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_wr": 0, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_rd": 2, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_del": 0 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.838 INFO:teuthology.orchestra.run.smithi090.stdout: "oft": { 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_objs": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_kv_pairs": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_updates": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "omap_total_removes": 0 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "purge_queue": { 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executing_high_water": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed_ops": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_executed": 0, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "pq_item_in_journal": 0 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.839 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 1307, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 3587858, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 1307, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1307, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 3587858, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.840 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_bytes": { 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 1156, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 2527067, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1156, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 2527067, 2024-09-21T02:47:20.841 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-objecter_ops": { 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 1024, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:20.842 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 1156, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 1156, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 1156, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 1156, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle": { 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:20.843 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-write_buf_throttle-0x556a76d3d520": { 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:20.844 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 3758096384, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.845 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:20.846 INFO:teuthology.orchestra.run.smithi090.stdout: "trackedop": { 2024-09-21T02:47:20.846 INFO:teuthology.orchestra.run.smithi090.stdout: "slow_ops_count": 0 2024-09-21T02:47:20.846 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:20.846 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T02:47:21.809 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T02:47:21.809 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T02:47:21.809 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T02:47:21.809 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T02:47:22.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:21 smithi172 ceph-mon[35067]: pgmap v547: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:22.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:21 smithi084 ceph-mon[30747]: pgmap v547: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:22.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:21 smithi090 ceph-mon[34571]: pgmap v547: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:22.056 INFO:teuthology.orchestra.run.smithi090.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T02:47:22.573 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-09-21T02:47:22.573 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:22.573 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 0, 2024-09-21T02:47:22.573 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 2, 2024-09-21T02:47:22.573 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 0, 2024-09-21T02:47:22.573 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 0, 2024-09-21T02:47:22.573 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 4, 2024-09-21T02:47:22.573 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 0, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.001133768, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.000362170, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:22.574 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 1, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 103, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 160, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 98368, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 3, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.008590618, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.006609109, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.000795273, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:22.575 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 101, 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.006246881, 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000061850 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 98368 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:22.576 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_messages": 145, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages": 138, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_bytes": 817472, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_bytes": 83360, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_created_connections": 2, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_active_connections": 1, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_total_time": 0.030097258, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_send_time": 0.012380815, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_recv_time": 0.024951352, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 138, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.011898330, 2024-09-21T02:47:22.577 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000086219 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_recv_encrypted_bytes": 817472, 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "msgr_send_encrypted_bytes": 83360 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "cct": { 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "total_workers": 0, 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: "unhealthy_workers": 0 2024-09-21T02:47:22.578 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "mempool": { 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:22.579 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:22.580 INFO:teuthology.orchestra.run.smithi090.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_items": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_bytes": 148863, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_anon_items": 28, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_bytes": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_items": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:22.581 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_bytes": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_items": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "pgmap_items": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_bytes": 968, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_co_items": 2, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_1_items": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "unittest_2_items": 0 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:22.582 INFO:teuthology.orchestra.run.smithi090.stdout: "val": 0, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "max": 104857600, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "get_started": 0, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "get": 142, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "get_sum": 794606, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "get_or_fail_success": 142, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "take": 0, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "take_sum": 0, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "put": 142, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "put_sum": 794606, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "wait": { 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "avgcount": 0, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "sum": 0.000000000, 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: "avgtime": 0.000000000 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:22.583 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-09-21T02:47:22.584 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-09-21T02:47:23.220 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T02:47:23.221 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T02:47:23.221 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T02:47:23.221 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T02:47:23.480 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:47:23.966 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:23 smithi172 ceph-mon[35067]: pgmap v548: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:24.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:23 smithi084 ceph-mon[30747]: pgmap v548: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:24.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:23 smithi090 ceph-mon[34571]: pgmap v548: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:24.086 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T02:47:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:24.086 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 15991, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 19487, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 7031066, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 47184039, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 9, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 1.741772698, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.872434575, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.449406098, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.348538216, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 19487, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.418370254, 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000072785 2024-09-21T02:47:24.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 12592, 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002566498, 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000203 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 12329, 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 12426, 2024-09-21T02:47:24.088 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 3120004, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 55235230, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 12, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 1.563156542, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.806236882, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.264339823, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.396608478, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 12425, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.215256092, 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000097807 2024-09-21T02:47:24.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000573, 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000143 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 239776 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 51517, 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 99464, 2024-09-21T02:47:24.090 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 19121275, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 50474919, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 12, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 8, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 4.223827908, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 2.626879458, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 2.127779194, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.171703046, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 99461, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1485.399959226, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.014934496 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 75078, 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.018637318, 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000248 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 874176, 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 88848 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T02:47:24.092 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5509, 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 25.063410737, 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004549539 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 18049, 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3.630107592, 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000201125 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.093 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 26191, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 26122, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 26122, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 100.554900422, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003849433 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 69, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 110, 2024-09-21T02:47:24.094 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 11, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 3, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 391, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 254, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 124, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 13, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 26, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 893, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 30299, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 29543, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 20, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 165, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-21T02:47:24.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 33, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 660, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 213, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 2726, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 3720, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 125874512, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T02:47:24.096 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 134, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 9512, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 23505, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 19761, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 11284, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 413, 2024-09-21T02:47:24.097 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 13524 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 188, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 18, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 13, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 10941, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 10928, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-21T02:47:24.098 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-21T02:47:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-21T02:47:24.099 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-21T02:47:24.101 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 4, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 7842, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 33, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 14, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-21T02:47:24.102 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 52341, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 52341, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 67, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-21T02:47:24.103 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 67, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 6, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 110271835, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5575, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 73.420745329, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.013169640 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.104 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 33, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 11405, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 11372, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 32, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 747, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 715, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 391, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 18740, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 18349, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 14458, 2024-09-21T02:47:24.105 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 14458, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 164960, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 397225984 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 29888, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 93, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 26191, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 35, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 298, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10272, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 11.334787990, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001103464 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.106 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 27, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.025817275, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000956195 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.107 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3492, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.049432555, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001159631 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.108 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.109 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-21T02:47:24.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 366, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.275718075, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000753328 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.111 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 985, 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.212586601, 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001231052 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 604, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 10.641576721, 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.017618504 2024-09-21T02:47:24.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 39, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3.374420375, 2024-09-21T02:47:24.114 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.086523599 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.115 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10337, 2024-09-21T02:47:24.116 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 69.640560830, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006737018 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-09-21T02:47:24.117 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 14537, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 14537, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 164, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:24.118 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:24.119 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:24.120 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 287702, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 108, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8856, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 166, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:24.121 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 412067, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 6846, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 27728, 2024-09-21T02:47:24.122 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 110336396, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 33, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 27728, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 27728, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 135.327624218, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004880540 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 27728, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 27993 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 27728, 2024-09-21T02:47:24.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 209, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 27519, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 209, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 5784, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 101, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 11, 2024-09-21T02:47:24.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 21407, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-21T02:47:24.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-21T02:47:24.126 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 4, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 374, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-21T02:47:24.127 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 77 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 23, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 15, 2024-09-21T02:47:24.128 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 21350, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 10928, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 79833, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 22809732, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 79833, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:24.129 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 79833, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 22809732, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:24.130 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 27728, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 111522916, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 27728, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 111522916, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.131 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 27728, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 27728, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 27728, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 27728, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.132 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 10928, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1186520, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 10928, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 209, 2024-09-21T02:47:24.133 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1186520, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x563bb838f520": { 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 52341, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 106077531, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:24.134 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 52341, 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 5575, 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 106077531, 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 7848 2024-09-21T02:47:24.135 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:24.136 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T02:47:24.923 INFO:tasks.check_counter:Daemon mds.c mds.exported=33 2024-09-21T02:47:24.923 INFO:tasks.check_counter:Daemon mds.c mds.imported=213 2024-09-21T02:47:24.923 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T02:47:24.924 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T02:47:25.173 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 755, 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 757, 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4421785, 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 240100, 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.097500240, 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.040182940, 2024-09-21T02:47:25.709 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.024263118, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.025353829, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 755, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.031691751, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000041975 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:25.710 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 169, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 266, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4649636, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 291852, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.029397366, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.012992879, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.009738893, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.004626217, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 265, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.019528040, 2024-09-21T02:47:25.711 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000073690 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 239952 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 549, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 537, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 5152585, 2024-09-21T02:47:25.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 208459, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 3, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.075127834, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.033168189, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.034544733, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.011688127, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 536, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.022132024, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000041291 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 859696, 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 82848 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2171, 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.073796248, 2024-09-21T02:47:25.714 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000033991 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-21T02:47:25.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 633, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 363, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 270, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 114, 2024-09-21T02:47:25.716 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-21T02:47:25.717 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-21T02:47:25.718 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-21T02:47:25.719 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-21T02:47:25.720 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-21T02:47:25.721 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 5601, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 21, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 16817322, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 17187288, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 17182616, 2024-09-21T02:47:25.722 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 5601 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 22, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 3245, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 3223, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 20, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 341, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 321, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 633, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 3802, 2024-09-21T02:47:25.723 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 3169, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 126668, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 328441856 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-21T02:47:25.724 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.726 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.727 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.728 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.729 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.730 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.731 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.732 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.733 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.734 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-21T02:47:25.735 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 4, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 3, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 3430, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:25.736 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:25.737 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-21T02:47:25.738 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 189313, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 50, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8856, 2024-09-21T02:47:25.739 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 166, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 506680, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 3715, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 1313, 2024-09-21T02:47:25.740 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 1313, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1313, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.705957949, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001299282 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1313, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1314 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 1313, 2024-09-21T02:47:25.741 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 1313, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 802, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 508, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-21T02:47:25.742 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-21T02:47:25.743 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-21T02:47:25.744 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 3, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 5, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 5, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-21T02:47:25.745 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T02:47:25.746 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1469, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 14080981, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1469, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1469, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 14080981, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1313, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12993618, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1313, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12993618, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.748 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1313, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1313, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1313, 2024-09-21T02:47:25.749 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1313, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:25.750 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x5582fd769520": { 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T02:47:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:25.752 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T02:47:26.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:25 smithi172 ceph-mon[35067]: pgmap v549: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:26.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:25 smithi084 ceph-mon[30747]: pgmap v549: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:26.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:25 smithi090 ceph-mon[34571]: pgmap v549: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:26.515 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T02:47:26.515 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T02:47:26.515 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T02:47:26.516 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T02:47:26.780 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:47:27.411 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T02:47:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1189, 2024-09-21T02:47:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1024, 2024-09-21T02:47:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 446017, 2024-09-21T02:47:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 2910911, 2024-09-21T02:47:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 11, 2024-09-21T02:47:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-21T02:47:27.412 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.116182113, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.054200680, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.043666131, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.017498410, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1022, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.069811433, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000068308 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1100, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000231248, 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000210 2024-09-21T02:47:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1535, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 3048, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 497577, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 1795877, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 11, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.150605738, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.092187223, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.059462548, 2024-09-21T02:47:27.414 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.006389511, 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3046, 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.187184755, 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000061452 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1880, 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000521339, 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000277 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 244048 2024-09-21T02:47:27.415 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2358, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1742, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1889506, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 635468, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 10, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.188746811, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.084332981, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.117441957, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.015768488, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1742, 2024-09-21T02:47:27.416 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.125071927, 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000071797 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2679, 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000420424, 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000156 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 881600, 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 90736 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-21T02:47:27.417 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 440, 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.515871948, 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001172436 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 820, 2024-09-21T02:47:27.418 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.062575066, 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000076311 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 930, 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 914, 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 914, 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.821604338, 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000898910 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-21T02:47:27.419 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 16, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 23, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 5, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 18, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 14, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 61, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 2, 2024-09-21T02:47:27.420 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 2, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 4, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 1444, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 1328, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 13, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 38, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 1, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 22, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 22, 2024-09-21T02:47:27.421 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 381, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 3720, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 125874512, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T02:47:27.422 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 165, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 576, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 349, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 184, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 21, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 854 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-21T02:47:27.423 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 23, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 6, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 430, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 430, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-21T02:47:27.424 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 4, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 148, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 22, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 1450, 2024-09-21T02:47:27.425 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 1450, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 3, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 3, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 6721366, 2024-09-21T02:47:27.426 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 210, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.688544990, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003278785 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 28, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 489, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 461, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 27, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 80, 2024-09-21T02:47:27.427 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 53, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 23, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 895, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 872, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 2, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 510, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 508, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 126412, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 336412672 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 1011, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 17, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 930, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 12, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 77, 2024-09-21T02:47:27.428 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 59, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.036234970, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000614152 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.003035680, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001011893 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.429 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 390, 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.240306484, 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000616170 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000398472, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000398472 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-21T02:47:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-21T02:47:27.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-21T02:47:27.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 31, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.015731312, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000507461 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.435 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.046099377, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.011524844 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.436 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-21T02:47:27.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-21T02:47:27.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 426, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.479798043, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001126286 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 750, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 750, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 287, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.440 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:27.441 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:27.442 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 279205, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 93, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-21T02:47:27.443 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8856, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 166, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 115329, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 469, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:27.444 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 1254, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 2653740, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 28, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 1254, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1254, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 5.873853753, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004684093 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-21T02:47:27.445 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1254, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1337 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 1254, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 34, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 1220, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 34, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 244, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 35, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-21T02:47:27.446 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 868, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T02:47:27.447 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-21T02:47:27.448 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 4, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 95, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 31 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-21T02:47:27.449 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 17, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 9, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 856, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 430, 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-21T02:47:27.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 5078, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2384157, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 5078, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 5078, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2384157, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.451 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1254, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 2700578, 2024-09-21T02:47:27.452 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1254, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2700578, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:27.453 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1254, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1254, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1254, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1254, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:27.454 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 430, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 46838, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 430, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 34, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 46838, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.455 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55a326ba31e0": { 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1450, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2527062, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1450, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 210, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2527062, 2024-09-21T02:47:27.456 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 152 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:27.457 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T02:47:27.946 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:27 smithi172 ceph-mon[35067]: pgmap v550: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:28.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:27 smithi084 ceph-mon[30747]: pgmap v550: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:28.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:27 smithi090 ceph-mon[34571]: pgmap v550: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:28.256 INFO:tasks.check_counter:Daemon mds.i mds.exported=22 2024-09-21T02:47:28.256 INFO:tasks.check_counter:Daemon mds.i mds.imported=22 2024-09-21T02:47:28.256 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T02:47:28.256 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T02:47:28.504 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 148, 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 141, 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 818288, 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 85280, 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 0, 2024-09-21T02:47:29.045 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.031215263, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.012044429, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.025740203, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 141, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.012533934, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000088893 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 818288, 2024-09-21T02:47:29.046 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 85280 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 105, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 160, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 98720, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 3, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.008772407, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.006882891, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.000719750, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 103, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.007045246, 2024-09-21T02:47:29.047 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000068400 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 98720 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 0, 2024-09-21T02:47:29.048 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 0, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 0, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 2, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 1, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.000220659, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.000141047, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:29.049 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 0, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-21T02:47:29.050 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T02:47:29.051 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 148945, 2024-09-21T02:47:29.052 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 29, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-21T02:47:29.053 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 968, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 2, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 145, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 794996, 2024-09-21T02:47:29.054 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 145, 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 145, 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 794996, 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T02:47:29.055 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T02:47:29.722 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:29 smithi172 ceph-mon[35067]: pgmap v551: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:29.749 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T02:47:29.749 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T02:47:29.749 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T02:47:29.766 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T02:47:29.766 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:47:29.766 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:47:29.807 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T02:47:29.846 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T02:47:29.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T02:47:29.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:29 smithi084 ceph-mon[30747]: pgmap v551: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:30.016 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:29 smithi090 ceph-mon[34571]: pgmap v551: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:30.300 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 -- 172.21.15.84:0/1573265292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3958105b00 msgr2=0x7f395810f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 --2- 172.21.15.84:0/1573265292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3958105b00 0x7f395810f570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3950009ca0 tx=0x7f395002a8c0 comp rx=0 tx=0).stop 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 -- 172.21.15.84:0/1573265292 shutdown_connections 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 --2- 172.21.15.84:0/1573265292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3958105b00 0x7f395810f570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 --2- 172.21.15.84:0/1573265292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39581051b0 0x7f39581055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 --2- 172.21.15.84:0/1573265292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3958102b30 0x7f3958102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 -- 172.21.15.84:0/1573265292 >> 172.21.15.84:0/1573265292 conn(0x7f39580799a0 msgr2=0x7f3958079db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 -- 172.21.15.84:0/1573265292 shutdown_connections 2024-09-21T02:47:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.969+0000 7f395fa00640 1 -- 172.21.15.84:0/1573265292 wait complete. 2024-09-21T02:47:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.970+0000 7f395fa00640 1 Processor -- start 2024-09-21T02:47:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.970+0000 7f395fa00640 1 -- start start 2024-09-21T02:47:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395fa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3958102b30 0x7f395819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395fa00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39581051b0 0x7f395819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395fa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3958105b00 0x7f395819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395fa00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3958113c40 con 0x7f3958102b30 2024-09-21T02:47:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395fa00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3958113ac0 con 0x7f39581051b0 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395fa00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3958113dc0 con 0x7f3958105b00 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3958102b30 0x7f395819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395d000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3958102b30 0x7f395819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50300/0 (socket says 172.21.15.84:50300) 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f394fe00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39581051b0 0x7f395819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395d000640 1 -- 172.21.15.84:0/2896337806 learned_addr learned my addr 172.21.15.84:0/2896337806 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.971+0000 7f395da00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3958105b00 0x7f395819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f394fe00640 1 -- 172.21.15.84:0/2896337806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3958105b00 msgr2=0x7f395819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f394fe00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3958105b00 0x7f395819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f394fe00640 1 -- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3958102b30 msgr2=0x7f395819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f394fe00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3958102b30 0x7f395819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f394fe00640 1 -- 172.21.15.84:0/2896337806 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39581a04c0 con 0x7f39581051b0 2024-09-21T02:47:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f394fe00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39581051b0 0x7f395819aaf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f395806b630 tx=0x7f394000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f3956000640 1 -- 172.21.15.84:0/2896337806 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394000cc40 con 0x7f39581051b0 2024-09-21T02:47:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f3956000640 1 -- 172.21.15.84:0/2896337806 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f394000cde0 con 0x7f39581051b0 2024-09-21T02:47:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39581a07b0 con 0x7f39581051b0 2024-09-21T02:47:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f3956000640 1 -- 172.21.15.84:0/2896337806 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940018810 con 0x7f39581051b0 2024-09-21T02:47:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.972+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395810ff30 con 0x7f39581051b0 2024-09-21T02:47:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.973+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3958102f40 con 0x7f39581051b0 2024-09-21T02:47:30.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.976+0000 7f3956000640 1 -- 172.21.15.84:0/2896337806 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f3940010b40 con 0x7f39581051b0 2024-09-21T02:47:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.977+0000 7f3956000640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f393c0b6590 0x7f393c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.977+0000 7f3956000640 1 -- 172.21.15.84:0/2896337806 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f39400e7e10 con 0x7f39581051b0 2024-09-21T02:47:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.977+0000 7f395d000640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f393c0b6590 0x7f393c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.978+0000 7f395d000640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f393c0b6590 0x7f393c0b8aa0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3948009cd0 tx=0x7f3948005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:30.979+0000 7f3956000640 1 -- 172.21.15.84:0/2896337806 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39400b2690 con 0x7f39581051b0 2024-09-21T02:47:31.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.178+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f395819b680 con 0x7f39581051b0 2024-09-21T02:47:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.178+0000 7f3956000640 1 -- 172.21.15.84:0/2896337806 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+590 (secure 0 0 0) 0x7f39400b75d0 con 0x7f39581051b0 2024-09-21T02:47:31.180 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3670733962 2024-09-22T02:31:41.471413+0000 2024-09-21T02:47:31.180 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3670733962 2024-09-22T02:31:41.471413+0000 2024-09-21T02:47:31.180 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3048700539 2024-09-22T02:31:41.471413+0000 2024-09-21T02:47:31.180 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1797182197 2024-09-22T02:31:12.328817+0000 2024-09-21T02:47:31.180 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2355445501 2024-09-22T02:31:41.471413+0000 2024-09-21T02:47:31.181 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/239259500 2024-09-22T02:31:12.328817+0000 2024-09-21T02:47:31.181 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/4193451827 2024-09-22T02:31:12.328817+0000 2024-09-21T02:47:31.181 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3180377571 2024-09-22T02:31:41.471413+0000 2024-09-21T02:47:31.181 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/950512595 2024-09-22T02:31:12.328817+0000 2024-09-21T02:47:31.181 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/4193451827 2024-09-22T02:31:12.328817+0000 2024-09-21T02:47:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:listed 10 entries 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f393c0b6590 msgr2=0x7f393c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f393c0b6590 0x7f393c0b8aa0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3948009cd0 tx=0x7f3948005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39581051b0 msgr2=0x7f395819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39581051b0 0x7f395819aaf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f395806b630 tx=0x7f394000ee50 comp rx=0 tx=0).stop 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 shutdown_connections 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f393c0b6590 0x7f393c0b8aa0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3958105b00 0x7f395819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39581051b0 0x7f395819aaf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 --2- 172.21.15.84:0/2896337806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3958102b30 0x7f395819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:31.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 >> 172.21.15.84:0/2896337806 conn(0x7f39580799a0 msgr2=0x7f3958106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 shutdown_connections 2024-09-21T02:47:31.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:31.181+0000 7f395fa00640 1 -- 172.21.15.84:0/2896337806 wait complete. 2024-09-21T02:47:31.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:31 smithi084 ceph-mon[30747]: pgmap v552: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:31.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:31 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2896337806' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:47:31.978 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T02:47:31.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:47:31.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T02:47:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:31 smithi172 ceph-mon[35067]: pgmap v552: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:32.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:31 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2896337806' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:47:32.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:31 smithi090 ceph-mon[34571]: pgmap v552: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:32.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:31 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2896337806' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T02:47:32.083 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:47:32.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:47:32.084 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T02:47:32.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:47:32.159 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T02:47:32.217 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T02:47:32.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:47:32.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T02:47:32.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T02:47:32.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-09-21T02:47:32.576 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T02:47:32.588 INFO:tasks.cephadm:Teardown begin 2024-09-21T02:47:32.588 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T02:47:32.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:47:32.965 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:33.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.591+0000 7f7fda600640 1 -- 172.21.15.84:0/1269154565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd41025f0 msgr2=0x7f7fd4102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:33.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.591+0000 7f7fda600640 1 --2- 172.21.15.84:0/1269154565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd41025f0 0x7f7fd4102a00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009900 tx=0x7f7fc402a480 comp rx=0 tx=0).stop 2024-09-21T02:47:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.591+0000 7f7fda600640 1 -- 172.21.15.84:0/1269154565 shutdown_connections 2024-09-21T02:47:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.591+0000 7f7fda600640 1 --2- 172.21.15.84:0/1269154565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd41101a0 0x7f7fd41125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.591+0000 7f7fda600640 1 --2- 172.21.15.84:0/1269154565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd4102f40 0x7f7fd410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.591+0000 7f7fda600640 1 --2- 172.21.15.84:0/1269154565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd41025f0 0x7f7fd4102a00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.591+0000 7f7fda600640 1 -- 172.21.15.84:0/1269154565 >> 172.21.15.84:0/1269154565 conn(0x7f7fd4079740 msgr2=0x7f7fd4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.592+0000 7f7fda600640 1 -- 172.21.15.84:0/1269154565 shutdown_connections 2024-09-21T02:47:33.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.592+0000 7f7fda600640 1 -- 172.21.15.84:0/1269154565 wait complete. 2024-09-21T02:47:33.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.593+0000 7f7fda600640 1 Processor -- start 2024-09-21T02:47:33.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.593+0000 7f7fda600640 1 -- start start 2024-09-21T02:47:33.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fda600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd41025f0 0x7f7fd419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:33.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fda600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4102f40 0x7f7fd419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:33.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fda600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd41101a0 0x7f7fd41a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fda600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4115d70 con 0x7f7fd4102f40 2024-09-21T02:47:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fda600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4115bf0 con 0x7f7fd41101a0 2024-09-21T02:47:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fda600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4115ef0 con 0x7f7fd41025f0 2024-09-21T02:47:33.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fd2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4102f40 0x7f7fd419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fd3400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd41025f0 0x7f7fd419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fd2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4102f40 0x7f7fd419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50312/0 (socket says 172.21.15.84:50312) 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.594+0000 7f7fd2a00640 1 -- 172.21.15.84:0/3153558925 learned_addr learned my addr 172.21.15.84:0/3153558925 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.595+0000 7f7fd3e00640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd41101a0 0x7f7fd41a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.595+0000 7f7fd3e00640 1 -- 172.21.15.84:0/3153558925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd41025f0 msgr2=0x7f7fd419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.595+0000 7f7fd3e00640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd41025f0 0x7f7fd419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.595+0000 7f7fd3e00640 1 -- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4102f40 msgr2=0x7f7fd419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.595+0000 7f7fd3e00640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4102f40 0x7f7fd419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.595+0000 7f7fd3e00640 1 -- 172.21.15.84:0/3153558925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd41a26b0 con 0x7f7fd41101a0 2024-09-21T02:47:33.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.595+0000 7f7fd3e00640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd41101a0 0x7f7fd41a1f80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009fd0 tx=0x7f7fcc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.595+0000 7f7fcbe00640 1 -- 172.21.15.84:0/3153558925 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc00ce20 con 0x7f7fd41101a0 2024-09-21T02:47:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.596+0000 7f7fcbe00640 1 -- 172.21.15.84:0/3153558925 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7fcc005020 con 0x7f7fd41101a0 2024-09-21T02:47:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.596+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd41a29a0 con 0x7f7fd41101a0 2024-09-21T02:47:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.596+0000 7f7fcbe00640 1 -- 172.21.15.84:0/3153558925 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc010720 con 0x7f7fd41101a0 2024-09-21T02:47:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.596+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd41a9100 con 0x7f7fd41101a0 2024-09-21T02:47:33.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.597+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd406c240 con 0x7f7fd41101a0 2024-09-21T02:47:33.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.601+0000 7f7fcbe00640 1 -- 172.21.15.84:0/3153558925 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f7fcc005560 con 0x7f7fd41101a0 2024-09-21T02:47:33.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.603+0000 7f7fcbe00640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fb80b6510 0x7f7fb80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:33.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.603+0000 7f7fcbe00640 1 -- 172.21.15.84:0/3153558925 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f7fcc0e7d80 con 0x7f7fd41101a0 2024-09-21T02:47:33.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.603+0000 7f7fd3400640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fb80b6510 0x7f7fb80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:33.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.603+0000 7f7fcbe00640 1 -- 172.21.15.84:0/3153558925 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fcc0ae220 con 0x7f7fd41101a0 2024-09-21T02:47:33.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.604+0000 7f7fd3400640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fb80b6510 0x7f7fb80b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009230 tx=0x7f7fc40058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:33.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:33 smithi084 ceph-mon[30747]: pgmap v553: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:33.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.842+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fd4102a00 con 0x7f7fd41101a0 2024-09-21T02:47:33.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.843+0000 7f7fcbe00640 1 -- 172.21.15.84:0/3153558925 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11916 (secure 0 0 0) 0x7f7fcc0b2600 con 0x7f7fd41101a0 2024-09-21T02:47:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:47:33.845 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":32,"btime":"2024-09-21T02:46:34:361445+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:46:34.308556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:47:33.845 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 32 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fb80b6510 msgr2=0x7f7fb80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fb80b6510 0x7f7fb80b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009230 tx=0x7f7fc40058d0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd41101a0 msgr2=0x7f7fd41a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd41101a0 0x7f7fd41a1f80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009fd0 tx=0x7f7fcc00ef10 comp rx=0 tx=0).stop 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 shutdown_connections 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fd41101a0 0x7f7fd41a1f80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd4102f40 0x7f7fd419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f7fb80b6510 0x7f7fb80b8a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 --2- 172.21.15.84:0/3153558925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fd41025f0 0x7f7fd419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 >> 172.21.15.84:0/3153558925 conn(0x7f7fd4079740 msgr2=0x7f7fd4109d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 shutdown_connections 2024-09-21T02:47:33.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:33.846+0000 7f7fda600640 1 -- 172.21.15.84:0/3153558925 wait complete. 2024-09-21T02:47:34.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:33 smithi172 ceph-mon[35067]: pgmap v553: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:34.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:33 smithi090 ceph-mon[34571]: pgmap v553: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T02:47:34.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T02:47:35.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:34 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3153558925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:35.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:34 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3153558925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:35.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:34 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3153558925' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:35.040 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:35.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 -- 172.21.15.84:0/1625691078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781092f0 msgr2=0x7f9a78109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 --2- 172.21.15.84:0/1625691078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781092f0 0x7f9a78109700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009900 tx=0x7f9a6402a410 comp rx=0 tx=0).stop 2024-09-21T02:47:35.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 -- 172.21.15.84:0/1625691078 shutdown_connections 2024-09-21T02:47:35.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 --2- 172.21.15.84:0/1625691078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a78109c40 0x7f9a78110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 --2- 172.21.15.84:0/1625691078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781092f0 0x7f9a78109700 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 --2- 172.21.15.84:0/1625691078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a781039b0 0x7f9a78103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 -- 172.21.15.84:0/1625691078 >> 172.21.15.84:0/1625691078 conn(0x7f9a780ff440 msgr2=0x7f9a78101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:35.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 -- 172.21.15.84:0/1625691078 shutdown_connections 2024-09-21T02:47:35.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.625+0000 7f9a7e800640 1 -- 172.21.15.84:0/1625691078 wait complete. 2024-09-21T02:47:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.626+0000 7f9a7e800640 1 Processor -- start 2024-09-21T02:47:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.626+0000 7f9a7e800640 1 -- start start 2024-09-21T02:47:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781039b0 0x7f9a78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7e800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a781092f0 0x7f9a78075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7e800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a78109c40 0x7f9a78076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7e800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78113a20 con 0x7f9a781039b0 2024-09-21T02:47:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7e800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781138a0 con 0x7f9a781092f0 2024-09-21T02:47:35.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7e800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78113ba0 con 0x7f9a78109c40 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781039b0 0x7f9a78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781039b0 0x7f9a78075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50326/0 (socket says 172.21.15.84:50326) 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7d400640 1 -- 172.21.15.84:0/2632230133 learned_addr learned my addr 172.21.15.84:0/2632230133 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7de00640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a78109c40 0x7f9a78076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.627+0000 7f9a7ca00640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a781092f0 0x7f9a78075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a7d400640 1 -- 172.21.15.84:0/2632230133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a78109c40 msgr2=0x7f9a78076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a7d400640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a78109c40 0x7f9a78076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a7d400640 1 -- 172.21.15.84:0/2632230133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a781092f0 msgr2=0x7f9a78075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a7d400640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a781092f0 0x7f9a78075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a7d400640 1 -- 172.21.15.84:0/2632230133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a781a86b0 con 0x7f9a781039b0 2024-09-21T02:47:35.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a7d400640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781039b0 0x7f9a78075710 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00e9f0 tx=0x7f9a6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a76000640 1 -- 172.21.15.84:0/2632230133 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c00cd80 con 0x7f9a781039b0 2024-09-21T02:47:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a781a89a0 con 0x7f9a781039b0 2024-09-21T02:47:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a76000640 1 -- 172.21.15.84:0/2632230133 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9a6c010900 con 0x7f9a781039b0 2024-09-21T02:47:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a76000640 1 -- 172.21.15.84:0/2632230133 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0188d0 con 0x7f9a781039b0 2024-09-21T02:47:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.628+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a781a8f00 con 0x7f9a781039b0 2024-09-21T02:47:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.630+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a78103dc0 con 0x7f9a781039b0 2024-09-21T02:47:35.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.632+0000 7f9a76000640 1 -- 172.21.15.84:0/2632230133 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f9a6c010ab0 con 0x7f9a781039b0 2024-09-21T02:47:35.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.633+0000 7f9a76000640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9a600b6590 0x7f9a600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:35.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.633+0000 7f9a76000640 1 -- 172.21.15.84:0/2632230133 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f9a6c0e7c30 con 0x7f9a781039b0 2024-09-21T02:47:35.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.633+0000 7f9a7ca00640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9a600b6590 0x7f9a600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:35.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.634+0000 7f9a7ca00640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9a600b6590 0x7f9a600b8aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a64005940 tx=0x7f9a640058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.635+0000 7f9a76000640 1 -- 172.21.15.84:0/2632230133 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a6c0b24b0 con 0x7f9a781039b0 2024-09-21T02:47:35.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.868+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a78076a10 con 0x7f9a781039b0 2024-09-21T02:47:35.870 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:35 smithi084 ceph-mon[30747]: pgmap v554: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.869+0000 7f9a76000640 1 -- 172.21.15.84:0/2632230133 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11916 (secure 0 0 0) 0x7f9a78076a10 con 0x7f9a781039b0 2024-09-21T02:47:35.871 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:47:35.871 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":32,"btime":"2024-09-21T02:46:34:361445+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14631,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/688117760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":688117760},{"type":"v1","addr":"172.21.15.84:6837","nonce":688117760}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/594957392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":594957392},{"type":"v1","addr":"172.21.15.84:6839","nonce":594957392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/3752727807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":3752727807},{"type":"v1","addr":"172.21.15.84:6841","nonce":3752727807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6833/1029758123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1029758123},{"type":"v1","addr":"172.21.15.90:6833","nonce":1029758123}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1475355449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1475355449},{"type":"v1","addr":"172.21.15.172:6833","nonce":1475355449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/3765261714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3765261714},{"type":"v1","addr":"172.21.15.84:6835","nonce":3765261714}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T02:39:47.859217+0000","modified":"2024-09-21T02:46:34.308556+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24704,"mds_1":24703,"mds_2":24679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6835/1905318969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1905318969},{"type":"v1","addr":"172.21.15.90:6835","nonce":1905318969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.90:6837/939715852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":939715852},{"type":"v1","addr":"172.21.15.90:6837","nonce":939715852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/2876777250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2876777250},{"type":"v1","addr":"172.21.15.172:6835","nonce":2876777250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24679":{"gid":24679,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":22,"addr":"172.21.15.172:6837/3475533235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3475533235},{"type":"v1","addr":"172.21.15.172:6837","nonce":3475533235}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24703":{"gid":24703,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.172:6839/3937933536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3937933536},{"type":"v1","addr":"172.21.15.172:6839","nonce":3937933536}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24704":{"gid":24704,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.90:6839/3427873852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6838","nonce":3427873852},{"type":"v1","addr":"172.21.15.90:6839","nonce":3427873852}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24704,"qdb_cluster":[24704,24703,24679]},"id":1}]} 2024-09-21T02:47:35.871 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 32 2024-09-21T02:47:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9a600b6590 msgr2=0x7f9a600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9a600b6590 0x7f9a600b8aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a64005940 tx=0x7f9a640058d0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781039b0 msgr2=0x7f9a78075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781039b0 0x7f9a78075710 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00e9f0 tx=0x7f9a6c00eeb0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 shutdown_connections 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f9a600b6590 0x7f9a600b8aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a78109c40 0x7f9a78076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a781092f0 0x7f9a78075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 --2- 172.21.15.84:0/2632230133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a781039b0 0x7f9a78075710 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 >> 172.21.15.84:0/2632230133 conn(0x7f9a780ff440 msgr2=0x7f9a78101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 shutdown_connections 2024-09-21T02:47:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:35.872+0000 7f9a7e800640 1 -- 172.21.15.84:0/2632230133 wait complete. 2024-09-21T02:47:36.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:35 smithi172 ceph-mon[35067]: pgmap v554: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:36.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:35 smithi090 ceph-mon[34571]: pgmap v554: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:36.644 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T02:47:37.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:36 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2632230133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:37.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:36 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2632230133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:37.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:36 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2632230133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T02:47:37.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 -- 172.21.15.84:0/1763170596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac1092d0 msgr2=0x7f47ac1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:37.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 --2- 172.21.15.84:0/1763170596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac1092d0 0x7f47ac1096e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4798009900 tx=0x7f479802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 -- 172.21.15.84:0/1763170596 shutdown_connections 2024-09-21T02:47:37.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 --2- 172.21.15.84:0/1763170596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac109c20 0x7f47ac110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 --2- 172.21.15.84:0/1763170596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac1092d0 0x7f47ac1096e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 --2- 172.21.15.84:0/1763170596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac103990 0x7f47ac103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 -- 172.21.15.84:0/1763170596 >> 172.21.15.84:0/1763170596 conn(0x7f47ac0ff3e0 msgr2=0x7f47ac101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 -- 172.21.15.84:0/1763170596 shutdown_connections 2024-09-21T02:47:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.679+0000 7f47ab200640 1 -- 172.21.15.84:0/1763170596 wait complete. 2024-09-21T02:47:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.680+0000 7f47ab200640 1 Processor -- start 2024-09-21T02:47:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47ab200640 1 -- start start 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47ab200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac103990 0x7f47ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47ab200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac1092d0 0x7f47ac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47ab200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac109c20 0x7f47ac076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47ab200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac113a00 con 0x7f47ac103990 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47ab200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac113880 con 0x7f47ac1092d0 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47ab200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac113b80 con 0x7f47ac109c20 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47a9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac103990 0x7f47ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47aa800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac109c20 0x7f47ac076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47a9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac103990 0x7f47ac075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50348/0 (socket says 172.21.15.84:50348) 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.681+0000 7f47a9e00640 1 -- 172.21.15.84:0/4217078548 learned_addr learned my addr 172.21.15.84:0/4217078548 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.682+0000 7f47a9400640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac1092d0 0x7f47ac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.682+0000 7f47a9e00640 1 -- 172.21.15.84:0/4217078548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac109c20 msgr2=0x7f47ac076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.682+0000 7f47a9e00640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac109c20 0x7f47ac076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.682+0000 7f47a9e00640 1 -- 172.21.15.84:0/4217078548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac1092d0 msgr2=0x7f47ac075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.682+0000 7f47a9e00640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac1092d0 0x7f47ac075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.682+0000 7f47a9e00640 1 -- 172.21.15.84:0/4217078548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ac1a86b0 con 0x7f47ac103990 2024-09-21T02:47:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.682+0000 7f47a9e00640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac103990 0x7f47ac075710 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f479c00e9f0 tx=0x7f479c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.682+0000 7f47a2a00640 1 -- 172.21.15.84:0/4217078548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479c00ccc0 con 0x7f47ac103990 2024-09-21T02:47:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.683+0000 7f47a2a00640 1 -- 172.21.15.84:0/4217078548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f479c00ce60 con 0x7f47ac103990 2024-09-21T02:47:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.683+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ac1a89a0 con 0x7f47ac103990 2024-09-21T02:47:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.683+0000 7f47a2a00640 1 -- 172.21.15.84:0/4217078548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479c010690 con 0x7f47ac103990 2024-09-21T02:47:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.683+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ac1a8e60 con 0x7f47ac103990 2024-09-21T02:47:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.684+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ac103da0 con 0x7f47ac103990 2024-09-21T02:47:37.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.686+0000 7f47a2a00640 1 -- 172.21.15.84:0/4217078548 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f479c0046c0 con 0x7f47ac103990 2024-09-21T02:47:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.687+0000 7f47a2a00640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47900b6510 0x7f47900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:37.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.688+0000 7f47a2a00640 1 -- 172.21.15.84:0/4217078548 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7f479c0e7ad0 con 0x7f47ac103990 2024-09-21T02:47:37.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.688+0000 7f47a9400640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47900b6510 0x7f47900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:37.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.688+0000 7f47a9400640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47900b6510 0x7f47900b8a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4798005940 tx=0x7f47980058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:37.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.692+0000 7f47a2a00640 1 -- 172.21.15.84:0/4217078548 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f479c0adf70 con 0x7f47ac103990 2024-09-21T02:47:37.763 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:37 smithi084 ceph-mon[30747]: pgmap v555: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:37.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.884+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47ac02e640 con 0x7f47ac103990 2024-09-21T02:47:37.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.885+0000 7f47a2a00640 1 -- 172.21.15.84:0/4217078548 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24819 (secure 0 0 0) 0x7f479c0b2350 con 0x7f47ac103990 2024-09-21T02:47:37.887 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T02:47:37.888 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":88,"fsid":"5b18da14-77c1-11ef-baf5-efdc52797490","created":"2024-09-21T02:30:39.705635+0000","modified":"2024-09-21T02:41:44.334281+0000","last_up_change":"2024-09-21T02:38:50.684424+0000","last_in_change":"2024-09-21T02:38:28.234333+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T02:34:41.799617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T02:39:42.063636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T02:39:44.892150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T02:39:54.907352+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d5e3c2be-3797-41fc-ad09-a84eaae5cd87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6803","nonce":3291842956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6805","nonce":3291842956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6809","nonce":3291842956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":3291842956},{"type":"v1","addr":"172.21.15.84:6807","nonce":3291842956}]},"public_addr":"172.21.15.84:6803/3291842956","cluster_addr":"172.21.15.84:6805/3291842956","heartbeat_back_addr":"172.21.15.84:6809/3291842956","heartbeat_front_addr":"172.21.15.84:6807/3291842956","state":["exists","up"]},{"osd":1,"uuid":"04282e2a-4e57-4b6a-9e35-2acbf64bc65f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6801","nonce":1253575304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6803","nonce":1253575304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6807","nonce":1253575304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1253575304},{"type":"v1","addr":"172.21.15.90:6805","nonce":1253575304}]},"public_addr":"172.21.15.90:6801/1253575304","cluster_addr":"172.21.15.90:6803/1253575304","heartbeat_back_addr":"172.21.15.90:6807/1253575304","heartbeat_front_addr":"172.21.15.90:6805/1253575304","state":["exists","up"]},{"osd":2,"uuid":"44e5c979-386a-496f-97a0-6fd02825c725","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6801","nonce":105113584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6803","nonce":105113584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6807","nonce":105113584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":105113584},{"type":"v1","addr":"172.21.15.172:6805","nonce":105113584}]},"public_addr":"172.21.15.172:6801/105113584","cluster_addr":"172.21.15.172:6803/105113584","heartbeat_back_addr":"172.21.15.172:6807/105113584","heartbeat_front_addr":"172.21.15.172:6805/105113584","state":["exists","up"]},{"osd":3,"uuid":"990a6d3d-f181-4236-8f89-89ccf33456dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6811","nonce":2780019322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6813","nonce":2780019322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6817","nonce":2780019322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2780019322},{"type":"v1","addr":"172.21.15.84:6815","nonce":2780019322}]},"public_addr":"172.21.15.84:6811/2780019322","cluster_addr":"172.21.15.84:6813/2780019322","heartbeat_back_addr":"172.21.15.84:6817/2780019322","heartbeat_front_addr":"172.21.15.84:6815/2780019322","state":["exists","up"]},{"osd":4,"uuid":"6d366acd-ad48-43e2-ad7e-eed923fbf8eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6809","nonce":1991269390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6811","nonce":1991269390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6815","nonce":1991269390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1991269390},{"type":"v1","addr":"172.21.15.90:6813","nonce":1991269390}]},"public_addr":"172.21.15.90:6809/1991269390","cluster_addr":"172.21.15.90:6811/1991269390","heartbeat_back_addr":"172.21.15.90:6815/1991269390","heartbeat_front_addr":"172.21.15.90:6813/1991269390","state":["exists","up"]},{"osd":5,"uuid":"c12622ec-42b4-431d-be3a-09277322ecda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6809","nonce":3941830817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6811","nonce":3941830817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6815","nonce":3941830817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3941830817},{"type":"v1","addr":"172.21.15.172:6813","nonce":3941830817}]},"public_addr":"172.21.15.172:6809/3941830817","cluster_addr":"172.21.15.172:6811/3941830817","heartbeat_back_addr":"172.21.15.172:6815/3941830817","heartbeat_front_addr":"172.21.15.172:6813/3941830817","state":["exists","up"]},{"osd":6,"uuid":"fd5c4982-d301-4b87-a9cc-14740596822d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6819","nonce":4007584109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6821","nonce":4007584109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6825","nonce":4007584109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":4007584109},{"type":"v1","addr":"172.21.15.84:6823","nonce":4007584109}]},"public_addr":"172.21.15.84:6819/4007584109","cluster_addr":"172.21.15.84:6821/4007584109","heartbeat_back_addr":"172.21.15.84:6825/4007584109","heartbeat_front_addr":"172.21.15.84:6823/4007584109","state":["exists","up"]},{"osd":7,"uuid":"3fe3f253-331b-4188-b422-bae618bdd56f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6817","nonce":2835288640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6819","nonce":2835288640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6823","nonce":2835288640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":2835288640},{"type":"v1","addr":"172.21.15.90:6821","nonce":2835288640}]},"public_addr":"172.21.15.90:6817/2835288640","cluster_addr":"172.21.15.90:6819/2835288640","heartbeat_back_addr":"172.21.15.90:6823/2835288640","heartbeat_front_addr":"172.21.15.90:6821/2835288640","state":["exists","up"]},{"osd":8,"uuid":"7a9eb9c5-681c-4d53-bb24-a231ce58658e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6817","nonce":3206361854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6819","nonce":3206361854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6823","nonce":3206361854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3206361854},{"type":"v1","addr":"172.21.15.172:6821","nonce":3206361854}]},"public_addr":"172.21.15.172:6817/3206361854","cluster_addr":"172.21.15.172:6819/3206361854","heartbeat_back_addr":"172.21.15.172:6823/3206361854","heartbeat_front_addr":"172.21.15.172:6821/3206361854","state":["exists","up"]},{"osd":9,"uuid":"b1b5f1ae-5663-448e-b0f3-cd2207d9c5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6827","nonce":3727244874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6829","nonce":3727244874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6833","nonce":3727244874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3727244874},{"type":"v1","addr":"172.21.15.84:6831","nonce":3727244874}]},"public_addr":"172.21.15.84:6827/3727244874","cluster_addr":"172.21.15.84:6829/3727244874","heartbeat_back_addr":"172.21.15.84:6833/3727244874","heartbeat_front_addr":"172.21.15.84:6831/3727244874","state":["exists","up"]},{"osd":10,"uuid":"6b971755-045e-4107-aeb2-22aa69cfdea3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6825","nonce":1478210023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6827","nonce":1478210023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6831","nonce":1478210023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1478210023},{"type":"v1","addr":"172.21.15.90:6829","nonce":1478210023}]},"public_addr":"172.21.15.90:6825/1478210023","cluster_addr":"172.21.15.90:6827/1478210023","heartbeat_back_addr":"172.21.15.90:6831/1478210023","heartbeat_front_addr":"172.21.15.90:6829/1478210023","state":["exists","up"]},{"osd":11,"uuid":"326bf4e4-01ff-42e4-8092-7c2d418273d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6825","nonce":1518672432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6827","nonce":1518672432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6831","nonce":1518672432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1518672432},{"type":"v1","addr":"172.21.15.172:6829","nonce":1518672432}]},"public_addr":"172.21.15.172:6825/1518672432","cluster_addr":"172.21.15.172:6827/1518672432","heartbeat_back_addr":"172.21.15.172:6831/1518672432","heartbeat_front_addr":"172.21.15.172:6829/1518672432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:33:47.628646+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:14.227231+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:34:39.414729+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:10.078075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:35:37.573971+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:03.448201+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:36:34.390010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:01.070554+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:26.972661+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:37:57.698025+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:24.207912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T02:38:49.516822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.5","mappings":[{"from":5,"to":8}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:6800/3670733962":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/3048700539":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/1797182197":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/2355445501":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/239259500":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6801/4193451827":"2024-09-22T02:31:12.328817+0000","172.21.15.84:0/3180377571":"2024-09-22T02:31:41.471413+0000","172.21.15.84:0/950512595":"2024-09-22T02:31:12.328817+0000","172.21.15.84:6800/4193451827":"2024-09-22T02:31:12.328817+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T02:47:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47900b6510 msgr2=0x7f47900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47900b6510 0x7f47900b8a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4798005940 tx=0x7f47980058d0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac103990 msgr2=0x7f47ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac103990 0x7f47ac075710 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f479c00e9f0 tx=0x7f479c00edf0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 shutdown_connections 2024-09-21T02:47:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f47900b6510 0x7f47900b8a20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac109c20 0x7f47ac076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f47ac1092d0 0x7f47ac075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 --2- 172.21.15.84:0/4217078548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47ac103990 0x7f47ac075710 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.888+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 >> 172.21.15.84:0/4217078548 conn(0x7f47ac0ff3e0 msgr2=0x7f47ac101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.889+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 shutdown_connections 2024-09-21T02:47:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:37.889+0000 7f47ab200640 1 -- 172.21.15.84:0/4217078548 wait complete. 2024-09-21T02:47:38.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:37 smithi172 ceph-mon[35067]: pgmap v555: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:38.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:37 smithi090 ceph-mon[34571]: pgmap v555: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T02:47:38.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T02:47:39.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:38 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4217078548' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:47:39.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:38 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4217078548' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:47:39.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:38 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4217078548' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T02:47:39.029 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:39.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 -- 172.21.15.84:0/1855463762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 msgr2=0x7fb3ec1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:39.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/1855463762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 0x7fb3ec1096e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009900 tx=0x7fb3d802a3f0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 -- 172.21.15.84:0/1855463762 shutdown_connections 2024-09-21T02:47:39.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/1855463762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ec109c20 0x7fb3ec110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/1855463762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 0x7fb3ec1096e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/1855463762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3ec103990 0x7fb3ec103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 -- 172.21.15.84:0/1855463762 >> 172.21.15.84:0/1855463762 conn(0x7fb3ec0ff3e0 msgr2=0x7fb3ec101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:39.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 -- 172.21.15.84:0/1855463762 shutdown_connections 2024-09-21T02:47:39.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.690+0000 7fb3f2a00640 1 -- 172.21.15.84:0/1855463762 wait complete. 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.691+0000 7fb3f2a00640 1 Processor -- start 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.691+0000 7fb3f2a00640 1 -- start start 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f2a00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ec103990 0x7fb3ec19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 0x7fb3ec19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f2a00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3ec109c20 0x7fb3ec1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f2a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec113a00 con 0x7fb3ec1092d0 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f2a00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec113880 con 0x7fb3ec109c20 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f2a00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec113b80 con 0x7fb3ec103990 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 0x7fb3ec19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 0x7fb3ec19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50362/0 (socket says 172.21.15.84:50362) 2024-09-21T02:47:39.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f0c00640 1 -- 172.21.15.84:0/4015279002 learned_addr learned my addr 172.21.15.84:0/4015279002 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f2000640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3ec109c20 0x7fb3ec1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f1600640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ec103990 0x7fb3ec19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f0c00640 1 -- 172.21.15.84:0/4015279002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ec103990 msgr2=0x7fb3ec19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f0c00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ec103990 0x7fb3ec19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f0c00640 1 -- 172.21.15.84:0/4015279002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3ec109c20 msgr2=0x7fb3ec1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f0c00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3ec109c20 0x7fb3ec1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.692+0000 7fb3f0c00640 1 -- 172.21.15.84:0/4015279002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ec1a2540 con 0x7fb3ec1092d0 2024-09-21T02:47:39.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.693+0000 7fb3f0c00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 0x7fb3ec19cb70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8005940 tx=0x7fb3d8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.693+0000 7fb3ea000640 1 -- 172.21.15.84:0/4015279002 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d803f030 con 0x7fb3ec1092d0 2024-09-21T02:47:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.693+0000 7fb3ea000640 1 -- 172.21.15.84:0/4015279002 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb3d8004440 con 0x7fb3ec1092d0 2024-09-21T02:47:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.693+0000 7fb3ea000640 1 -- 172.21.15.84:0/4015279002 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8035070 con 0x7fb3ec1092d0 2024-09-21T02:47:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.693+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ec1a27d0 con 0x7fb3ec1092d0 2024-09-21T02:47:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.693+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ec1a8f90 con 0x7fb3ec1092d0 2024-09-21T02:47:39.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.695+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ec104c10 con 0x7fb3ec1092d0 2024-09-21T02:47:39.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.697+0000 7fb3ea000640 1 -- 172.21.15.84:0/4015279002 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fb3d8042030 con 0x7fb3ec1092d0 2024-09-21T02:47:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.699+0000 7fb3ea000640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3d40b6590 0x7fb3d40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.699+0000 7fb3ea000640 1 -- 172.21.15.84:0/4015279002 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9150+0+0 (secure 0 0 0) 0x7fb3d8107910 con 0x7fb3ec1092d0 2024-09-21T02:47:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.699+0000 7fb3f1600640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3d40b6590 0x7fb3d40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:39.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.700+0000 7fb3f1600640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3d40b6590 0x7fb3d40b8aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009bd0 tx=0x7fb3e0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:39.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.703+0000 7fb3ea000640 1 -- 172.21.15.84:0/4015279002 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3d80d2190 con 0x7fb3ec1092d0 2024-09-21T02:47:39.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.930+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb3ec1a9160 con 0x7fb3ec1092d0 2024-09-21T02:47:39.932 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:39 smithi084 ceph-mon[30747]: pgmap v556: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:47:39.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.933+0000 7fb3ea000640 1 -- 172.21.15.84:0/4015279002 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7fb3d80d70d0 con 0x7fb3ec1092d0 2024-09-21T02:47:39.934 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T02:47:39.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3d40b6590 msgr2=0x7fb3d40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:39.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3d40b6590 0x7fb3d40b8aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009bd0 tx=0x7fb3e0005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 msgr2=0x7fb3ec19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 0x7fb3ec19cb70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8005940 tx=0x7fb3d8004040 comp rx=0 tx=0).stop 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 shutdown_connections 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3ec109c20 0x7fb3ec1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3ec1092d0 0x7fb3ec19cb70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fb3d40b6590 0x7fb3d40b8aa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 --2- 172.21.15.84:0/4015279002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3ec103990 0x7fb3ec19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.936+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 >> 172.21.15.84:0/4015279002 conn(0x7fb3ec0ff3e0 msgr2=0x7fb3ec106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.937+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 shutdown_connections 2024-09-21T02:47:39.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:39.937+0000 7fb3f2a00640 1 -- 172.21.15.84:0/4015279002 wait complete. 2024-09-21T02:47:40.000 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:39 smithi090 ceph-mon[34571]: pgmap v556: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:47:40.004 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:39 smithi172 ceph-mon[35067]: pgmap v556: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-21T02:47:40.256 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c[64441]: ignoring --setuser ceph since I am not root 2024-09-21T02:47:40.256 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c[64441]: ignoring --setgroup ceph since I am not root 2024-09-21T02:47:40.256 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mds[64445]: -- 172.21.15.172:0/2714379744 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56094f1e7860 con 0x56095338f600 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c[64441]: starting mds.c at 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f[64172]: ignoring --setuser ceph since I am not root 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f[64172]: ignoring --setgroup ceph since I am not root 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mds[64176]: -- 172.21.15.172:0/2648272860 <== mon.1 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e9043a1860 con 0x55e908549a80 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f[64172]: starting mds.f at 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i[64713]: ignoring --setuser ceph since I am not root 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i[64713]: ignoring --setgroup ceph since I am not root 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mds[64717]: -- 172.21.15.172:0/1601815268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565488efd860 con 0x56548d0a5600 2024-09-21T02:47:40.257 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i[64713]: starting mds.i at 2024-09-21T02:47:40.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:39 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a[30743]: 2024-09-21T02:47:39.931+0000 7f382c600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T02:47:40.267 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b[63014]: ignoring --setuser ceph since I am not root 2024-09-21T02:47:40.267 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b[63014]: ignoring --setgroup ceph since I am not root 2024-09-21T02:47:40.267 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mds[63018]: -- 172.21.15.90:0/3391150354 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb580c9860 con 0x55bb5c271180 2024-09-21T02:47:40.267 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b[63014]: starting mds.b at 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e[62464]: ignoring --setuser ceph since I am not root 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e[62464]: ignoring --setgroup ceph since I am not root 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mds[62468]: --2- 172.21.15.90:0/3809264334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5590d3e3f600 0x5590d4a2e580 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5590d3e50ba0 tx=0x5590d3d76540 comp rx=0 tx=0).write_message sending message m=0x5590d3d04540 seq=3 auth(proto 2 2 bytes epoch 0) 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mds[62468]: -- 172.21.15.90:0/3809264334 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590cfc97860 con 0x5590d3e3f600 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e[62464]: starting mds.e at 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h[62733]: ignoring --setuser ceph since I am not root 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h[62733]: ignoring --setgroup ceph since I am not root 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mds[62737]: --2- 172.21.15.90:0/2899793797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56307ea93180 0x56307f682000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56307eaa4ba0 tx=0x56307e9ca540 comp rx=0 tx=0).write_message sending message m=0x56307e958540 seq=3 auth(proto 2 2 bytes epoch 0) 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mds[62737]: -- 172.21.15.90:0/2899793797 <== mon.2 v2:172.21.15.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56307a8eb860 con 0x56307ea93180 2024-09-21T02:47:40.268 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h[62733]: starting mds.h at 2024-09-21T02:47:40.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T02:47:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4015279002' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T02:47:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mon[35067]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T02:47:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mon[35067]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T02:47:41.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/4015279002' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T02:47:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mon[35067]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T02:47:41.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:40 smithi172 ceph-mon[35067]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T02:47:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:40 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4015279002' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T02:47:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:40 smithi084 ceph-mon[30747]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T02:47:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:40 smithi084 ceph-mon[30747]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T02:47:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:40 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/4015279002' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T02:47:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:40 smithi084 ceph-mon[30747]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T02:47:41.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:40 smithi084 ceph-mon[30747]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T02:47:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4015279002' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T02:47:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mon[34571]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T02:47:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mon[34571]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T02:47:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/4015279002' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T02:47:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mon[34571]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T02:47:41.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:40 smithi090 ceph-mon[34571]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T02:47:41.205 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:41.909 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: pgmap v557: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:47:41.909 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.90:6834/4181717483,v1:172.21.15.90:6837/4181717483] up:boot 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.90:6835/147137015,v1:172.21.15.90:6838/147137015] up:boot 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.90:6836/1195576592,v1:172.21.15.90:6839/1195576592] up:boot 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6834/1542434741,v1:172.21.15.172:6835/1542434741] up:boot 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6836/2735220900,v1:172.21.15.172:6837/2735220900] up:boot 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: mds.? [v2:172.21.15.172:6838/3775224385,v1:172.21.15.172:6839/3775224385] up:boot 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:47:41.910 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:41 smithi084 ceph-mon[30747]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:47:41.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.975+0000 7f2ce4c00640 1 -- 172.21.15.84:0/725593577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce01092d0 msgr2=0x7f2ce01096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:41.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.975+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/725593577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce01092d0 0x7f2ce01096e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009900 tx=0x7f2ccc02a410 comp rx=0 tx=0).stop 2024-09-21T02:47:41.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.976+0000 7f2ce4c00640 1 -- 172.21.15.84:0/725593577 shutdown_connections 2024-09-21T02:47:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.976+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/725593577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce0109c20 0x7f2ce0110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.976+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/725593577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce01092d0 0x7f2ce01096e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.976+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/725593577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ce0103990 0x7f2ce0103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.976+0000 7f2ce4c00640 1 -- 172.21.15.84:0/725593577 >> 172.21.15.84:0/725593577 conn(0x7f2ce00ff3e0 msgr2=0x7f2ce0101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.976+0000 7f2ce4c00640 1 -- 172.21.15.84:0/725593577 shutdown_connections 2024-09-21T02:47:41.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.976+0000 7f2ce4c00640 1 -- 172.21.15.84:0/725593577 wait complete. 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2ce4c00640 1 Processor -- start 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2ce4c00640 1 -- start start 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2ce4c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ce0103990 0x7f2ce019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2ce4c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce01092d0 0x7f2ce019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2ce4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce0109c20 0x7f2ce019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2ce4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce0113a00 con 0x7f2ce0109c20 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2ce4c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce0113880 con 0x7f2ce01092d0 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2ce4c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce0113b80 con 0x7f2ce0103990 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2cdfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce0109c20 0x7f2ce019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2cdea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce01092d0 0x7f2ce019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:41.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2cdf400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ce0103990 0x7f2ce019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2cdfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce0109c20 0x7f2ce019fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39734/0 (socket says 172.21.15.84:39734) 2024-09-21T02:47:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2cdea00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce01092d0 0x7f2ce019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.84:50000/0 (socket says 172.21.15.84:50000) 2024-09-21T02:47:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.977+0000 7f2cdfe00640 1 -- 172.21.15.84:0/2241033978 learned_addr learned my addr 172.21.15.84:0/2241033978 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.978+0000 7f2cdea00640 1 -- 172.21.15.84:0/2241033978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ce0103990 msgr2=0x7f2ce019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:41.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.978+0000 7f2cdea00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ce0103990 0x7f2ce019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.978+0000 7f2cdea00640 1 -- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce0109c20 msgr2=0x7f2ce019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.978+0000 7f2cdea00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce0109c20 0x7f2ce019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.978+0000 7f2cdea00640 1 -- 172.21.15.84:0/2241033978 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce01a0380 con 0x7f2ce01092d0 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.978+0000 7f2cdfe00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce0109c20 0x7f2ce019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.978+0000 7f2cdea00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce01092d0 0x7f2ce019a9b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc02a930 tx=0x7f2ccc0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.979+0000 7f2cd7e00640 1 -- 172.21.15.84:0/2241033978 <== mon.2 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc03f030 con 0x7f2ce01092d0 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.979+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce01a0610 con 0x7f2ce01092d0 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.979+0000 7f2cd7e00640 1 -- 172.21.15.84:0/2241033978 <== mon.2 v2:172.21.15.90:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ccc0318f0 con 0x7f2ce01092d0 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.979+0000 7f2cd7e00640 1 -- 172.21.15.84:0/2241033978 <== mon.2 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc035070 con 0x7f2ce01092d0 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.979+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce01a6dd0 con 0x7f2ce01092d0 2024-09-21T02:47:41.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.980+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce0104c10 con 0x7f2ce01092d0 2024-09-21T02:47:41.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.982+0000 7f2cd7e00640 1 -- 172.21.15.84:0/2241033978 <== mon.2 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f2ccc042030 con 0x7f2ce01092d0 2024-09-21T02:47:41.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.984+0000 7f2cd7e00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2cc40b6510 0x7f2cc40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:41.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.984+0000 7f2cd7e00640 1 -- 172.21.15.84:0/2241033978 <== mon.2 v2:172.21.15.90:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9408+0+0 (secure 0 0 0) 0x7f2ccc107cf0 con 0x7f2ce01092d0 2024-09-21T02:47:41.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.984+0000 7f2cdf400640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2cc40b6510 0x7f2cc40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:41.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.985+0000 7f2cdf400640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2cc40b6510 0x7f2cc40b8a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009bd0 tx=0x7f2cd0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:41.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:41.986+0000 7f2cd7e00640 1 -- 172.21.15.84:0/2241033978 <== mon.2 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ccc0d2490 con 0x7f2ce01092d0 2024-09-21T02:47:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: pgmap v557: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:47:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.90:6834/4181717483,v1:172.21.15.90:6837/4181717483] up:boot 2024-09-21T02:47:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.90:6835/147137015,v1:172.21.15.90:6838/147137015] up:boot 2024-09-21T02:47:42.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.90:6836/1195576592,v1:172.21.15.90:6839/1195576592] up:boot 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6834/1542434741,v1:172.21.15.172:6835/1542434741] up:boot 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6836/2735220900,v1:172.21.15.172:6837/2735220900] up:boot 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: mds.? [v2:172.21.15.172:6838/3775224385,v1:172.21.15.172:6839/3775224385] up:boot 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:47:42.007 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:41 smithi172 ceph-mon[35067]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:47:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: pgmap v557: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T02:47:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.90:6834/4181717483,v1:172.21.15.90:6837/4181717483] up:boot 2024-09-21T02:47:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.90:6835/147137015,v1:172.21.15.90:6838/147137015] up:boot 2024-09-21T02:47:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.90:6836/1195576592,v1:172.21.15.90:6839/1195576592] up:boot 2024-09-21T02:47:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6834/1542434741,v1:172.21.15.172:6835/1542434741] up:boot 2024-09-21T02:47:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6836/2735220900,v1:172.21.15.172:6837/2735220900] up:boot 2024-09-21T02:47:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: mds.? [v2:172.21.15.172:6838/3775224385,v1:172.21.15.172:6839/3775224385] up:boot 2024-09-21T02:47:42.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T02:47:42.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T02:47:42.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T02:47:42.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T02:47:42.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T02:47:42.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T02:47:42.018 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:41 smithi090 ceph-mon[34571]: from='mgr.14152 172.21.15.84:0/1873360646' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T02:47:42.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.208+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2ce010b9f0 con 0x7f2ce01092d0 2024-09-21T02:47:42.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.689+0000 7f2cd7e00640 1 -- 172.21.15.84:0/2241033978 <== mon.2 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f2ccc0d73d0 con 0x7f2ce01092d0 2024-09-21T02:47:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.691+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2cc40b6510 msgr2=0x7f2cc40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.691+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2cc40b6510 0x7f2cc40b8a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009bd0 tx=0x7f2cd0005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.691+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce01092d0 msgr2=0x7f2ce019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.691+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce01092d0 0x7f2ce019a9b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc02a930 tx=0x7f2ccc0042f0 comp rx=0 tx=0).stop 2024-09-21T02:47:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.692+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 shutdown_connections 2024-09-21T02:47:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.692+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ce0109c20 0x7f2ce019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:42.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.692+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce01092d0 0x7f2ce019a9b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.692+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f2cc40b6510 0x7f2cc40b8a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.692+0000 7f2ce4c00640 1 --2- 172.21.15.84:0/2241033978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ce0103990 0x7f2ce019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.692+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 >> 172.21.15.84:0/2241033978 conn(0x7f2ce00ff3e0 msgr2=0x7f2ce0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.692+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 shutdown_connections 2024-09-21T02:47:42.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:42.692+0000 7f2ce4c00640 1 -- 172.21.15.84:0/2241033978 wait complete. 2024-09-21T02:47:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:42 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2241033978' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:47:43.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:42 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:47:43.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:42 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2241033978' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:47:43.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:42 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:47:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:42 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2241033978' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:47:43.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:42 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T02:47:43.579 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T02:47:43.952 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:43 smithi172 ceph-mon[35067]: pgmap v559: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T02:47:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:43 smithi172 ceph-mon[35067]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T02:47:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:43 smithi172 ceph-mon[35067]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T02:47:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:43 smithi172 ceph-mon[35067]: Cluster is now healthy 2024-09-21T02:47:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:43 smithi172 ceph-mon[35067]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:47:44.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:43 smithi172 ceph-mon[35067]: fsmap 12 up:standby 2024-09-21T02:47:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:43 smithi084 ceph-mon[30747]: pgmap v559: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T02:47:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:43 smithi084 ceph-mon[30747]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T02:47:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:43 smithi084 ceph-mon[30747]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T02:47:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:43 smithi084 ceph-mon[30747]: Cluster is now healthy 2024-09-21T02:47:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:43 smithi084 ceph-mon[30747]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:47:44.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:43 smithi084 ceph-mon[30747]: fsmap 12 up:standby 2024-09-21T02:47:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:43 smithi090 ceph-mon[34571]: pgmap v559: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T02:47:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:43 smithi090 ceph-mon[34571]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T02:47:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:43 smithi090 ceph-mon[34571]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T02:47:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:43 smithi090 ceph-mon[34571]: Cluster is now healthy 2024-09-21T02:47:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:43 smithi090 ceph-mon[34571]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T02:47:44.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:43 smithi090 ceph-mon[34571]: fsmap 12 up:standby 2024-09-21T02:47:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 -- 172.21.15.84:0/3631974850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c410de20 msgr2=0x7fd0c4110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 --2- 172.21.15.84:0/3631974850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c410de20 0x7fd0c4110310 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009ca0 tx=0x7fd0bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:47:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 -- 172.21.15.84:0/3631974850 shutdown_connections 2024-09-21T02:47:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 --2- 172.21.15.84:0/3631974850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c410de20 0x7fd0c4110310 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 --2- 172.21.15.84:0/3631974850 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c4105310 0x7fd0c410d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 --2- 172.21.15.84:0/3631974850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c41049c0 0x7fd0c4104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:44.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 -- 172.21.15.84:0/3631974850 >> 172.21.15.84:0/3631974850 conn(0x7fd0c40796e0 msgr2=0x7fd0c4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:44.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 -- 172.21.15.84:0/3631974850 shutdown_connections 2024-09-21T02:47:44.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.611+0000 7fd0ca800640 1 -- 172.21.15.84:0/3631974850 wait complete. 2024-09-21T02:47:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.612+0000 7fd0ca800640 1 Processor -- start 2024-09-21T02:47:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0ca800640 1 -- start start 2024-09-21T02:47:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0ca800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c41049c0 0x7fd0c4102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0ca800640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c4105310 0x7fd0c4102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0ca800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c410de20 0x7fd0c4103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0ca800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4113be0 con 0x7fd0c41049c0 2024-09-21T02:47:44.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0ca800640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4113a60 con 0x7fd0c4105310 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0ca800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4113d60 con 0x7fd0c410de20 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0c3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c41049c0 0x7fd0c4102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0c3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c41049c0 0x7fd0c4102700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39756/0 (socket says 172.21.15.84:39756) 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0c3400640 1 -- 172.21.15.84:0/916651114 learned_addr learned my addr 172.21.15.84:0/916651114 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0c2a00640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c4105310 0x7fd0c4102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.613+0000 7fd0c3e00640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c410de20 0x7fd0c4103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0c3400640 1 -- 172.21.15.84:0/916651114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c410de20 msgr2=0x7fd0c4103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0c3400640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c410de20 0x7fd0c4103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0c3400640 1 -- 172.21.15.84:0/916651114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c4105310 msgr2=0x7fd0c4102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0c3400640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c4105310 0x7fd0c4102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0c3400640 1 -- 172.21.15.84:0/916651114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c41a8790 con 0x7fd0c41049c0 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0c3e00640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c410de20 0x7fd0c4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0c2a00640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c4105310 0x7fd0c4102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T02:47:44.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0c3400640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c41049c0 0x7fd0c4102700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400e9f0 tx=0x7fd0b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:44.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0bbe00640 1 -- 172.21.15.84:0/916651114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b400cd80 con 0x7fd0c41049c0 2024-09-21T02:47:44.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0bbe00640 1 -- 172.21.15.84:0/916651114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd0b40054f0 con 0x7fd0c41049c0 2024-09-21T02:47:44.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c41a8a80 con 0x7fd0c41049c0 2024-09-21T02:47:44.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0bbe00640 1 -- 172.21.15.84:0/916651114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4010690 con 0x7fd0c41049c0 2024-09-21T02:47:44.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.614+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c41a8f70 con 0x7fd0c41049c0 2024-09-21T02:47:44.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.615+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c406c200 con 0x7fd0c41049c0 2024-09-21T02:47:44.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.618+0000 7fd0bbe00640 1 -- 172.21.15.84:0/916651114 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7fd0b40046c0 con 0x7fd0c41049c0 2024-09-21T02:47:44.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.619+0000 7fd0bbe00640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0a80b6510 0x7fd0a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:44.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.620+0000 7fd0bbe00640 1 -- 172.21.15.84:0/916651114 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9408+0+0 (secure 0 0 0) 0x7fd0b40e7eb0 con 0x7fd0c41049c0 2024-09-21T02:47:44.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.620+0000 7fd0c2a00640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0a80b6510 0x7fd0a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:44.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.620+0000 7fd0c2a00640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0a80b6510 0x7fd0a80b8a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd0c410fa80 tx=0x7fd0b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:44.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.622+0000 7fd0bbe00640 1 -- 172.21.15.84:0/916651114 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0b4056710 con 0x7fd0c41049c0 2024-09-21T02:47:44.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:44.811+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd0c4104dd0 con 0x7fd0c41049c0 2024-09-21T02:47:45.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.703+0000 7fd0bbe00640 1 -- 172.21.15.84:0/916651114 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7fd0c4104dd0 con 0x7fd0c41049c0 2024-09-21T02:47:45.705 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0a80b6510 msgr2=0x7fd0a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0a80b6510 0x7fd0a80b8a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd0c410fa80 tx=0x7fd0b0005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c41049c0 msgr2=0x7fd0c4102700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c41049c0 0x7fd0c4102700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400e9f0 tx=0x7fd0b400edf0 comp rx=0 tx=0).stop 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 shutdown_connections 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7fd0a80b6510 0x7fd0a80b8a20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c410de20 0x7fd0c4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c4105310 0x7fd0c4102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 --2- 172.21.15.84:0/916651114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0c41049c0 0x7fd0c4102700 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.706+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 >> 172.21.15.84:0/916651114 conn(0x7fd0c40796e0 msgr2=0x7fd0c40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.707+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 shutdown_connections 2024-09-21T02:47:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:45.707+0000 7fd0ca800640 1 -- 172.21.15.84:0/916651114 wait complete. 2024-09-21T02:47:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:45 smithi172 ceph-mon[35067]: pgmap v560: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T02:47:46.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:45 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/916651114' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:46.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:45 smithi084 ceph-mon[30747]: pgmap v560: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T02:47:46.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:45 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/916651114' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:45 smithi090 ceph-mon[34571]: pgmap v560: 129 pgs: 129 active+clean; 106 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T02:47:46.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:45 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/916651114' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:46.621 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T02:47:47.001 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:46 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/916651114' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:46 smithi172 ceph-mon[35067]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T02:47:47.006 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:46 smithi172 ceph-mon[35067]: pgmap v562: 97 pgs: 97 active+clean; 577 KiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:47.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:46 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/916651114' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:47.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:46 smithi084 ceph-mon[30747]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T02:47:47.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:46 smithi084 ceph-mon[30747]: pgmap v562: 97 pgs: 97 active+clean; 577 KiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:47.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:46 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/916651114' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:47.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:46 smithi090 ceph-mon[34571]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T02:47:47.017 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:46 smithi090 ceph-mon[34571]: pgmap v562: 97 pgs: 97 active+clean; 577 KiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 -- 172.21.15.84:0/3635997629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735410be50 msgr2=0x7f7354112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 --2- 172.21.15.84:0/3635997629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735410be50 0x7f7354112680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f734c009ca0 tx=0x7f734c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:47:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 -- 172.21.15.84:0/3635997629 shutdown_connections 2024-09-21T02:47:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 --2- 172.21.15.84:0/3635997629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735410b500 0x7f735410b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 --2- 172.21.15.84:0/3635997629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f735410be50 0x7f7354112680 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 --2- 172.21.15.84:0/3635997629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7354105bc0 0x7f7354105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 -- 172.21.15.84:0/3635997629 >> 172.21.15.84:0/3635997629 conn(0x7f7354101670 msgr2=0x7f7354103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:47.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 -- 172.21.15.84:0/3635997629 shutdown_connections 2024-09-21T02:47:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.652+0000 7f735a200640 1 -- 172.21.15.84:0/3635997629 wait complete. 2024-09-21T02:47:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.654+0000 7f735a200640 1 Processor -- start 2024-09-21T02:47:47.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.654+0000 7f735a200640 1 -- start start 2024-09-21T02:47:47.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.654+0000 7f735a200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7354105bc0 0x7f735419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:47.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.654+0000 7f735a200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735410b500 0x7f735419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:47.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.654+0000 7f735a200640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f735410be50 0x7f73541a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:47.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.654+0000 7f735a200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7354115c50 con 0x7f7354105bc0 2024-09-21T02:47:47.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.654+0000 7f735a200640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7354115ad0 con 0x7f735410be50 2024-09-21T02:47:47.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.654+0000 7f735a200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7354115dd0 con 0x7f735410b500 2024-09-21T02:47:47.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7358e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7354105bc0 0x7f735419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:47.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7358e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7354105bc0 0x7f735419c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39768/0 (socket says 172.21.15.84:39768) 2024-09-21T02:47:47.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7358e00640 1 -- 172.21.15.84:0/3016932493 learned_addr learned my addr 172.21.15.84:0/3016932493 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:47.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7353e00640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735410b500 0x7f735419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:47.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7359800640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f735410be50 0x7f73541a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7358e00640 1 -- 172.21.15.84:0/3016932493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735410b500 msgr2=0x7f735419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7358e00640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735410b500 0x7f735419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7358e00640 1 -- 172.21.15.84:0/3016932493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f735410be50 msgr2=0x7f73541a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7358e00640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f735410be50 0x7f73541a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.655+0000 7f7358e00640 1 -- 172.21.15.84:0/3016932493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73541a25f0 con 0x7f7354105bc0 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.656+0000 7f7358e00640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7354105bc0 0x7f735419c680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f734800e9f0 tx=0x7f734800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.656+0000 7f7351600640 1 -- 172.21.15.84:0/3016932493 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734800cd80 con 0x7f7354105bc0 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.656+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73541a28e0 con 0x7f7354105bc0 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.656+0000 7f7351600640 1 -- 172.21.15.84:0/3016932493 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7348010900 con 0x7f7354105bc0 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.656+0000 7f7351600640 1 -- 172.21.15.84:0/3016932493 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480188d0 con 0x7f7354105bc0 2024-09-21T02:47:47.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.656+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73541a9040 con 0x7f7354105bc0 2024-09-21T02:47:47.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.657+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7354105fd0 con 0x7f7354105bc0 2024-09-21T02:47:47.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.660+0000 7f7351600640 1 -- 172.21.15.84:0/3016932493 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f7348010ab0 con 0x7f7354105bc0 2024-09-21T02:47:47.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.661+0000 7f7351600640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f733c0b6510 0x7f733c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:47.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.661+0000 7f7351600640 1 -- 172.21.15.84:0/3016932493 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8883+0+0 (secure 0 0 0) 0x7f73480e7e00 con 0x7f7354105bc0 2024-09-21T02:47:47.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.661+0000 7f7353e00640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f733c0b6510 0x7f733c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:47.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.662+0000 7f7353e00640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f733c0b6510 0x7f733c0b8a20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7354104d70 tx=0x7f7340005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:47.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.663+0000 7f7351600640 1 -- 172.21.15.84:0/3016932493 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73480b2780 con 0x7f7354105bc0 2024-09-21T02:47:47.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:47.855+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f735419d7b0 con 0x7f7354105bc0 2024-09-21T02:47:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.790+0000 7f7351600640 1 -- 172.21.15.84:0/3016932493 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7f73480b76c0 con 0x7f7354105bc0 2024-09-21T02:47:48.792 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f733c0b6510 msgr2=0x7f733c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f733c0b6510 0x7f733c0b8a20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7354104d70 tx=0x7f7340005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7354105bc0 msgr2=0x7f735419c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7354105bc0 0x7f735419c680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f734800e9f0 tx=0x7f734800eeb0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 shutdown_connections 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f733c0b6510 0x7f733c0b8a20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f735410b500 0x7f735419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f735410be50 0x7f73541a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 --2- 172.21.15.84:0/3016932493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7354105bc0 0x7f735419c680 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.795+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 >> 172.21.15.84:0/3016932493 conn(0x7f7354101670 msgr2=0x7f7354108a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.796+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 shutdown_connections 2024-09-21T02:47:48.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:48.796+0000 7f735a200640 1 -- 172.21.15.84:0/3016932493 wait complete. 2024-09-21T02:47:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:48 smithi084 ceph-mon[30747]: pgmap v563: 97 pgs: 97 active+clean; 577 KiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:49.157 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:48 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3016932493' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:48 smithi172 ceph-mon[35067]: pgmap v563: 97 pgs: 97 active+clean; 577 KiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:49.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:48 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3016932493' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:49.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:48 smithi090 ceph-mon[34571]: pgmap v563: 97 pgs: 97 active+clean; 577 KiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:49.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:48 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3016932493' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:49.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T02:47:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:49 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/3016932493' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:50.013 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:49 smithi084 ceph-mon[30747]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T02:47:50.013 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T02:47:50.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:49 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/3016932493' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:50.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:49 smithi172 ceph-mon[35067]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T02:47:50.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:49 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/3016932493' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:50.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:49 smithi090 ceph-mon[34571]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T02:47:50.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 -- 172.21.15.84:0/114067253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351410c010 msgr2=0x7f3514112840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:50.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 --2- 172.21.15.84:0/114067253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351410c010 0x7f3514112840 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f350c009ca0 tx=0x7f350c02a8c0 comp rx=0 tx=0).stop 2024-09-21T02:47:50.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 -- 172.21.15.84:0/114067253 shutdown_connections 2024-09-21T02:47:50.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 --2- 172.21.15.84:0/114067253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f351410c010 0x7f3514112840 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:50.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 --2- 172.21.15.84:0/114067253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f351410b6c0 0x7f351410bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:50.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 --2- 172.21.15.84:0/114067253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3514105d80 0x7f3514106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:50.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 -- 172.21.15.84:0/114067253 >> 172.21.15.84:0/114067253 conn(0x7f3514101810 msgr2=0x7f3514103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:50.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 -- 172.21.15.84:0/114067253 shutdown_connections 2024-09-21T02:47:50.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.659+0000 7f351c600640 1 -- 172.21.15.84:0/114067253 wait complete. 2024-09-21T02:47:50.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.660+0000 7f351c600640 1 Processor -- start 2024-09-21T02:47:50.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f351c600640 1 -- start start 2024-09-21T02:47:50.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f351c600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3514105d80 0x7f351419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f351c600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f351410b6c0 0x7f351419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f351c600640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f351410c010 0x7f35141a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f351c600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3514115e10 con 0x7f3514105d80 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f351c600640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3514115c90 con 0x7f351410c010 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f351c600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3514115f90 con 0x7f351410b6c0 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f3519c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3514105d80 0x7f351419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f3519c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3514105d80 0x7f351419c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54142/0 (socket says 172.21.15.84:54142) 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f3519c00640 1 -- 172.21.15.84:0/2002169013 learned_addr learned my addr 172.21.15.84:0/2002169013 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.661+0000 7f3519200640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f351410b6c0 0x7f351419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.662+0000 7f351a600640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f351410c010 0x7f35141a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.662+0000 7f3519c00640 1 -- 172.21.15.84:0/2002169013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f351410b6c0 msgr2=0x7f351419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.662+0000 7f3519c00640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f351410b6c0 0x7f351419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.662+0000 7f3519c00640 1 -- 172.21.15.84:0/2002169013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f351410c010 msgr2=0x7f35141a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:50.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.662+0000 7f3519c00640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f351410c010 0x7f35141a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:50.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.662+0000 7f3519c00640 1 -- 172.21.15.84:0/2002169013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35141a26b0 con 0x7f3514105d80 2024-09-21T02:47:50.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.662+0000 7f3519c00640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3514105d80 0x7f351419c740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f350800e9f0 tx=0x7f350800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:50.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.662+0000 7f3512000640 1 -- 172.21.15.84:0/2002169013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350800cd80 con 0x7f3514105d80 2024-09-21T02:47:50.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.663+0000 7f3512000640 1 -- 172.21.15.84:0/2002169013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f35080054f0 con 0x7f3514105d80 2024-09-21T02:47:50.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.663+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35141a29a0 con 0x7f3514105d80 2024-09-21T02:47:50.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.663+0000 7f3512000640 1 -- 172.21.15.84:0/2002169013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508010690 con 0x7f3514105d80 2024-09-21T02:47:50.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.663+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35141a9100 con 0x7f3514105d80 2024-09-21T02:47:50.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.664+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f40052c0 con 0x7f3514105d80 2024-09-21T02:47:50.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.666+0000 7f3512000640 1 -- 172.21.15.84:0/2002169013 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154512+0+0 (secure 0 0 0) 0x7f35080046c0 con 0x7f3514105d80 2024-09-21T02:47:50.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.668+0000 7f3512000640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f34fc0b6510 0x7f34fc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T02:47:50.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.668+0000 7f3512000640 1 -- 172.21.15.84:0/2002169013 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8324+0+0 (secure 0 0 0) 0x7f35080e7760 con 0x7f3514105d80 2024-09-21T02:47:50.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.668+0000 7f3519200640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f34fc0b6510 0x7f34fc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T02:47:50.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.669+0000 7f3519200640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f34fc0b6510 0x7f34fc0b8a20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3514105130 tx=0x7f3500005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T02:47:50.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.670+0000 7f3512000640 1 -- 172.21.15.84:0/2002169013 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35080adf30 con 0x7f3514105d80 2024-09-21T02:47:50.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:50.862+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34f40055b0 con 0x7f3514105d80 2024-09-21T02:47:51.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:50 smithi172 ceph-mon[35067]: pgmap v565: 33 pgs: 33 active+clean; 577 KiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:51.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:50 smithi084 ceph-mon[30747]: pgmap v565: 33 pgs: 33 active+clean; 577 KiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:51.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:50 smithi090 ceph-mon[34571]: pgmap v565: 33 pgs: 33 active+clean; 577 KiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.806+0000 7f3512000640 1 -- 172.21.15.84:0/2002169013 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v92) ==== 178+0+0 (secure 0 0 0) 0x7f35080b2310 con 0x7f3514105d80 2024-09-21T02:47:51.808 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' removed 2024-09-21T02:47:51.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.811+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f34fc0b6510 msgr2=0x7f34fc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:51.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.811+0000 7f351c600640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f34fc0b6510 0x7f34fc0b8a20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3514105130 tx=0x7f3500005f90 comp rx=0 tx=0).stop 2024-09-21T02:47:51.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.811+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3514105d80 msgr2=0x7f351419c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T02:47:51.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.811+0000 7f351c600640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3514105d80 0x7f351419c740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f350800e9f0 tx=0x7f350800edf0 comp rx=0 tx=0).stop 2024-09-21T02:47:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.812+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 shutdown_connections 2024-09-21T02:47:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.812+0000 7f351c600640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:6800/2416519122,v1:172.21.15.84:6801/2416519122] conn(0x7f34fc0b6510 0x7f34fc0b8a20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.812+0000 7f351c600640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f351410b6c0 0x7f351419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.812+0000 7f351c600640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f351410c010 0x7f35141a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.812+0000 7f351c600640 1 --2- 172.21.15.84:0/2002169013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3514105d80 0x7f351419c740 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T02:47:51.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.812+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 >> 172.21.15.84:0/2002169013 conn(0x7f3514101810 msgr2=0x7f351410acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T02:47:51.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.813+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 shutdown_connections 2024-09-21T02:47:51.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T02:47:51.813+0000 7f351c600640 1 -- 172.21.15.84:0/2002169013 wait complete. 2024-09-21T02:47:52.194 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:51 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2002169013' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:52.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:51 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2002169013' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:52.266 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:51 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2002169013' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T02:47:52.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:47:52.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:47:52.821 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:47:52.854 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T02:47:52.855 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:47:52.890 DEBUG:teuthology.orchestra.run.smithi090:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:47:52.909 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T02:47:52.927 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T02:47:52.927 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T02:47:52.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a 2024-09-21T02:47:52.977 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:52 smithi084 ceph-mon[30747]: pgmap v566: 33 pgs: 33 active+clean; 577 KiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:52.978 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:52 smithi084 ceph-mon[30747]: from='client.? 172.21.15.84:0/2002169013' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:52.978 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:52 smithi084 ceph-mon[30747]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T02:47:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:52 smithi172 ceph-mon[35067]: pgmap v566: 33 pgs: 33 active+clean; 577 KiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:53.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:52 smithi172 ceph-mon[35067]: from='client.? 172.21.15.84:0/2002169013' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:53.257 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:52 smithi172 ceph-mon[35067]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T02:47:53.263 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:53 smithi084 systemd[1]: Stopping Ceph mon.a for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:47:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:52 smithi090 ceph-mon[34571]: pgmap v566: 33 pgs: 33 active+clean; 577 KiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T02:47:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:52 smithi090 ceph-mon[34571]: from='client.? 172.21.15.84:0/2002169013' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T02:47:53.267 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:52 smithi090 ceph-mon[34571]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T02:47:53.629 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:53 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a[30743]: 2024-09-21T02:47:53.361+0000 7f3833400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:47:53.629 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:53 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a[30743]: 2024-09-21T02:47:53.361+0000 7f3833400640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T02:47:53.903 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:53 smithi084 podman[91262]: 2024-09-21 02:47:53.628314609 +0000 UTC m=+0.406077010 container died 2869e05ceb39fe2c3509b1333c27b26486cc7ed99f41fd6087ccf6c22a815e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:47:54.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:54 smithi084 podman[91262]: 2024-09-21 02:47:54.166807622 +0000 UTC m=+0.944570014 container cleanup 2869e05ceb39fe2c3509b1333c27b26486cc7ed99f41fd6087ccf6c22a815e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T02:47:54.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:54 smithi084 bash[91262]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a 2024-09-21T02:47:54.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 02:47:54 smithi084 podman[91274]: 2024-09-21 02:47:54.401574725 +0000 UTC m=+0.768440153 container remove 2869e05ceb39fe2c3509b1333c27b26486cc7ed99f41fd6087ccf6c22a815e57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T02:47:54.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T02:47:54.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:47:54.751 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T02:47:54.751 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T02:47:54.751 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.b 2024-09-21T02:47:55.069 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:54 smithi090 systemd[1]: Stopping Ceph mon.b for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:47:55.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-b[34567]: 2024-09-21T02:47:55.067+0000 7f33fbcd8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:47:55.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-b[34567]: 2024-09-21T02:47:55.067+0000 7f33fbcd8640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T02:47:55.517 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:55 smithi090 podman[65747]: 2024-09-21 02:47:55.282219058 +0000 UTC m=+0.333701299 container died 0efa60bf2ee943fbe4f0f4ac8f41616bbc08dafb34a2710a59d5fdf0894f43f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-21T02:47:55.931 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:55 smithi090 podman[65747]: 2024-09-21 02:47:55.6859995 +0000 UTC m=+0.737481731 container cleanup 0efa60bf2ee943fbe4f0f4ac8f41616bbc08dafb34a2710a59d5fdf0894f43f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:47:55.932 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:55 smithi090 bash[65747]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-b 2024-09-21T02:47:56.163 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T02:47:56.184 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:55 smithi090 podman[65761]: 2024-09-21 02:47:55.930963548 +0000 UTC m=+0.645013067 container remove 0efa60bf2ee943fbe4f0f4ac8f41616bbc08dafb34a2710a59d5fdf0894f43f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T02:47:56.184 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:56 smithi090 systemd[1]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T02:47:56.185 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:56 smithi090 systemd[1]: Stopped Ceph mon.b for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:47:56.185 INFO:journalctl@ceph.mon.b.smithi090.stdout:Sep 21 02:47:56 smithi090 systemd[1]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.b.service: Consumed 11.313s CPU time. 2024-09-21T02:47:56.208 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:47:56.209 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T02:47:56.209 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T02:47:56.209 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.c 2024-09-21T02:47:56.506 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:56 smithi172 systemd[1]: Stopping Ceph mon.c for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:47:56.774 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-c[35051]: 2024-09-21T02:47:56.539+0000 7f9382ca4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:47:56.774 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-c[35051]: 2024-09-21T02:47:56.539+0000 7f9382ca4640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T02:47:56.774 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:56 smithi172 podman[67334]: 2024-09-21 02:47:56.591240909 +0000 UTC m=+0.175472605 container died 210a6b4d73123e7d21858d27319a93456859058456224625857cabc4e8b93b25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T02:47:57.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:56 smithi172 podman[67334]: 2024-09-21 02:47:56.973817649 +0000 UTC m=+0.558049330 container cleanup 210a6b4d73123e7d21858d27319a93456859058456224625857cabc4e8b93b25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T02:47:57.256 INFO:journalctl@ceph.mon.c.smithi172.stdout:Sep 21 02:47:56 smithi172 bash[67334]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mon-c 2024-09-21T02:47:57.397 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T02:47:57.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:47:57.446 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T02:47:57.446 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T02:47:57.446 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x 2024-09-21T02:47:57.763 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:57 smithi084 systemd[1]: Stopping Ceph mgr.x for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:47:58.257 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:57 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:47:57.864+0000 7f95b8e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:47:58.257 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:57 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x[30970]: 2024-09-21T02:47:57.864+0000 7f95b8e00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T02:47:58.257 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:57 smithi084 podman[91381]: 2024-09-21 02:47:57.959210636 +0000 UTC m=+0.223904661 container died 7df86c183f495f2f311d581dd285cb153849180d5047bcbfc306f544bf8667df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:47:58.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:58 smithi084 podman[91381]: 2024-09-21 02:47:58.496250334 +0000 UTC m=+0.760944355 container cleanup 7df86c183f495f2f311d581dd285cb153849180d5047bcbfc306f544bf8667df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:47:58.513 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:58 smithi084 bash[91381]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x 2024-09-21T02:47:58.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T02:47:59.011 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:58 smithi084 podman[91394]: 2024-09-21 02:47:58.714516504 +0000 UTC m=+0.749727248 container remove 7df86c183f495f2f311d581dd285cb153849180d5047bcbfc306f544bf8667df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:47:59.011 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:58 smithi084 systemd[1]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x.service: Deactivated successfully. 2024-09-21T02:47:59.011 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:58 smithi084 systemd[1]: Stopped Ceph mgr.x for 5b18da14-77c1-11ef-baf5-efdc52797490. 2024-09-21T02:47:59.011 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 02:47:58 smithi084 systemd[1]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.x.service: Consumed 44.480s CPU time. 2024-09-21T02:47:59.036 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:47:59.036 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T02:47:59.036 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T02:47:59.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.y 2024-09-21T02:47:59.390 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:47:59 smithi090 systemd[1]: Stopping Ceph mgr.y for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:47:59.654 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:47:59 smithi090 podman[65872]: 2024-09-21 02:47:59.389266102 +0000 UTC m=+0.151044759 container died f1184dc398dbe42b0cdae8ef87f9a0505b6279223e5c1ae709b28408c2f4fa4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T02:48:00.017 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:47:59 smithi090 podman[65872]: 2024-09-21 02:47:59.794894391 +0000 UTC m=+0.556673048 container cleanup f1184dc398dbe42b0cdae8ef87f9a0505b6279223e5c1ae709b28408c2f4fa4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-09-21T02:48:00.017 INFO:journalctl@ceph.mgr.y.smithi090.stdout:Sep 21 02:47:59 smithi090 bash[65872]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-y 2024-09-21T02:48:00.258 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T02:48:00.293 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:00.293 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T02:48:00.294 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T02:48:00.294 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.z 2024-09-21T02:48:00.642 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:48:00 smithi172 systemd[1]: Stopping Ceph mgr.z for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:00.931 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:48:00 smithi172 podman[67469]: 2024-09-21 02:48:00.641451925 +0000 UTC m=+0.153206167 container died d5bee140c48c2553355b93a33df55caf5821d28a572c04acd55a687128f3bc0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-z, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:48:01.240 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:48:01 smithi172 podman[67469]: 2024-09-21 02:48:01.029871485 +0000 UTC m=+0.541625727 container cleanup d5bee140c48c2553355b93a33df55caf5821d28a572c04acd55a687128f3bc0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-z, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:48:01.240 INFO:journalctl@ceph.mgr.z.smithi172.stdout:Sep 21 02:48:01 smithi172 bash[67469]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mgr-z 2024-09-21T02:48:01.449 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T02:48:01.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:01.485 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T02:48:01.486 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T02:48:01.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.0 2024-09-21T02:48:01.904 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:01 smithi084 systemd[1]: Stopping Ceph osd.0 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:02.263 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:01 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0[46140]: 2024-09-21T02:48:01.902+0000 7fca12200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:48:02.263 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:01 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0[46140]: 2024-09-21T02:48:01.902+0000 7fca12200640 -1 osd.0 92 *** Got signal Terminated *** 2024-09-21T02:48:02.263 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:01 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0[46140]: 2024-09-21T02:48:01.902+0000 7fca12200640 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:48:07.668 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:07 smithi084 podman[91504]: 2024-09-21 02:48:07.336083543 +0000 UTC m=+5.565667606 container died 0f8bae43b283ce528c3b7d74dd57d9defd71a934b65ab0c255097323a5ed0385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T02:48:08.013 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:07 smithi084 podman[91504]: 2024-09-21 02:48:07.891526111 +0000 UTC m=+6.121110212 container cleanup 0f8bae43b283ce528c3b7d74dd57d9defd71a934b65ab0c255097323a5ed0385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T02:48:08.013 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:07 smithi084 bash[91504]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0 2024-09-21T02:48:08.513 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:08 smithi084 podman[91522]: 2024-09-21 02:48:08.118400926 +0000 UTC m=+0.775481144 container remove 0f8bae43b283ce528c3b7d74dd57d9defd71a934b65ab0c255097323a5ed0385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:48:08.914 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:08 smithi084 podman[91615]: 2024-09-21 02:48:08.553821088 +0000 UTC m=+0.027078062 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:48:08.914 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:08 smithi084 podman[91615]: 2024-09-21 02:48:08.652169858 +0000 UTC m=+0.125426833 container create 23e100c8b820e47be56284d0b47753949667e69325157b11db0c9288aa64307a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T02:48:09.173 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:08 smithi084 podman[91615]: 2024-09-21 02:48:08.913312217 +0000 UTC m=+0.386569199 container init 23e100c8b820e47be56284d0b47753949667e69325157b11db0c9288aa64307a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:48:09.173 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:08 smithi084 podman[91615]: 2024-09-21 02:48:08.919940379 +0000 UTC m=+0.393197354 container start 23e100c8b820e47be56284d0b47753949667e69325157b11db0c9288aa64307a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T02:48:09.173 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:09 smithi084 podman[91615]: 2024-09-21 02:48:09.004554239 +0000 UTC m=+0.477811232 container attach 23e100c8b820e47be56284d0b47753949667e69325157b11db0c9288aa64307a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T02:48:09.500 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 02:48:09 smithi084 podman[91615]: 2024-09-21 02:48:09.17275262 +0000 UTC m=+0.646009595 container died 23e100c8b820e47be56284d0b47753949667e69325157b11db0c9288aa64307a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-21T02:48:09.893 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T02:48:09.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:09.970 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T02:48:09.971 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T02:48:09.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.1 2024-09-21T02:48:10.267 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:10 smithi090 systemd[1]: Stopping Ceph osd.1 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:10.767 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1[38510]: 2024-09-21T02:48:10.287+0000 7f5fed7e7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:48:10.767 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1[38510]: 2024-09-21T02:48:10.287+0000 7f5fed7e7640 -1 osd.1 92 *** Got signal Terminated *** 2024-09-21T02:48:10.767 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1[38510]: 2024-09-21T02:48:10.287+0000 7f5fed7e7640 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:48:15.906 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:15 smithi090 podman[66007]: 2024-09-21 02:48:15.603657626 +0000 UTC m=+5.443866802 container died 6566d094bd45a448417b3238278ec3636a0f54c51a2dac7912d6cd4297d14692 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T02:48:16.267 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:16 smithi090 podman[66007]: 2024-09-21 02:48:16.00470154 +0000 UTC m=+5.844910728 container cleanup 6566d094bd45a448417b3238278ec3636a0f54c51a2dac7912d6cd4297d14692 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T02:48:16.267 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:16 smithi090 bash[66007]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1 2024-09-21T02:48:16.619 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:16 smithi090 podman[66022]: 2024-09-21 02:48:16.283055039 +0000 UTC m=+0.673065774 container remove 6566d094bd45a448417b3238278ec3636a0f54c51a2dac7912d6cd4297d14692 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T02:48:16.896 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:16 smithi090 podman[66113]: 2024-09-21 02:48:16.520972001 +0000 UTC m=+0.015613620 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:48:16.896 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:16 smithi090 podman[66113]: 2024-09-21 02:48:16.634198608 +0000 UTC m=+0.128840206 container create 87866852f14996fdf35e56723543a672e2f44fc25f08e1b9f6056eefb2241f2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T02:48:16.897 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:16 smithi090 podman[66113]: 2024-09-21 02:48:16.895873856 +0000 UTC m=+0.390515473 container init 87866852f14996fdf35e56723543a672e2f44fc25f08e1b9f6056eefb2241f2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T02:48:17.267 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:16 smithi090 podman[66113]: 2024-09-21 02:48:16.899528759 +0000 UTC m=+0.394170363 container start 87866852f14996fdf35e56723543a672e2f44fc25f08e1b9f6056eefb2241f2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:48:17.268 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:17 smithi090 podman[66113]: 2024-09-21 02:48:17.013061127 +0000 UTC m=+0.507702739 container attach 87866852f14996fdf35e56723543a672e2f44fc25f08e1b9f6056eefb2241f2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:48:17.268 INFO:journalctl@ceph.osd.1.smithi090.stdout:Sep 21 02:48:17 smithi090 podman[66113]: 2024-09-21 02:48:17.094655167 +0000 UTC m=+0.589296768 container died 87866852f14996fdf35e56723543a672e2f44fc25f08e1b9f6056eefb2241f2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T02:48:17.797 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T02:48:17.837 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:17.837 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T02:48:17.837 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T02:48:17.837 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.2 2024-09-21T02:48:18.176 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:17 smithi172 systemd[1]: Stopping Ceph osd.2 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:18.506 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2[39496]: 2024-09-21T02:48:18.175+0000 7f56ce1ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:48:18.506 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2[39496]: 2024-09-21T02:48:18.175+0000 7f56ce1ac640 -1 osd.2 92 *** Got signal Terminated *** 2024-09-21T02:48:18.506 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2[39496]: 2024-09-21T02:48:18.175+0000 7f56ce1ac640 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:48:23.870 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:23 smithi172 podman[67595]: 2024-09-21 02:48:23.577472312 +0000 UTC m=+5.544104261 container died 1299ffacedc021202f126898c72fff04b888ce9978f9c43de1030a2f9a601365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:48:24.161 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:23 smithi172 podman[67595]: 2024-09-21 02:48:23.958373128 +0000 UTC m=+5.925005077 container cleanup 1299ffacedc021202f126898c72fff04b888ce9978f9c43de1030a2f9a601365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T02:48:24.161 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:23 smithi172 bash[67595]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2 2024-09-21T02:48:24.506 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:24 smithi172 podman[67610]: 2024-09-21 02:48:24.160299436 +0000 UTC m=+0.576793550 container remove 1299ffacedc021202f126898c72fff04b888ce9978f9c43de1030a2f9a601365 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T02:48:24.865 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:24 smithi172 podman[67696]: 2024-09-21 02:48:24.472472596 +0000 UTC m=+0.015763181 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:48:24.865 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:24 smithi172 podman[67696]: 2024-09-21 02:48:24.611245814 +0000 UTC m=+0.154536374 container create 95f8341da7197897d424944c99264e6ffceeed77dd3bcbedd3cfff8555f642bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:48:25.256 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:24 smithi172 podman[67696]: 2024-09-21 02:48:24.864505695 +0000 UTC m=+0.407796256 container init 95f8341da7197897d424944c99264e6ffceeed77dd3bcbedd3cfff8555f642bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:48:25.256 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:24 smithi172 podman[67696]: 2024-09-21 02:48:24.868168008 +0000 UTC m=+0.411458569 container start 95f8341da7197897d424944c99264e6ffceeed77dd3bcbedd3cfff8555f642bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T02:48:25.256 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:24 smithi172 podman[67696]: 2024-09-21 02:48:24.964546168 +0000 UTC m=+0.507836738 container attach 95f8341da7197897d424944c99264e6ffceeed77dd3bcbedd3cfff8555f642bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-21T02:48:25.257 INFO:journalctl@ceph.osd.2.smithi172.stdout:Sep 21 02:48:25 smithi172 podman[67696]: 2024-09-21 02:48:25.065321604 +0000 UTC m=+0.608612167 container died 95f8341da7197897d424944c99264e6ffceeed77dd3bcbedd3cfff8555f642bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:48:25.682 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T02:48:25.721 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:25.722 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T02:48:25.722 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T02:48:25.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.3 2024-09-21T02:48:26.138 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:25 smithi084 systemd[1]: Stopping Ceph osd.3 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:26.513 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:26 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3[52360]: 2024-09-21T02:48:26.136+0000 7f335a000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:48:26.513 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:26 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3[52360]: 2024-09-21T02:48:26.136+0000 7f335a000640 -1 osd.3 92 *** Got signal Terminated *** 2024-09-21T02:48:26.513 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:26 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3[52360]: 2024-09-21T02:48:26.136+0000 7f335a000640 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:48:29.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:29 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:29.017+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:29.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:29 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:29.160+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:29.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:29 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:29.205+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:30.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:30 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:30.029+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:30.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:30 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:30.196+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:30.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:30 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:30.248+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:31.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:31.003+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:31.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:31 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:31.170+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:31.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:31 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:31.219+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:31.860 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:31 smithi084 podman[91728]: 2024-09-21 02:48:31.574626951 +0000 UTC m=+5.562953861 container died 552c81709c0494db5062b6f05c5e00bcc189c49fca4eea637e610c5d2b5623bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T02:48:32.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:31.566+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:32.128 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:32 smithi084 podman[91728]: 2024-09-21 02:48:32.04135187 +0000 UTC m=+6.029678778 container cleanup 552c81709c0494db5062b6f05c5e00bcc189c49fca4eea637e610c5d2b5623bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T02:48:32.129 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:32 smithi084 bash[91728]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3 2024-09-21T02:48:32.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:32.174+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:32.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:32.046+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:32.513 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:32 smithi084 podman[91745]: 2024-09-21 02:48:32.326304286 +0000 UTC m=+0.744259686 container remove 552c81709c0494db5062b6f05c5e00bcc189c49fca4eea637e610c5d2b5623bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:48:32.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:32 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:32.126+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:32.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:32 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:32.220+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:33.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:32.588+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:33.088 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:32 smithi084 podman[91831]: 2024-09-21 02:48:32.711255324 +0000 UTC m=+0.027275811 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:48:33.088 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:32 smithi084 podman[91831]: 2024-09-21 02:48:32.81856284 +0000 UTC m=+0.134583319 container create 552e9e5e7b44c0ea71e62f73507812c4098c0f69c5c180e10c8aa3a2bdd7d415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T02:48:33.347 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:33 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:33.144+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:33.348 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:33 smithi084 podman[91831]: 2024-09-21 02:48:33.087946491 +0000 UTC m=+0.403966969 container init 552e9e5e7b44c0ea71e62f73507812c4098c0f69c5c180e10c8aa3a2bdd7d415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:48:33.348 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:33 smithi084 podman[91831]: 2024-09-21 02:48:33.094840453 +0000 UTC m=+0.410860933 container start 552e9e5e7b44c0ea71e62f73507812c4098c0f69c5c180e10c8aa3a2bdd7d415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T02:48:33.348 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:33 smithi084 podman[91831]: 2024-09-21 02:48:33.17955847 +0000 UTC m=+0.495578963 container attach 552e9e5e7b44c0ea71e62f73507812c4098c0f69c5c180e10c8aa3a2bdd7d415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:48:33.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:33.179+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:33.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:33.073+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:33.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:33 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:33.236+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:33.749 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 02:48:33 smithi084 podman[91831]: 2024-09-21 02:48:33.347455029 +0000 UTC m=+0.663475509 container died 552e9e5e7b44c0ea71e62f73507812c4098c0f69c5c180e10c8aa3a2bdd7d415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T02:48:34.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:33.590+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:34.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T02:48:34.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:34.306 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T02:48:34.307 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T02:48:34.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.4 2024-09-21T02:48:34.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:34.140+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:34.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:34.089+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:34.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:34 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:34.107+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:34.517 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:34 smithi090 systemd[1]: Stopping Ceph osd.4 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:34.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:34 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:34.257+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:35.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:34.639+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:35.017 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:34 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4[44833]: 2024-09-21T02:48:34.624+0000 7f6f09415640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:48:35.017 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:34 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4[44833]: 2024-09-21T02:48:34.624+0000 7f6f09415640 -1 osd.4 92 *** Got signal Terminated *** 2024-09-21T02:48:35.017 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:34 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4[44833]: 2024-09-21T02:48:34.624+0000 7f6f09415640 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:48:35.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:35.189+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:35.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:35.095+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:35.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:35 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:35.082+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:35.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:35 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:35.294+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:36.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:35.643+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:36.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:36 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:36.197+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:36.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:36 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:36.084+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:36.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:36 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:36.060+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:36.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:36 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:36.293+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:37.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:36 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:36.678+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:37.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:36 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:36.678+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:37.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:36 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:36.902+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:37.414 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:37 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:37.043+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:37.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:37 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:37.209+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:37.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:37 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:37.125+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:37.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:37 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:37.338+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:38.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:37 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:37.702+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:38.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:37 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:37.702+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:38.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:37 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:37.877+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:38.440 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:38 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:38.053+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:38.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:38 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:38.216+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:38.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:38 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:38.141+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:38.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:38 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:38.292+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:38.767 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:38 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4[44833]: 2024-09-21T02:48:38.526+0000 7f6f019f8640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:09.636393+0000 front 2024-09-21T02:48:09.636462+0000 (oldest deadline 2024-09-21T02:48:38.437211+0000) 2024-09-21T02:48:39.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:38 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:38.668+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:39.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:38 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:38.668+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:39.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:38 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:38.890+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:39.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:39 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:39.203+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:39.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:39 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:39.129+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:39.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:39 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:39.074+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:39.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:39 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:39.183+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:39.767 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:39 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4[44833]: 2024-09-21T02:48:39.547+0000 7f6f019f8640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:09.636393+0000 front 2024-09-21T02:48:09.636462+0000 (oldest deadline 2024-09-21T02:48:38.437211+0000) 2024-09-21T02:48:39.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:39 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:39.312+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:40.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:39 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:39.704+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:40.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:39 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:39.704+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:40.211 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:40 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:40.069+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:40.267 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:40 smithi090 podman[66229]: 2024-09-21 02:48:40.041987947 +0000 UTC m=+5.532015888 container died dc806323920f1baa35769d1799054c89de0fd09d270a4998cbe2e2ccdfe510e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T02:48:40.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:39 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:39.886+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:40.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:40.242+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:40.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:40.090+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:40.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:40.090+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:40.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:40 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:40.210+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:40.688 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:40 smithi090 podman[66229]: 2024-09-21 02:48:40.460542493 +0000 UTC m=+5.950570434 container cleanup dc806323920f1baa35769d1799054c89de0fd09d270a4998cbe2e2ccdfe510e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T02:48:40.688 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:40 smithi090 bash[66229]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4 2024-09-21T02:48:40.688 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:40.316+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:40.688 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:40.316+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:41.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:40.663+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:41.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:40 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:40.663+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:41.015 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:40 smithi090 podman[66246]: 2024-09-21 02:48:40.687281314 +0000 UTC m=+0.640180872 container remove dc806323920f1baa35769d1799054c89de0fd09d270a4998cbe2e2ccdfe510e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T02:48:41.015 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:40 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:40.909+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:41.267 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:41 smithi090 podman[66332]: 2024-09-21 02:48:40.917323305 +0000 UTC m=+0.016312157 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:48:41.267 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:41 smithi090 podman[66332]: 2024-09-21 02:48:41.046725275 +0000 UTC m=+0.145714151 container create 2ae29cf5a4fb155d99c18c2580a712b6a38e9a13ca3f6006a5504606947bdcd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:48:41.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:41 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:41.247+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:41.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:41 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:41.122+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:41.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:41 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:41.122+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:41.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:41 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:41.229+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:41.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:41 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:41.026+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:41.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:41 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:41.026+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:41.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:41 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:41.271+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:41.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:41 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:41.272+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:41.768 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:41 smithi090 podman[66332]: 2024-09-21 02:48:41.3083158 +0000 UTC m=+0.407304634 container init 2ae29cf5a4fb155d99c18c2580a712b6a38e9a13ca3f6006a5504606947bdcd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T02:48:41.768 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:41 smithi090 podman[66332]: 2024-09-21 02:48:41.311642968 +0000 UTC m=+0.410631803 container start 2ae29cf5a4fb155d99c18c2580a712b6a38e9a13ca3f6006a5504606947bdcd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:48:41.768 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:41 smithi090 podman[66332]: 2024-09-21 02:48:41.408269704 +0000 UTC m=+0.507258547 container attach 2ae29cf5a4fb155d99c18c2580a712b6a38e9a13ca3f6006a5504606947bdcd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:48:41.768 INFO:journalctl@ceph.osd.4.smithi090.stdout:Sep 21 02:48:41 smithi090 podman[66332]: 2024-09-21 02:48:41.498229768 +0000 UTC m=+0.597218603 container died 2ae29cf5a4fb155d99c18c2580a712b6a38e9a13ca3f6006a5504606947bdcd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-21T02:48:42.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:41 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:41.711+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:42.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:41 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:41.711+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:42.148 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:41 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:41.862+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:42.170 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T02:48:42.211 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:42.211 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T02:48:42.211 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T02:48:42.211 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.5 2024-09-21T02:48:42.263 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:42.232+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:42.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:41 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:41.982+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:42.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:41 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:41.982+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:42.506 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:42 smithi172 systemd[1]: Stopping Ceph osd.5 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:42.507 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:42 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:42.277+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:42.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:42 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:42.148+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:42.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:42 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:42.148+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:42.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:42 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:42.303+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:42.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:42 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:42.303+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:43.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:42 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:42.540+0000 7f2262b87640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:48:43.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:42 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:42.540+0000 7f2262b87640 -1 osd.5 92 *** Got signal Terminated *** 2024-09-21T02:48:43.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:42 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:42.540+0000 7f2262b87640 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:48:43.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:42 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:42.734+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:43.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:42 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:42.734+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:43.254 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:42.949+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:43.254 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:42 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:42.949+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:43.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:42 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:42.817+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:43.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:43 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:43.278+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:43.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:43 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:43.139+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:43.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:43 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:43.139+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:43.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:43 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:43.253+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:43.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:43 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:43.314+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:43.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:43 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:43.314+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:44.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:43 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:43.710+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:44.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:43 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:43.710+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:44.261 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:43 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:43.930+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:44.261 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:43 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:43.930+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:44.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:43 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:43.833+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:44.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:44 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:44.244+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:44.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:44 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:44.181+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:44.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:44 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:44.181+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:44.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:44 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:44.260+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:44.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:44 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:44.281+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:44.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:44 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:44.281+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:45.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:44 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:44.694+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:45.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:44 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:44.694+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:45.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:44 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:44.694+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:18.062286+0000 front 2024-09-21T02:48:18.062329+0000 (oldest deadline 2024-09-21T02:48:43.962319+0000) 2024-09-21T02:48:45.252 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:44 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:44.948+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:45.252 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:44 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:44.948+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:45.266 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:44 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:44.838+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:45.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:45 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:45.285+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:45.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:45 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:45.285+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:45.506 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:45 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:45.135+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:45.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:45 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:45.135+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:45.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:45 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:45.135+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:45.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:45 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:45.250+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:45.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:45 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:45.250+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:45.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:45 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:45.264+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:45.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:45 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:45.264+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:45.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:45 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:45.264+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:46.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:45 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:45.722+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:46.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:45 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:45.722+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:46.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:45 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:45.722+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:18.062286+0000 front 2024-09-21T02:48:18.062329+0000 (oldest deadline 2024-09-21T02:48:43.962319+0000) 2024-09-21T02:48:46.255 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:45 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:45.993+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:46.255 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:45 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:45.993+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:46.257 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:45 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:45.798+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:46.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:46 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:46.311+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:46.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:46 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:46.311+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:46.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:46 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:46.165+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:46.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:46 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:46.165+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:46.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:46 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:46.165+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:46.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:46 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:46.254+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:46.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:46 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:46.254+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:46.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:46 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:46.256+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:46.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:46 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:46.256+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:46.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:46 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:46.256+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:47.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:46 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:46.691+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:01.160234+0000 front 2024-09-21T02:48:01.160194+0000 (oldest deadline 2024-09-21T02:48:31.160578+0000) 2024-09-21T02:48:47.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:46 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:46.691+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.461514+0000 front 2024-09-21T02:48:13.461603+0000 (oldest deadline 2024-09-21T02:48:35.761436+0000) 2024-09-21T02:48:47.006 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:46 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5[46083]: 2024-09-21T02:48:46.691+0000 7f225b16a640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:18.062286+0000 front 2024-09-21T02:48:18.062329+0000 (oldest deadline 2024-09-21T02:48:43.962319+0000) 2024-09-21T02:48:47.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:46 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:46.971+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:47.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:46 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:46.971+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:47.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:46 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:46.971+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:47.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:46 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:46.773+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:47.267 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:46 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:46.773+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:47.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:47 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:47.319+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:47.506 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:47 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:47.319+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:47.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:47 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:47.150+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:47.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:47 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:47.150+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:47.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:47 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:47.150+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:47.763 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:47 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:47.286+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:47.763 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:47 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:47.286+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:47.763 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:47 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:47.286+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:47.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:47.279+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:47.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:47.279+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:48.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:47 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:47.761+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:48.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:47 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:47.761+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:48.148 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:47 smithi172 podman[67809]: 2024-09-21 02:48:47.881304171 +0000 UTC m=+5.476231578 container died 1cccded0deed024201da628a7f88ff3478ceeee8def761dd12c4db3bbf49ac24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T02:48:48.249 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:47.968+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:48.250 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:47.968+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:48.250 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:47 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:47.968+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:48.506 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:48 smithi172 podman[67809]: 2024-09-21 02:48:48.237857944 +0000 UTC m=+5.832785351 container cleanup 1cccded0deed024201da628a7f88ff3478ceeee8def761dd12c4db3bbf49ac24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T02:48:48.506 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:48 smithi172 bash[67809]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5 2024-09-21T02:48:48.507 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:48 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:48.330+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:48.507 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:48 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:48.330+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:48.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:48 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:48.154+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:48.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:48 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:48.154+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:48.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:48 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:48.154+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:48.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:48 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:48.248+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:48.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:48 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:48.248+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:48.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:48 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:48.259+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:48.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:48 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:48.259+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:48.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:48 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:48.259+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:48.856 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:48 smithi172 podman[67825]: 2024-09-21 02:48:48.530953496 +0000 UTC m=+0.650754280 container remove 1cccded0deed024201da628a7f88ff3478ceeee8def761dd12c4db3bbf49ac24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T02:48:49.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:48 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:48.746+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:49.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:48 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:48.746+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:49.110 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:48 smithi172 podman[67915]: 2024-09-21 02:48:48.758702038 +0000 UTC m=+0.016123248 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:48:49.110 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:48 smithi172 podman[67915]: 2024-09-21 02:48:48.893416336 +0000 UTC m=+0.150837545 container create a01cfe63621852040c29142e5630e8a94bccfc6208f57285b49ee2044f424f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T02:48:49.110 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:49 smithi172 podman[67915]: 2024-09-21 02:48:49.109609708 +0000 UTC m=+0.367030905 container init a01cfe63621852040c29142e5630e8a94bccfc6208f57285b49ee2044f424f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T02:48:49.263 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:49 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:49.239+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:49.263 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:49 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:49.239+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:49.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:48 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:48.994+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:49.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:48 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:48.994+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:49.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:48 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:48.994+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:49.507 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:49 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:49.322+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:49.507 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:49 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:49.322+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:49.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:49 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:49.120+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:49.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:49 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:49.120+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:49.507 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:49 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:49.120+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:49.507 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:49 smithi172 podman[67915]: 2024-09-21 02:48:49.11288978 +0000 UTC m=+0.370310977 container start a01cfe63621852040c29142e5630e8a94bccfc6208f57285b49ee2044f424f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:48:49.507 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:49 smithi172 podman[67915]: 2024-09-21 02:48:49.227646865 +0000 UTC m=+0.485068072 container attach a01cfe63621852040c29142e5630e8a94bccfc6208f57285b49ee2044f424f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:48:49.507 INFO:journalctl@ceph.osd.5.smithi172.stdout:Sep 21 02:48:49 smithi172 podman[67915]: 2024-09-21 02:48:49.304469952 +0000 UTC m=+0.561891159 container died a01cfe63621852040c29142e5630e8a94bccfc6208f57285b49ee2044f424f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T02:48:49.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:49 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:49.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:49.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:49 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:49.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:49.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:49 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:49.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:49.942 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T02:48:49.980 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:49.980 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T02:48:49.980 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T02:48:49.980 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.6 2024-09-21T02:48:50.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:49 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:49.731+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:50.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:49 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:49.731+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:50.230 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:50 smithi084 systemd[1]: Stopping Ceph osd.6 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:50.230 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:49 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:49.997+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:50.231 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:49 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:49.997+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:50.231 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:49 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:49.997+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:50.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:50 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:50.098+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:50.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:50 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:50.098+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:50.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:50 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:50.098+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:50.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:50 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:50.228+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:50.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:50 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:50.228+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:50.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:50 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:50.420+0000 7f30e0e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:48:50.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:50 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:50.420+0000 7f30e0e00640 -1 osd.6 92 *** Got signal Terminated *** 2024-09-21T02:48:50.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:50 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:50.420+0000 7f30e0e00640 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:48:50.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:50 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:50.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:50.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:50 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:50.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:50.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:50 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:50.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:50.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:50 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:50.366+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:50.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:50 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:50.366+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:51.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:50 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:50.750+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:51.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:50 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:50.750+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:51.349 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:51 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:51.067+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:51.349 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:51 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:51.067+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:51.349 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:51 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:51.067+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:51.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:51 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:51.252+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:51.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:51 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:51.252+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:51.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:51 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:51.040+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:51.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:51 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:51.040+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:51.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:51 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:51.040+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:51.742 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:51 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:51.277+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:51.743 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:51 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:51.277+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:51.743 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:51 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:51.277+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:51.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:51 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:51.348+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:51.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:51 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:51.348+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:52.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:51 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:51.741+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:52.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:51 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:51.741+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:52.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:51 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:51.995+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:52.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:51 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:51.995+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:52.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:51 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:51.995+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:52.377 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:52 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:52.034+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:52.377 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:52 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:52.034+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:52.377 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:52 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:52.034+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:52.696 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:52 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:52.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:52.696 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:52 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:52.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:52.696 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:52 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:52.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:52.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:52 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:52.376+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:52.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:52 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:52.376+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:52.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:52 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:52.376+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:48:52.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:52 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:52.293+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:52.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:52 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:52.293+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:52.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:52 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:52.293+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.845803+0000 front 2024-09-21T02:48:29.845908+0000 (oldest deadline 2024-09-21T02:48:52.046280+0000) 2024-09-21T02:48:53.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:52 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:52.695+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:53.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:52 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:52.695+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:53.311 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:53 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:53.033+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:53.311 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:53 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:53.033+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:53.312 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:53 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:53.033+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:53.363 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:53 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:53.024+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:53.363 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:53 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:53.024+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:53.363 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:53 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:53.024+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:53.654 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:53 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:53.307+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:53.654 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:53 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:53.307+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:53.654 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:53 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:53.307+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:53.654 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:53 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:53.307+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:48:53.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:53 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:53.362+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:53.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:53 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:53.362+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:53.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:53 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:53.362+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:48:53.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:53 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:53.309+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:53.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:53 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:53.309+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:53.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:53 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:53.309+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.845803+0000 front 2024-09-21T02:48:29.845908+0000 (oldest deadline 2024-09-21T02:48:52.046280+0000) 2024-09-21T02:48:54.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:53 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:53.652+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:54.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:53 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:53.652+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:54.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:53 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:53.652+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:48:54.329 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:54.016+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:54.329 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:54.016+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:54.329 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:54.016+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:54.329 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:54.016+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:48:54.385 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:54 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:54.014+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:54.385 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:54 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:54.014+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:54.385 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:54 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:54.014+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:54.607 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:54 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:54.327+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:54.607 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:54 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:54.327+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:54.607 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:54 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:54.327+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:54.607 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:54 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:54.327+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:48:54.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:54 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:54.383+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:54.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:54 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:54.383+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:54.757 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:54 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:54.383+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:48:54.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:54.327+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:54.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:54.327+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:54.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:54.327+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.845803+0000 front 2024-09-21T02:48:29.845908+0000 (oldest deadline 2024-09-21T02:48:52.046280+0000) 2024-09-21T02:48:55.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:54 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:54.605+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:55.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:54 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:54.605+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:55.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:54 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:54.605+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:48:55.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:54.974+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:55.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:54.974+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:55.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:54.974+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:55.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:54 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:54.974+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:48:55.337 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:55 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:55.006+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:55.337 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:55 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:55.006+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:55.337 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:55 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:55.006+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:55.645 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:55.289+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:55.645 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:55.289+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:55.645 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:55.289+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:55.645 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:55.289+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:48:55.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:55 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:55.336+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:55.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:55 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:55.336+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:55.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:55 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:55.336+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:48:55.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:55 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:55.287+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.543399+0000 front 2024-09-21T02:48:13.543357+0000 (oldest deadline 2024-09-21T02:48:38.243436+0000) 2024-09-21T02:48:55.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:55 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:55.287+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:22.845219+0000 front 2024-09-21T02:48:22.845341+0000 (oldest deadline 2024-09-21T02:48:44.544940+0000) 2024-09-21T02:48:55.763 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:55 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6[58505]: 2024-09-21T02:48:55.287+0000 7f30d7800640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.845803+0000 front 2024-09-21T02:48:29.845908+0000 (oldest deadline 2024-09-21T02:48:52.046280+0000) 2024-09-21T02:48:56.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:55.644+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:56.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:55.644+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:56.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:55 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:55.644+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:48:56.162 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:55 smithi084 podman[91943]: 2024-09-21 02:48:55.894332258 +0000 UTC m=+5.632583606 container died 852277f5a631693e8c06df71cf01311d90d5377be1e3fd31db99ed53d609b00d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T02:48:56.162 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:55 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:55.940+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:56.162 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:55 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:55.940+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:56.162 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:55 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:55.940+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:56.162 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:55 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:55.940+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:48:56.386 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:56.007+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:56.387 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:56.007+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:56.387 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:56.007+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:56.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:56 smithi084 podman[91943]: 2024-09-21 02:48:56.358754427 +0000 UTC m=+6.097005756 container cleanup 852277f5a631693e8c06df71cf01311d90d5377be1e3fd31db99ed53d609b00d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T02:48:56.513 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:56 smithi084 bash[91943]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6 2024-09-21T02:48:56.622 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:56 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:56.281+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:56.622 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:56 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:56.281+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:56.622 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:56 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:56.281+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:56.622 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:56 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:56.281+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:48:56.665 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:56.385+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:56.665 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:56.385+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:56.665 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:56.385+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:48:56.979 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:56 smithi084 podman[91961]: 2024-09-21 02:48:56.560494822 +0000 UTC m=+0.652376497 container remove 852277f5a631693e8c06df71cf01311d90d5377be1e3fd31db99ed53d609b00d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T02:48:57.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:56 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:56.621+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:57.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:56 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:56.621+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:57.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:56 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:56.621+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:48:57.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:56.984+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:57.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:56.984+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:57.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:56 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:56.984+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:57.263 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:57 smithi084 podman[92046]: 2024-09-21 02:48:57.016262665 +0000 UTC m=+0.027801184 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:48:57.263 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:57 smithi084 podman[92046]: 2024-09-21 02:48:57.136024011 +0000 UTC m=+0.147562530 container create 1adc690186136427d5f87f0f31c2c860927d526516926f48473d33c74b458c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T02:48:57.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:56 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:56.976+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:57.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:56 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:56.976+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:57.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:56 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:56.976+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:57.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:56 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:56.976+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:48:57.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:57.249+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:57.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:57.249+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:57.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:57.249+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:57.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:57.249+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:48:57.622 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:57 smithi084 podman[92046]: 2024-09-21 02:48:57.363446681 +0000 UTC m=+0.374985209 container init 1adc690186136427d5f87f0f31c2c860927d526516926f48473d33c74b458c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T02:48:57.622 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:57 smithi084 podman[92046]: 2024-09-21 02:48:57.370474825 +0000 UTC m=+0.382013353 container start 1adc690186136427d5f87f0f31c2c860927d526516926f48473d33c74b458c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T02:48:57.623 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:57 smithi084 podman[92046]: 2024-09-21 02:48:57.454920197 +0000 UTC m=+0.466458724 container attach 1adc690186136427d5f87f0f31c2c860927d526516926f48473d33c74b458c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:48:57.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:57 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:57.431+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:57.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:57 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:57.431+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:57.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:57 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:57.431+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:48:57.949 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 02:48:57 smithi084 podman[92046]: 2024-09-21 02:48:57.622152602 +0000 UTC m=+0.633691139 container died 1adc690186136427d5f87f0f31c2c860927d526516926f48473d33c74b458c5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T02:48:58.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:57.582+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:58.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:57.582+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:58.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:57.582+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:48:58.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:57 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:57.981+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:58.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:57 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:57.981+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:58.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:57 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:57.981+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:58.259 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:57 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:57.954+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:58.260 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:57 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:57.957+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:58.260 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:57 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:57.957+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:58.260 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:57 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:57.957+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:48:58.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T02:48:58.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:48:58.367 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T02:48:58.367 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T02:48:58.367 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.7 2024-09-21T02:48:58.604 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:58 smithi090 systemd[1]: Stopping Ceph osd.7 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:48:58.604 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:58.291+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:58.604 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:58.291+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:58.604 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:58.291+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:58.604 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:58.291+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:48:58.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:58 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:58.440+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:58.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:58 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:58.440+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:58.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:58 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:58.440+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:48:59.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:58.602+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:48:59.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:58.602+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:48:59.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:58.602+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:48:59.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:58.687+0000 7f0dcbbe7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:48:59.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:58.687+0000 7f0dcbbe7640 -1 osd.7 92 *** Got signal Terminated *** 2024-09-21T02:48:59.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:58 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:58.687+0000 7f0dcbbe7640 -1 osd.7 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:48:59.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:58 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:58.948+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:48:59.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:58 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:58.948+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:48:59.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:58 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:58.948+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:48:59.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:58 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:58.989+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:48:59.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:58 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:58.989+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:48:59.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:58 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:58.989+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:48:59.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:58 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:58.989+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:48:59.652 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:59 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:59.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:48:59.652 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:59 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:59.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:48:59.652 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:59 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:59.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:48:59.652 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:48:59 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:48:59.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:48:59.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:59 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:59.414+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:48:59.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:59 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:59.414+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:48:59.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:48:59 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:48:59.414+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:00.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:59 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:59.971+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:00.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:59 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:59.971+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:00.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:59 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:59.971+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:00.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:48:59 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:48:59.971+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:00.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:59 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:59.649+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:49:00.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:59 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:59.649+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:49:00.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:48:59 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:48:59.649+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:49:00.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:59 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:59.971+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:00.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:59 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:59.971+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:00.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:48:59 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:48:59.971+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:00.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:00 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:00.283+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:00.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:00 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:00.283+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:00.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:00 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:00.283+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:00.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:00 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:00.283+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:00.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:00 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:00.431+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:00.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:00 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:00.431+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:00.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:00 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:00.431+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:01.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:00 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:00.693+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:49:01.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:00 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:00.693+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:49:01.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:00 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:00.693+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:49:01.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:00 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:00.969+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:01.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:00 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:00.969+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:01.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:00 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:00.969+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:01.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:00 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:00.932+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:01.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:00 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:00.932+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:01.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:00 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:00.932+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:01.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:00 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:00.932+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:01.690 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:01.304+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:01.690 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:01.304+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:01.691 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:01.304+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:01.691 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:01.304+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:01.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:01 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:01.455+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:01.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:01 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:01.455+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:01.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:01 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:01.455+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:02.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:01.688+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:49:02.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:01.689+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:49:02.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:01.689+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:49:02.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:01 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:01.954+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:02.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:01 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:01.954+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:02.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:01 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:01.954+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:02.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:01 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:01.907+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:02.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:01 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:01.907+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:02.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:01 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:01.907+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:02.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:01 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:01.907+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:02.673 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:02.272+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:02.673 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:02.272+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:02.673 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:02.272+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:02.673 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:02.272+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:02.673 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:02.272+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:02.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:02 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:02.497+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:02.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:02 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:02.497+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:02.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:02 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:02.497+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:02.926 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:02 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:02.923+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:02.926 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:02 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:02.923+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:02.926 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:02 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:02.923+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:02.926 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:02 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:02.923+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:03.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:02.672+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:49:03.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:02.672+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:49:03.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:02.672+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:49:03.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:02 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:02.672+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:38.929168+0000 front 2024-09-21T02:48:38.929192+0000 (oldest deadline 2024-09-21T02:49:02.429347+0000) 2024-09-21T02:49:03.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:02 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:02.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:03.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:02 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:02.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:03.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:02 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:02.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:03.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:02 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:02.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:03.627 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:03.294+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:03.627 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:03.294+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:03.627 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:03.294+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:03.627 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:03.294+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:03.627 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:03.294+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:03.969 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:03 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:03.510+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:03.969 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:03 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:03.510+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:03.969 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:03 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:03.510+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:03.969 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:03 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:03.510+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:04.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:03.626+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:10.726128+0000 front 2024-09-21T02:48:10.726095+0000 (oldest deadline 2024-09-21T02:48:36.626269+0000) 2024-09-21T02:49:04.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:03.626+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.127452+0000 front 2024-09-21T02:48:20.127550+0000 (oldest deadline 2024-09-21T02:48:46.027382+0000) 2024-09-21T02:49:04.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:03.626+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:28.928539+0000 front 2024-09-21T02:48:28.928712+0000 (oldest deadline 2024-09-21T02:48:53.028390+0000) 2024-09-21T02:49:04.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:03 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7[51018]: 2024-09-21T02:49:03.626+0000 7f0dc41ca640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:38.929168+0000 front 2024-09-21T02:48:38.929192+0000 (oldest deadline 2024-09-21T02:49:02.429347+0000) 2024-09-21T02:49:04.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:03 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:03.968+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:04.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:03 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:03.968+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:04.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:03 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:03.968+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:04.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:03 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:03.968+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:04.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:03 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:03.825+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:04.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:03 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:03.825+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:04.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:03 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:03.826+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:04.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:03 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:03.826+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:04.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:03 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:03.826+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:04.365 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:04 smithi090 podman[66436]: 2024-09-21 02:49:04.060326207 +0000 UTC m=+5.504617700 container died 2ecc0edd0b13add7710eb0a19f8a7089a2de8bc56168f30ca640e2f824339b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T02:49:04.366 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:04 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:04.302+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:04.366 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:04 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:04.302+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:04.366 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:04 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:04.302+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:04.366 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:04 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:04.302+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:04.366 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:04 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:04.302+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:04.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:04 smithi090 podman[66436]: 2024-09-21 02:49:04.472462984 +0000 UTC m=+5.916754454 container cleanup 2ecc0edd0b13add7710eb0a19f8a7089a2de8bc56168f30ca640e2f824339b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T02:49:04.734 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:04 smithi090 bash[66436]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7 2024-09-21T02:49:04.978 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:04.526+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:04.978 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:04.526+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:04.978 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:04.526+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:04.978 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:04.526+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:05.017 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:04 smithi090 podman[66466]: 2024-09-21 02:49:04.732724473 +0000 UTC m=+0.665710638 container remove 2ecc0edd0b13add7710eb0a19f8a7089a2de8bc56168f30ca640e2f824339b90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T02:49:05.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:04.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:05.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:04.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:05.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:04.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:05.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:04 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:04.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:05.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:04 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:04.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:05.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:04 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:04.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:05.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:04 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:04.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:05.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:04 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:04.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:05.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:04 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:04.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:05.433 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:05 smithi090 podman[66554]: 2024-09-21 02:49:05.040242546 +0000 UTC m=+0.015375044 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:49:05.433 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:05 smithi090 podman[66554]: 2024-09-21 02:49:05.158834468 +0000 UTC m=+0.133966996 container create efc11afeba0b88d2f4a9a587dd861d9e73c86d308b887580956c41698052facd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T02:49:05.433 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:05 smithi090 podman[66554]: 2024-09-21 02:49:05.432220795 +0000 UTC m=+0.407353280 container init efc11afeba0b88d2f4a9a587dd861d9e73c86d308b887580956c41698052facd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T02:49:05.433 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:05 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:05.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:05.433 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:05 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:05.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:05.433 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:05 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:05.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:05.433 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:05 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:05.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:05.434 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:05 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:05.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:05.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:05 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:05.492+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:05.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:05 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:05.492+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:05.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:05 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:05.492+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:05.757 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:05 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:05.492+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:05.767 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:05 smithi090 podman[66554]: 2024-09-21 02:49:05.435534768 +0000 UTC m=+0.410667262 container start efc11afeba0b88d2f4a9a587dd861d9e73c86d308b887580956c41698052facd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:49:05.767 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:05 smithi090 podman[66554]: 2024-09-21 02:49:05.521511795 +0000 UTC m=+0.496644297 container attach efc11afeba0b88d2f4a9a587dd861d9e73c86d308b887580956c41698052facd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:49:05.767 INFO:journalctl@ceph.osd.7.smithi090.stdout:Sep 21 02:49:05 smithi090 podman[66554]: 2024-09-21 02:49:05.622674148 +0000 UTC m=+0.597806634 container died efc11afeba0b88d2f4a9a587dd861d9e73c86d308b887580956c41698052facd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:49:06.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:05 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:05.834+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:06.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:05 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:05.834+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:06.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:05 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:05.834+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:06.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:05 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:05.834+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:06.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:05 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:05.834+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:06.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T02:49:06.341 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:06.341 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T02:49:06.341 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T02:49:06.341 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.8 2024-09-21T02:49:06.369 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:06.019+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:06.370 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:06.019+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:06.370 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:06.019+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:06.370 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:06.019+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:06.658 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:06 smithi172 systemd[1]: Stopping Ceph osd.8 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:06.658 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:06.497+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:06.659 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:06.497+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:06.659 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:06.497+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:06.659 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:06.497+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:06.659 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:06.657+0000 7f4227262640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:06.659 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:06.657+0000 7f4227262640 -1 osd.8 92 *** Got signal Terminated *** 2024-09-21T02:49:06.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:06 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:06.312+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:06.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:06 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:06.312+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:06.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:06 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:06.312+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:06.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:06 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:06.312+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:06.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:06 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:06.312+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:06.989 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:06.657+0000 7f4227262640 -1 osd.8 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:49:07.164 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:06 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:06.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:07.165 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:06 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:06.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:07.165 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:06 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:06.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:07.165 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:06 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:06.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:07.165 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:06 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:06.801+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:07.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:06.988+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:07.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:06.988+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:07.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:06.988+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:07.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:06 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:06.988+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:07.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:07 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:07.491+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:07.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:07 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:07.491+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:07.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:07 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:07.491+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:07.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:07 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:07.491+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:07.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:07 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:07.277+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:07.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:07 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:07.277+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:07.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:07 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:07.277+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:07.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:07 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:07.277+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:07.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:07 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:07.277+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:08.177 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:07 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:07.802+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:08.177 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:07 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:07.802+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:08.177 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:07 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:07.802+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:08.177 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:07 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:07.802+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:08.177 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:07 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:07.802+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:08.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:07 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:07.941+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:08.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:07 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:07.941+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:08.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:07 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:07.941+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:08.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:07 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:07.941+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:08.758 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:08.464+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:08.758 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:08.464+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:08.758 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:08.464+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:08.758 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:08.464+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:08.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:08 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:08.322+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:08.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:08 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:08.322+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:08.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:08 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:08.322+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:08.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:08 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:08.322+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:08.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:08 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:08.322+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:09.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:08 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:08.759+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:09.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:08 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:08.759+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:09.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:08 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:08.759+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:09.014 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:08 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:08.759+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:09.014 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:08 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:08.759+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:09.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:08.960+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:09.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:08.960+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:09.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:08.960+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:09.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:08.960+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:09.752 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:09 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:09.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:09.752 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:09 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:09.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:09.752 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:09 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:09.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:09.752 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:09 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:09.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:09.752 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:09 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:09.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:09.752 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:09 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:09.300+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:09.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:09 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:09.445+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:09.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:09 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:09.445+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:09.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:09 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:09.445+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:09.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:09 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:09.445+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:10.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:09 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:09.941+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:10.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:09 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:09.941+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:10.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:09 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:09.941+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:10.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:09 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:09.941+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:10.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:09 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:09.786+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:10.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:09 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:09.786+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:10.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:09 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:09.786+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:10.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:09 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:09.786+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:10.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:09 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:09.786+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:10.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:09 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:09.786+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:10.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:10.470+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:10.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:10.470+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:10.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:10.470+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:10.757 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:10.470+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:10.757 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:10.470+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.969435+0000 front 2024-09-21T02:48:43.969450+0000 (oldest deadline 2024-09-21T02:49:09.869464+0000) 2024-09-21T02:49:10.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:10.342+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:10.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:10.342+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:10.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:10.342+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:10.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:10.342+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:10.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:10.343+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:10.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:10 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:10.343+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:11.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:10 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:10.750+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:11.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:10 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:10.750+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:11.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:10 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:10.750+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:11.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:10 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:10.750+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:11.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:10 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:10.750+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:11.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:10 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:10.750+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:11.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:10.957+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:11.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:10.957+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:11.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:10.957+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:11.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:10 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:10.957+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:11.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:11 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:11.388+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:11.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:11 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:11.388+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:11.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:11 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:11.388+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:11.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:11 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:11.388+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:11.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:11 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:11.388+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:11.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:11 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:11.388+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:11.978 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:11.507+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:06.663824+0000 front 2024-09-21T02:48:06.663984+0000 (oldest deadline 2024-09-21T02:48:31.363756+0000) 2024-09-21T02:49:11.978 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:11.507+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.065931+0000 front 2024-09-21T02:48:20.065966+0000 (oldest deadline 2024-09-21T02:48:44.766065+0000) 2024-09-21T02:49:11.979 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:11.507+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:25.867134+0000 front 2024-09-21T02:48:25.867260+0000 (oldest deadline 2024-09-21T02:48:52.267413+0000) 2024-09-21T02:49:11.979 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:11.507+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.968624+0000 front 2024-09-21T02:48:36.968696+0000 (oldest deadline 2024-09-21T02:49:02.868677+0000) 2024-09-21T02:49:11.979 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8[52695]: 2024-09-21T02:49:11.507+0000 7f421f845640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.969435+0000 front 2024-09-21T02:48:43.969450+0000 (oldest deadline 2024-09-21T02:49:09.869464+0000) 2024-09-21T02:49:12.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:11 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:11.729+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:12.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:11 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:11.729+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:12.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:11 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:11.729+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:12.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:11 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:11.729+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:12.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:11 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:11.729+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:12.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:11 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:11.729+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:12.256 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:12 smithi172 podman[68029]: 2024-09-21 02:49:12.128397358 +0000 UTC m=+5.595219174 container died a33a0eb11755b2eaee1d7fefc22440040720a06a971a57d2215deb8df4a28862 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:49:12.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:11.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:12.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:11.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:12.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:11.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:12.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:11.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:12.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:11 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:11.977+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:12.692 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:12 smithi172 podman[68029]: 2024-09-21 02:49:12.515334989 +0000 UTC m=+5.982156793 container cleanup a33a0eb11755b2eaee1d7fefc22440040720a06a971a57d2215deb8df4a28862 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:49:12.692 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:12 smithi172 bash[68029]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8 2024-09-21T02:49:12.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:12 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:12.372+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:12.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:12 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:12.372+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:12.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:12 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:12.372+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:12.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:12 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:12.372+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:12.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:12 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:12.372+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:12.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:12 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:12.372+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:13.006 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:12 smithi172 podman[68046]: 2024-09-21 02:49:12.691738063 +0000 UTC m=+0.552127555 container remove a33a0eb11755b2eaee1d7fefc22440040720a06a971a57d2215deb8df4a28862 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T02:49:13.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:12 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:12.935+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:13.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:12 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:12.935+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:13.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:12 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:12.935+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:13.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:12 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:12.935+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:13.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:12 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:12.935+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:13.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:12 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:12.762+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:13.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:12 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:12.762+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:13.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:12 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:12.762+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:13.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:12 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:12.762+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:13.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:12 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:12.762+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:13.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:12 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:12.762+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:13.397 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:13 smithi172 podman[68136]: 2024-09-21 02:49:13.030411093 +0000 UTC m=+0.015620949 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:49:13.397 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:13 smithi172 podman[68136]: 2024-09-21 02:49:13.169823348 +0000 UTC m=+0.155033199 container create bc4a0ce7a7c76bedaa18f062fe8a83993abd00feaa19b36450ac1864d4d6b661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T02:49:13.756 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:13 smithi172 podman[68136]: 2024-09-21 02:49:13.397118848 +0000 UTC m=+0.382328704 container init bc4a0ce7a7c76bedaa18f062fe8a83993abd00feaa19b36450ac1864d4d6b661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T02:49:13.757 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:13 smithi172 podman[68136]: 2024-09-21 02:49:13.400545492 +0000 UTC m=+0.385755345 container start bc4a0ce7a7c76bedaa18f062fe8a83993abd00feaa19b36450ac1864d4d6b661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:49:13.757 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:13 smithi172 podman[68136]: 2024-09-21 02:49:13.505507002 +0000 UTC m=+0.490716852 container attach bc4a0ce7a7c76bedaa18f062fe8a83993abd00feaa19b36450ac1864d4d6b661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T02:49:13.757 INFO:journalctl@ceph.osd.8.smithi172.stdout:Sep 21 02:49:13 smithi172 podman[68136]: 2024-09-21 02:49:13.589298988 +0000 UTC m=+0.574508839 container died bc4a0ce7a7c76bedaa18f062fe8a83993abd00feaa19b36450ac1864d4d6b661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T02:49:13.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:13 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:13.326+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:13.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:13 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:13.326+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:13.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:13 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:13.326+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:13.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:13 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:13.326+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:13.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:13 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:13.326+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:13.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:13 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:13.326+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:14.252 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:13 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:13.886+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:14.252 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:13 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:13.886+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:14.252 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:13 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:13.886+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:14.252 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:13 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:13.886+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:14.252 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:13 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:13.886+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:14.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:13 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:13.796+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:14.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:13 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:13.796+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:14.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:13 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:13.796+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:14.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:13 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:13.796+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:14.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:13 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:13.796+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:14.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:13 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:13.796+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:14.278 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T02:49:14.358 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:14.358 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T02:49:14.359 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T02:49:14.359 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.9 2024-09-21T02:49:14.763 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 systemd[1]: Stopping Ceph osd.9 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:14.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:14 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:14.356+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:14.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:14 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:14.356+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:14.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:14 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:14.356+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:14.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:14 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:14.356+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:14.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:14 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:14.356+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:14.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:14 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:14.356+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:15.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:14 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:14.845+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:15.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:14 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:14.845+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:15.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:14 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:14.845+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:15.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:14 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:14.845+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:15.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:14 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:14.845+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:15.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.762+0000 7f951de00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:15.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.762+0000 7f951de00640 -1 osd.9 92 *** Got signal Terminated *** 2024-09-21T02:49:15.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.762+0000 7f951de00640 -1 osd.9 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:49:15.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.773+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:15.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.773+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:15.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.773+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:15.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.773+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:15.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.773+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:15.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:14 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:14.773+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:15.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:15 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:15.325+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:15.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:15 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:15.325+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:15.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:15 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:15.325+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:15.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:15 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:15.325+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:15.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:15 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:15.325+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:15.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:15 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:15.325+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:16.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:15 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:15.871+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:16.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:15 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:15.871+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:16.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:15 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:15.871+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:16.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:15 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:15.871+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:16.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:15 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:15.871+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:16.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:15 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:15.811+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:16.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:15 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:15.811+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:16.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:15 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:15.811+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:16.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:15 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:15.811+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:16.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:15 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:15.811+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:16.264 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:15 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:15.811+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:16.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:16 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:16.319+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:16.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:16 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:16.319+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:16.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:16 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:16.319+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:16.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:16 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:16.319+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:16.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:16 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:16.319+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:16.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:16 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:16.319+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:17.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:16 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:16.912+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:17.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:16 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:16.912+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:17.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:16 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:16.912+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:17.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:16 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:16.912+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:17.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:16 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:16.912+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:17.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:16 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:16.836+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:17.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:16 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:16.836+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:17.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:16 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:16.836+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:17.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:16 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:16.836+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:17.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:16 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:16.836+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:17.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:16 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:16.836+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:17.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:17 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:17.276+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:17.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:17 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:17.276+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:17.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:17 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:17.276+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:17.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:17 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:17.276+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:17.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:17 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:17.276+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:17.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:17 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:17.276+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:18.229 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:17 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:17.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:18.229 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:17 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:17.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:18.229 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:17 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:17.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:18.229 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:17 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:17.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:18.229 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:17 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:17.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:18.229 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:17 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:17.863+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:18.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:17 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:17.932+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:18.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:17 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:17.932+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:18.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:17 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:17.932+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:18.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:17 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:17.932+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:18.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:17 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:17.932+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:18.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:17 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:17.932+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:18.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:18 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:18.282+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:18.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:18 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:18.282+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:18.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:18 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:18.282+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:18.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:18 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:18.282+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:18.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:18 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:18.282+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:18.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:18 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:18.282+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:18.768 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:18 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:18.282+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:19.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:18.887+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:19.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:18.887+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:19.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:18.887+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:19.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:18.887+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:19.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:18.887+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:19.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:18 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:18.887+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:19.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:18 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:18.816+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.346386+0000 front 2024-09-21T02:48:03.346204+0000 (oldest deadline 2024-09-21T02:48:28.646245+0000) 2024-09-21T02:49:19.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:18 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:18.816+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:14.948242+0000 front 2024-09-21T02:48:14.948505+0000 (oldest deadline 2024-09-21T02:48:40.848275+0000) 2024-09-21T02:49:19.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:18 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:18.816+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:20.849125+0000 front 2024-09-21T02:48:20.849175+0000 (oldest deadline 2024-09-21T02:48:46.748819+0000) 2024-09-21T02:49:19.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:18 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:18.816+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:27.849687+0000 front 2024-09-21T02:48:27.849710+0000 (oldest deadline 2024-09-21T02:48:53.149654+0000) 2024-09-21T02:49:19.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:18 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:18.816+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:39.551393+0000 front 2024-09-21T02:48:39.551296+0000 (oldest deadline 2024-09-21T02:49:03.651318+0000) 2024-09-21T02:49:19.263 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:18 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9[64744]: 2024-09-21T02:49:18.816+0000 7f9519800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.651893+0000 front 2024-09-21T02:48:43.651935+0000 (oldest deadline 2024-09-21T02:49:09.452404+0000) 2024-09-21T02:49:19.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:19 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:19.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:19.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:19 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:19.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:19.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:19 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:19.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:19.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:19 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:19.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:19.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:19 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:19.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:19.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:19 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:19.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:19.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:19 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:19.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:20.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:19 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:19.936+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:20.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:19 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:19.936+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:20.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:19 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:19.936+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:20.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:19 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:19.936+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:20.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:19 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:19.936+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:20.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:19 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:19.936+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:20.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:20 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:20.262+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:20.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:20 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:20.262+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:20.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:20 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:20.262+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:20.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:20 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:20.262+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:20.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:20 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:20.262+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:20.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:20 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:20.262+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:20.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:20 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:20.262+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:20.611 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:20 smithi084 podman[92159]: 2024-09-21 02:49:20.326088451 +0000 UTC m=+5.671895354 container died dc72b82fb1d05ff1f8f5062f0b1019085bb8e97d31cf70b6a35a39a2427cc2b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T02:49:21.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:20 smithi084 podman[92159]: 2024-09-21 02:49:20.82504768 +0000 UTC m=+6.170854582 container cleanup dc72b82fb1d05ff1f8f5062f0b1019085bb8e97d31cf70b6a35a39a2427cc2b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T02:49:21.013 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:20 smithi084 bash[92159]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9 2024-09-21T02:49:21.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:20 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:20.920+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:21.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:20 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:20.920+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:21.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:20 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:20.920+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:21.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:20 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:20.920+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:21.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:20 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:20.920+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:21.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:20 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:20.920+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:21.513 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:21 smithi084 podman[92175]: 2024-09-21 02:49:21.084291427 +0000 UTC m=+0.740885876 container remove dc72b82fb1d05ff1f8f5062f0b1019085bb8e97d31cf70b6a35a39a2427cc2b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T02:49:21.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:21 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:21.239+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:21.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:21 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:21.239+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:21.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:21 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:21.239+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:21.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:21 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:21.239+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:21.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:21 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:21.239+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:21.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:21 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:21.239+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:21.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:21 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:21.239+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:21.830 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:21 smithi084 podman[92260]: 2024-09-21 02:49:21.419984739 +0000 UTC m=+0.027576444 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:49:21.830 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:21 smithi084 podman[92260]: 2024-09-21 02:49:21.543348044 +0000 UTC m=+0.150939753 container create bc1742f472581a59efbed7ee17e72607f9f6ffb2afb9308bda17766cddd24637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T02:49:21.830 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:21 smithi084 podman[92260]: 2024-09-21 02:49:21.829345322 +0000 UTC m=+0.436937031 container init bc1742f472581a59efbed7ee17e72607f9f6ffb2afb9308bda17766cddd24637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:49:22.091 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:21 smithi084 podman[92260]: 2024-09-21 02:49:21.836039787 +0000 UTC m=+0.443631496 container start bc1742f472581a59efbed7ee17e72607f9f6ffb2afb9308bda17766cddd24637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2) 2024-09-21T02:49:22.092 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:21 smithi084 podman[92260]: 2024-09-21 02:49:21.920798532 +0000 UTC m=+0.528390241 container attach bc1742f472581a59efbed7ee17e72607f9f6ffb2afb9308bda17766cddd24637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T02:49:22.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:21 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:21.877+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:22.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:21 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:21.877+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:22.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:21 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:21.877+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:22.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:21 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:21.877+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:22.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:21 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:21.877+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:22.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:21 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:21.877+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:22.417 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 02:49:22 smithi084 podman[92260]: 2024-09-21 02:49:22.091229127 +0000 UTC m=+0.698820837 container died bc1742f472581a59efbed7ee17e72607f9f6ffb2afb9308bda17766cddd24637 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T02:49:22.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:22 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:22.211+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:22.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:22 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:22.211+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:22.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:22 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:22.211+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:22.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:22 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:22.211+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:22.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:22 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:22.211+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:22.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:22 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:22.211+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:22.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:22 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:22.211+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:22.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T02:49:22.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:22.979 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T02:49:22.979 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T02:49:22.979 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.10 2024-09-21T02:49:23.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:22 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:22.910+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:23.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:22 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:22.910+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:23.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:22 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:22.910+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:23.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:22 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:22.910+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:23.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:22 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:22.910+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:23.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:22 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:22.910+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:23.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 systemd[1]: Stopping Ceph osd.10 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:23.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.235+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:23.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.235+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:23.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.235+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:23.268 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.235+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:23.268 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.235+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:23.268 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.235+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:23.268 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.235+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:23.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.271+0000 7fd4e3af8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:23.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.271+0000 7fd4e3af8640 -1 osd.10 92 *** Got signal Terminated *** 2024-09-21T02:49:23.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:23 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:23.271+0000 7fd4e3af8640 -1 osd.10 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:49:24.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:23 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:23.899+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:24.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:23 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:23.899+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:24.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:23 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:23.899+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:24.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:23 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:23.899+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:24.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:23 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:23.899+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:24.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:23 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:23.899+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:24.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:24.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:24.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:24.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:24.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:24.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:24.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:24.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:24.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:24.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:24.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:24.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:24.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:24 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:24.245+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:25.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:24 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:24.918+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:25.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:24 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:24.918+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:25.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:24 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:24.918+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:25.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:24 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:24.918+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:25.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:24 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:24.918+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:25.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:24 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:24.918+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:25.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:25 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:25.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:25.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:25 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:25.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:25.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:25 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:25.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:25.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:25 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:25.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:25.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:25 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:25.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:25.517 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:25 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:25.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:25.518 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:25 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:25.255+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:26.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:25 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:25.905+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:26.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:25 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:25.905+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:26.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:25 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:25.905+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:26.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:25 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:25.905+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:26.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:25 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:25.905+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:26.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:25 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:25.905+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:26.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:26 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:26.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:26.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:26 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:26.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:26.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:26 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:26.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:26.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:26 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:26.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:26.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:26 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:26.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:26.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:26 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:26.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:26.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:26 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:26.288+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:27.158 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:26 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:26.892+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:27.158 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:26 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:26.892+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:27.158 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:26 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:26.892+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:27.158 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:26 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:26.892+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:27.158 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:26 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:26.892+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:27.158 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:26 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:26.892+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:27.158 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:26 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:26.892+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:27.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:27 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:27.336+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:05.454578+0000 front 2024-09-21T02:48:05.454703+0000 (oldest deadline 2024-09-21T02:48:28.354559+0000) 2024-09-21T02:49:27.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:27 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:27.336+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:15.256475+0000 front 2024-09-21T02:48:15.256450+0000 (oldest deadline 2024-09-21T02:48:39.356637+0000) 2024-09-21T02:49:27.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:27 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:27.336+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.357185+0000 front 2024-09-21T02:48:19.357047+0000 (oldest deadline 2024-09-21T02:48:44.657159+0000) 2024-09-21T02:49:27.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:27 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:27.336+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T02:48:29.358227+0000 front 2024-09-21T02:48:29.358148+0000 (oldest deadline 2024-09-21T02:48:52.858156+0000) 2024-09-21T02:49:27.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:27 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:27.336+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:37.459412+0000 front 2024-09-21T02:48:37.459480+0000 (oldest deadline 2024-09-21T02:49:02.159520+0000) 2024-09-21T02:49:27.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:27 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:27.336+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:45.461508+0000 front 2024-09-21T02:48:45.461580+0000 (oldest deadline 2024-09-21T02:49:08.961291+0000) 2024-09-21T02:49:27.767 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:27 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10[57681]: 2024-09-21T02:49:27.336+0000 7fd4e00e3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:53.562712+0000 front 2024-09-21T02:48:53.562817+0000 (oldest deadline 2024-09-21T02:49:17.662230+0000) 2024-09-21T02:49:28.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:27 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:27.854+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:28.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:27 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:27.854+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:28.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:27 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:27.854+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:28.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:27 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:27.854+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:28.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:27 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:27.854+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:28.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:27 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:27.854+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:28.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:27 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:27.854+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:28.992 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:28 smithi090 podman[66657]: 2024-09-21 02:49:28.728777434 +0000 UTC m=+5.559970259 container died 4d07eb8f28fa7736e71da195d309548caed05907f590bc5dc19c4d6079887454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T02:49:29.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:28.805+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:29.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:28.805+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:29.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:28.805+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:29.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:28.805+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:29.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:28.805+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:29.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:28.805+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:29.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:28 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:28.805+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:29.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:29 smithi090 podman[66657]: 2024-09-21 02:49:29.09908867 +0000 UTC m=+5.930281483 container cleanup 4d07eb8f28fa7736e71da195d309548caed05907f590bc5dc19c4d6079887454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T02:49:29.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:29 smithi090 bash[66657]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10 2024-09-21T02:49:29.710 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:29 smithi090 podman[66671]: 2024-09-21 02:49:29.375500661 +0000 UTC m=+0.643891975 container remove 4d07eb8f28fa7736e71da195d309548caed05907f590bc5dc19c4d6079887454 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T02:49:29.965 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:29 smithi090 podman[66760]: 2024-09-21 02:49:29.709721108 +0000 UTC m=+0.111833308 container create f17f14f6f041bb16a86454a000c19492a9c2b01eda6ea48fc7cc1dbac72bc276 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:49:29.965 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:29 smithi090 podman[66760]: 2024-09-21 02:49:29.613270693 +0000 UTC m=+0.015382903 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:49:29.965 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:29 smithi090 podman[66760]: 2024-09-21 02:49:29.964271418 +0000 UTC m=+0.366383615 container init f17f14f6f041bb16a86454a000c19492a9c2b01eda6ea48fc7cc1dbac72bc276 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T02:49:30.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:29 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:29.768+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:30.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:29 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:29.768+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:30.256 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:29 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:29.768+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:30.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:29 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:29.768+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:30.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:29 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:29.768+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:30.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:29 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:29.768+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:30.257 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:29 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:29.768+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:30.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:29 smithi090 podman[66760]: 2024-09-21 02:49:29.967624441 +0000 UTC m=+0.369736639 container start f17f14f6f041bb16a86454a000c19492a9c2b01eda6ea48fc7cc1dbac72bc276 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T02:49:30.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:30 smithi090 podman[66760]: 2024-09-21 02:49:30.055815091 +0000 UTC m=+0.457927297 container attach f17f14f6f041bb16a86454a000c19492a9c2b01eda6ea48fc7cc1dbac72bc276 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:49:30.267 INFO:journalctl@ceph.osd.10.smithi090.stdout:Sep 21 02:49:30 smithi090 podman[66760]: 2024-09-21 02:49:30.149076842 +0000 UTC m=+0.551189048 container died f17f14f6f041bb16a86454a000c19492a9c2b01eda6ea48fc7cc1dbac72bc276 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-10-deactivate, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:49:30.745 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T02:49:30.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:30.782 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T02:49:30.783 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T02:49:30.783 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.11 2024-09-21T02:49:31.104 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:30 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:30.765+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:31.104 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:30 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:30.765+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:31.104 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:30 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:30.765+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:31.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:30 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:30.765+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:31.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:30 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:30.765+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:31.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:30 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:30.765+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:31.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:30 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:30.765+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:31.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:30 smithi172 systemd[1]: Stopping Ceph osd.11 for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:31.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.101+0000 7f337d95f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:31.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.101+0000 7f337d95f640 -1 osd.11 92 *** Got signal Terminated *** 2024-09-21T02:49:31.105 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.101+0000 7f337d95f640 -1 osd.11 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T02:49:32.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.736+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:32.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.736+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:32.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.736+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:32.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.736+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:32.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.736+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:32.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.736+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:32.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:31 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:31.736+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:33.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:32.698+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:33.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:32.698+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:33.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:32.698+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:33.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:32.698+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:33.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:32.698+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:33.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:32.698+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:33.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:32 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:32.698+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:34.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:33.671+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:34.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:33.672+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:34.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:33.672+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:34.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:33.672+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:34.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:33.672+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:34.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:33.672+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:34.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:33 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:33.672+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:35.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:34.695+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:35.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:34.695+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:35.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:34.695+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:35.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:34.695+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:35.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:34.695+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:35.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:34.695+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:35.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:34 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:34.695+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:36.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:35.727+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T02:48:03.576467+0000 front 2024-09-21T02:48:03.576576+0000 (oldest deadline 2024-09-21T02:48:28.276344+0000) 2024-09-21T02:49:36.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:35.727+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6804 osd.1 since back 2024-09-21T02:48:13.978389+0000 front 2024-09-21T02:48:13.978276+0000 (oldest deadline 2024-09-21T02:48:39.878368+0000) 2024-09-21T02:49:36.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:35.727+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.2 since back 2024-09-21T02:48:19.878855+0000 front 2024-09-21T02:48:19.878890+0000 (oldest deadline 2024-09-21T02:48:44.579015+0000) 2024-09-21T02:49:36.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:35.727+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6812 osd.4 since back 2024-09-21T02:48:36.781656+0000 front 2024-09-21T02:48:36.781823+0000 (oldest deadline 2024-09-21T02:49:01.982088+0000) 2024-09-21T02:49:36.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:35.727+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.5 since back 2024-09-21T02:48:43.583596+0000 front 2024-09-21T02:48:43.583649+0000 (oldest deadline 2024-09-21T02:49:11.184110+0000) 2024-09-21T02:49:36.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:35.727+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T02:48:55.285390+0000 front 2024-09-21T02:48:55.285374+0000 (oldest deadline 2024-09-21T02:49:17.584968+0000) 2024-09-21T02:49:36.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:35.727+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.90:6820 osd.7 since back 2024-09-21T02:49:02.286049+0000 front 2024-09-21T02:49:02.285952+0000 (oldest deadline 2024-09-21T02:49:26.385769+0000) 2024-09-21T02:49:36.007 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:35 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11[59342]: 2024-09-21T02:49:35.727+0000 7f3379f4a640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.8 since back 2024-09-21T02:49:09.286609+0000 front 2024-09-21T02:49:09.286657+0000 (oldest deadline 2024-09-21T02:49:35.186718+0000) 2024-09-21T02:49:36.712 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:36 smithi172 podman[68263]: 2024-09-21 02:49:36.437339578 +0000 UTC m=+5.455687715 container died 0b58901da4c52ad076e12193dc8729ff210743ab3ce6c77cee596cea1979d4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T02:49:37.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:36 smithi172 podman[68263]: 2024-09-21 02:49:36.80225649 +0000 UTC m=+5.820604629 container cleanup 0b58901da4c52ad076e12193dc8729ff210743ab3ce6c77cee596cea1979d4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T02:49:37.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:36 smithi172 bash[68263]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11 2024-09-21T02:49:37.353 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:37 smithi172 podman[68279]: 2024-09-21 02:49:37.044939374 +0000 UTC m=+0.606336849 container remove 0b58901da4c52ad076e12193dc8729ff210743ab3ce6c77cee596cea1979d4fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T02:49:37.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:37 smithi172 podman[68370]: 2024-09-21 02:49:37.255413254 +0000 UTC m=+0.015596459 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T02:49:37.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:37 smithi172 podman[68370]: 2024-09-21 02:49:37.362278779 +0000 UTC m=+0.122462011 container create 14db023907a9673629046df6d5d261859cf4750462b2fc01f186e572e27f3b32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:49:37.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:37 smithi172 podman[68370]: 2024-09-21 02:49:37.589359191 +0000 UTC m=+0.349542386 container init 14db023907a9673629046df6d5d261859cf4750462b2fc01f186e572e27f3b32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T02:49:37.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:37 smithi172 podman[68370]: 2024-09-21 02:49:37.592642329 +0000 UTC m=+0.352825524 container start 14db023907a9673629046df6d5d261859cf4750462b2fc01f186e572e27f3b32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T02:49:37.673 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:37 smithi172 podman[68370]: 2024-09-21 02:49:37.672672849 +0000 UTC m=+0.432856044 container attach 14db023907a9673629046df6d5d261859cf4750462b2fc01f186e572e27f3b32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T02:49:38.006 INFO:journalctl@ceph.osd.11.smithi172.stdout:Sep 21 02:49:37 smithi172 podman[68370]: 2024-09-21 02:49:37.780265373 +0000 UTC m=+0.540448563 container died 14db023907a9673629046df6d5d261859cf4750462b2fc01f186e572e27f3b32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T02:49:38.447 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T02:49:38.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:38.485 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T02:49:38.485 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T02:49:38.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.a 2024-09-21T02:49:38.870 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:49:38 smithi084 systemd[1]: Stopping Ceph mds.a for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:39.263 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:49:38 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a[71475]: 2024-09-21T02:49:38.868+0000 7f5cb2400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:39.263 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:49:38 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a[71475]: 2024-09-21T02:49:38.868+0000 7f5cb2400640 -1 mds.a *** got signal Terminated *** 2024-09-21T02:49:40.168 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:49:39 smithi084 podman[92362]: 2024-09-21 02:49:39.861435081 +0000 UTC m=+1.087066492 container died 04c1d944003583146d3948741b024ad9019de5ded47d1e943efa58a4e3a17148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T02:49:40.513 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:49:40 smithi084 podman[92362]: 2024-09-21 02:49:40.373982723 +0000 UTC m=+1.599614127 container cleanup 04c1d944003583146d3948741b024ad9019de5ded47d1e943efa58a4e3a17148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:49:40.513 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:49:40 smithi084 bash[92362]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a 2024-09-21T02:49:40.787 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 02:49:40 smithi084 podman[92375]: 2024-09-21 02:49:40.633512776 +0000 UTC m=+0.757029789 container remove 04c1d944003583146d3948741b024ad9019de5ded47d1e943efa58a4e3a17148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-a, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T02:49:40.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T02:49:40.890 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:40.890 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T02:49:40.890 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T02:49:40.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.d 2024-09-21T02:49:41.131 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:49:40 smithi084 systemd[1]: Stopping Ceph mds.d for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:41.513 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:49:41 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d[70386]: 2024-09-21T02:49:41.314+0000 7fb9c7000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:41.513 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:49:41 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d[70386]: 2024-09-21T02:49:41.314+0000 7fb9c7000640 -1 mds.d *** got signal Terminated *** 2024-09-21T02:49:43.339 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:49:43 smithi084 podman[92495]: 2024-09-21 02:49:43.080537363 +0000 UTC m=+1.872421451 container died a441ab471a1376af9f74c8c2ce1ea2b412a1538c0db7a7dbc5ec317a6bde0860 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T02:49:43.612 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:49:43 smithi084 podman[92495]: 2024-09-21 02:49:43.443651178 +0000 UTC m=+2.235535264 container cleanup a441ab471a1376af9f74c8c2ce1ea2b412a1538c0db7a7dbc5ec317a6bde0860 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T02:49:43.612 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:49:43 smithi084 bash[92495]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d 2024-09-21T02:49:43.871 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 02:49:43 smithi084 podman[92507]: 2024-09-21 02:49:43.61154677 +0000 UTC m=+0.518534864 container remove a441ab471a1376af9f74c8c2ce1ea2b412a1538c0db7a7dbc5ec317a6bde0860 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T02:49:43.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T02:49:43.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:43.949 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T02:49:43.949 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T02:49:43.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.g 2024-09-21T02:49:44.263 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:49:44 smithi084 systemd[1]: Stopping Ceph mds.g for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:44.763 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:49:44 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g[71141]: 2024-09-21T02:49:44.374+0000 7f3874c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:44.763 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:49:44 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g[71141]: 2024-09-21T02:49:44.374+0000 7f3874c00640 -1 mds.g *** got signal Terminated *** 2024-09-21T02:49:48.099 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:49:47 smithi084 podman[92615]: 2024-09-21 02:49:47.821261614 +0000 UTC m=+3.588644585 container died aa068203c8417e14b477b75be57ee5298c1e19427c8a74ca53ef119d6d940f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T02:49:48.448 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:49:48 smithi084 podman[92615]: 2024-09-21 02:49:48.21302068 +0000 UTC m=+3.980403651 container cleanup aa068203c8417e14b477b75be57ee5298c1e19427c8a74ca53ef119d6d940f8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T02:49:48.448 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 02:49:48 smithi084 bash[92615]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-g 2024-09-21T02:49:48.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T02:49:48.708 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:48.708 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T02:49:48.708 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T02:49:48.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.j 2024-09-21T02:49:49.013 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:49:48 smithi084 systemd[1]: Stopping Ceph mds.j for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:49.513 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:49:49 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j[70030]: 2024-09-21T02:49:49.110+0000 7efff0800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:49.513 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:49:49 smithi084 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j[70030]: 2024-09-21T02:49:49.110+0000 7efff0800640 -1 mds.j *** got signal Terminated *** 2024-09-21T02:49:51.221 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:49:50 smithi084 podman[92732]: 2024-09-21 02:49:50.959252302 +0000 UTC m=+1.973195711 container died 4404949de54209ca24bbdb56b7e41250b26bec3b1cde06da7a9af2e599189982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T02:49:51.510 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:49:51 smithi084 podman[92732]: 2024-09-21 02:49:51.308332771 +0000 UTC m=+2.322276180 container cleanup 4404949de54209ca24bbdb56b7e41250b26bec3b1cde06da7a9af2e599189982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T02:49:51.510 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:49:51 smithi084 bash[92732]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j 2024-09-21T02:49:51.763 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 02:49:51 smithi084 podman[92743]: 2024-09-21 02:49:51.509444884 +0000 UTC m=+0.535367068 container remove 4404949de54209ca24bbdb56b7e41250b26bec3b1cde06da7a9af2e599189982 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:49:51.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T02:49:51.847 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:51.848 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T02:49:51.848 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T02:49:51.848 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.b 2024-09-21T02:49:52.165 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:49:51 smithi090 systemd[1]: Stopping Ceph mds.b for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:52.517 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:49:52 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b[63014]: 2024-09-21T02:49:52.163+0000 7ff01df0f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:52.517 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:49:52 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b[63014]: 2024-09-21T02:49:52.163+0000 7ff01df0f640 -1 mds.b *** got signal Terminated *** 2024-09-21T02:49:56.300 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:49:56 smithi090 podman[66876]: 2024-09-21 02:49:56.023110577 +0000 UTC m=+3.978677491 container died 4c2765dca7a27e3e3794c68b379f766d5c96da0897edc2179b731ed8b56ec6bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T02:49:56.667 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:49:56 smithi090 podman[66876]: 2024-09-21 02:49:56.381924335 +0000 UTC m=+4.337491246 container cleanup 4c2765dca7a27e3e3794c68b379f766d5c96da0897edc2179b731ed8b56ec6bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T02:49:56.667 INFO:journalctl@ceph.mds.b.smithi090.stdout:Sep 21 02:49:56 smithi090 bash[66876]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-b 2024-09-21T02:49:56.801 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T02:49:56.836 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:49:56.836 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T02:49:56.836 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T02:49:56.836 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.e 2024-09-21T02:49:57.267 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:49:56 smithi090 systemd[1]: Stopping Ceph mds.e for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:49:57.267 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:49:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e[62464]: 2024-09-21T02:49:57.169+0000 7fbf84e55640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:49:57.267 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:49:57 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e[62464]: 2024-09-21T02:49:57.169+0000 7fbf84e55640 -1 mds.e *** got signal Terminated *** 2024-09-21T02:50:00.321 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:50:00 smithi090 podman[66999]: 2024-09-21 02:50:00.025011493 +0000 UTC m=+2.964141975 container died ce4ceace76bc0743a51506f59fbf880e333be550037744fb927f8d7988c0c45b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T02:50:00.682 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:50:00 smithi090 podman[66999]: 2024-09-21 02:50:00.445489764 +0000 UTC m=+3.384620245 container cleanup ce4ceace76bc0743a51506f59fbf880e333be550037744fb927f8d7988c0c45b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:50:00.682 INFO:journalctl@ceph.mds.e.smithi090.stdout:Sep 21 02:50:00 smithi090 bash[66999]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-e 2024-09-21T02:50:00.907 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T02:50:00.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:50:00.941 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T02:50:00.941 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T02:50:00.941 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.h 2024-09-21T02:50:01.267 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:50:01 smithi090 systemd[1]: Stopping Ceph mds.h for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:50:01.767 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:50:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h[62733]: 2024-09-21T02:50:01.425+0000 7fadf0b5c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:50:01.767 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:50:01 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h[62733]: 2024-09-21T02:50:01.425+0000 7fadf0b5c640 -1 mds.h *** got signal Terminated *** 2024-09-21T02:50:04.312 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:50:04 smithi090 podman[67122]: 2024-09-21 02:50:04.026573513 +0000 UTC m=+2.867239286 container died bce9a61af2cd7e37e717421c92a7537736cbe2ebf24e0fc3608cd51cdf9d9be3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T02:50:04.653 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:50:04 smithi090 podman[67122]: 2024-09-21 02:50:04.417993678 +0000 UTC m=+3.258659457 container cleanup bce9a61af2cd7e37e717421c92a7537736cbe2ebf24e0fc3608cd51cdf9d9be3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T02:50:04.654 INFO:journalctl@ceph.mds.h.smithi090.stdout:Sep 21 02:50:04 smithi090 bash[67122]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-h 2024-09-21T02:50:04.777 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T02:50:04.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:50:04.813 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T02:50:04.813 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T02:50:04.813 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.k 2024-09-21T02:50:05.017 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:50:04 smithi090 systemd[1]: Stopping Ceph mds.k for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:50:05.517 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:50:05 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k[62182]: 2024-09-21T02:50:05.138+0000 7f784d2d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:50:05.517 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:50:05 smithi090 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k[62182]: 2024-09-21T02:50:05.138+0000 7f784d2d0640 -1 mds.k *** got signal Terminated *** 2024-09-21T02:50:07.318 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:50:07 smithi090 podman[67256]: 2024-09-21 02:50:07.053877656 +0000 UTC m=+2.014781296 container died 31e7134a9ca9fd90c0c785966fcfa7d4fd87e28e3e470407ec7a454335fc2f51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T02:50:07.659 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:50:07 smithi090 podman[67256]: 2024-09-21 02:50:07.415753643 +0000 UTC m=+2.376657283 container cleanup 31e7134a9ca9fd90c0c785966fcfa7d4fd87e28e3e470407ec7a454335fc2f51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T02:50:07.659 INFO:journalctl@ceph.mds.k.smithi090.stdout:Sep 21 02:50:07 smithi090 bash[67256]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-k 2024-09-21T02:50:07.792 DEBUG:teuthology.orchestra.run.smithi090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T02:50:07.824 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:50:07.825 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T02:50:07.825 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T02:50:07.825 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.c 2024-09-21T02:50:08.168 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:50:07 smithi172 systemd[1]: Stopping Ceph mds.c for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:50:08.506 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:50:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c[64441]: 2024-09-21T02:50:08.165+0000 7f2dbd599640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:50:08.506 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:50:08 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c[64441]: 2024-09-21T02:50:08.165+0000 7f2dbd599640 -1 mds.c *** got signal Terminated *** 2024-09-21T02:50:12.342 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:50:12 smithi172 podman[68475]: 2024-09-21 02:50:12.044779007 +0000 UTC m=+4.033367195 container died 54c03c993353a35e4bec16b41ffc1787177da2c3a2660feec012846e785be78c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:50:12.709 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:50:12 smithi172 podman[68475]: 2024-09-21 02:50:12.424356894 +0000 UTC m=+4.412945081 container cleanup 54c03c993353a35e4bec16b41ffc1787177da2c3a2660feec012846e785be78c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T02:50:12.709 INFO:journalctl@ceph.mds.c.smithi172.stdout:Sep 21 02:50:12 smithi172 bash[68475]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-c 2024-09-21T02:50:12.863 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T02:50:12.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:50:12.899 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T02:50:12.899 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T02:50:12.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.f 2024-09-21T02:50:13.212 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:50:12 smithi172 systemd[1]: Stopping Ceph mds.f for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:50:13.506 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:50:13 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f[64172]: 2024-09-21T02:50:13.211+0000 7f662cde2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:50:13.506 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:50:13 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f[64172]: 2024-09-21T02:50:13.211+0000 7f662cde2640 -1 mds.f *** got signal Terminated *** 2024-09-21T02:50:16.388 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:50:16 smithi172 podman[68598]: 2024-09-21 02:50:16.04045218 +0000 UTC m=+2.928713123 container died 44166c6d902acbe5db93b7655e0f6be1f6d929e575181f433085db88eabd4562 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T02:50:16.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:50:16 smithi172 podman[68598]: 2024-09-21 02:50:16.469704873 +0000 UTC m=+3.357965828 container cleanup 44166c6d902acbe5db93b7655e0f6be1f6d929e575181f433085db88eabd4562 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T02:50:16.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:50:16 smithi172 bash[68598]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f 2024-09-21T02:50:16.756 INFO:journalctl@ceph.mds.f.smithi172.stdout:Sep 21 02:50:16 smithi172 podman[68612]: 2024-09-21 02:50:16.629189809 +0000 UTC m=+0.585158321 container remove 44166c6d902acbe5db93b7655e0f6be1f6d929e575181f433085db88eabd4562 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T02:50:16.836 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T02:50:16.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:50:16.869 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T02:50:16.869 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T02:50:16.869 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.i 2024-09-21T02:50:17.182 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:50:16 smithi172 systemd[1]: Stopping Ceph mds.i for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:50:17.506 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:50:17 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i[64713]: 2024-09-21T02:50:17.181+0000 7fb3e3131640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:50:17.506 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:50:17 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i[64713]: 2024-09-21T02:50:17.181+0000 7fb3e3131640 -1 mds.i *** got signal Terminated *** 2024-09-21T02:50:20.408 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:50:20 smithi172 podman[68720]: 2024-09-21 02:50:20.027476753 +0000 UTC m=+2.942335769 container died 919b18d18202093b94635647a3eb68e2f1c3b725243c953e38e988128cf1f6ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T02:50:20.756 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:50:20 smithi172 podman[68720]: 2024-09-21 02:50:20.489604607 +0000 UTC m=+3.404463621 container cleanup 919b18d18202093b94635647a3eb68e2f1c3b725243c953e38e988128cf1f6ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-21T02:50:20.757 INFO:journalctl@ceph.mds.i.smithi172.stdout:Sep 21 02:50:20 smithi172 bash[68720]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-i 2024-09-21T02:50:20.926 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T02:50:20.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:50:20.957 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T02:50:20.958 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T02:50:20.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.l 2024-09-21T02:50:21.277 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:50:21 smithi172 systemd[1]: Stopping Ceph mds.l for 5b18da14-77c1-11ef-baf5-efdc52797490... 2024-09-21T02:50:21.756 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:50:21 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l[63908]: 2024-09-21T02:50:21.276+0000 7f869814a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T02:50:21.756 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:50:21 smithi172 ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l[63908]: 2024-09-21T02:50:21.276+0000 7f869814a640 -1 mds.l *** got signal Terminated *** 2024-09-21T02:50:24.636 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:50:24 smithi172 podman[68841]: 2024-09-21 02:50:24.313989705 +0000 UTC m=+3.142171215 container died ae375eb4cf9c4de2743f13e00fc05fd91d2d9d28ea3454dd7143196b13273560 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T02:50:24.953 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:50:24 smithi172 podman[68841]: 2024-09-21 02:50:24.70985002 +0000 UTC m=+3.538031528 container cleanup ae375eb4cf9c4de2743f13e00fc05fd91d2d9d28ea3454dd7143196b13273560 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T02:50:24.953 INFO:journalctl@ceph.mds.l.smithi172.stdout:Sep 21 02:50:24 smithi172 bash[68841]: ceph-5b18da14-77c1-11ef-baf5-efdc52797490-mds-l 2024-09-21T02:50:25.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b18da14-77c1-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T02:50:25.114 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T02:50:25.114 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T02:50:25.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T02:50:25.392 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:50:29.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T02:50:29.524 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting cluster with fsid: 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:50:31.863 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T02:50:32.066 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:50:34.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:50:34.500 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:50:34.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T02:50:34.555 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T02:50:34.557 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi084/crash 2024-09-21T02:50:34.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T02:50:34.614 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T02:50:34.614 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-09-21T02:50:34.618 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi090/crash 2024-09-21T02:50:34.619 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T02:50:34.651 INFO:teuthology.orchestra.run.smithi090.stderr:tar: /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T02:50:34.651 INFO:teuthology.orchestra.run.smithi090.stderr:tar: Error is not recoverable: exiting now 2024-09-21T02:50:34.653 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi172/crash 2024-09-21T02:50:34.654 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash -- . 2024-09-21T02:50:34.697 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T02:50:34.697 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-09-21T02:50:34.698 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T02:50:34.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T02:50:34.785 INFO:tasks.cephadm:Compressing logs... 2024-09-21T02:50:34.785 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T02:50:34.789 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T02:50:34.791 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T02:50:34.814 INFO:teuthology.orchestra.run.smithi090.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T02:50:34.814 INFO:teuthology.orchestra.run.smithi090.stderr:: No such file or directory 2024-09-21T02:50:34.814 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T02:50:34.814 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T02:50:34.814 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T02:50:34.816 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T02:50:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T02:50:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T02:50:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T02:50:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T02:50:34.818 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T02:50:34.818 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2024-09-21T02:50:34.818 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T02:50:34.818 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T02:50:34.818 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr: 82.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr: 90.2% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T02:50:34.822 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T02:50:34.823 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T02:50:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T02:50:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T02:50:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log: 82.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T02:50:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:gzip 95.0% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T02:50:34.825 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T02:50:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T02:50:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.y.log: /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log: 86.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T02:50:34.825 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T02:50:34.826 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T02:50:34.827 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T02:50:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.h.log: 92.0% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T02:50:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T02:50:34.829 INFO:teuthology.orchestra.run.smithi090.stderr: 90.8% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T02:50:34.829 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T02:50:34.830 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T02:50:34.831 INFO:teuthology.orchestra.run.smithi172.stderr: 92.2% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T02:50:34.832 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T02:50:34.832 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T02:50:34.839 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T02:50:34.839 INFO:teuthology.orchestra.run.smithi084.stderr:: No such file or directory 2024-09-21T02:50:34.839 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T02:50:34.840 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T02:50:34.841 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T02:50:34.841 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.9.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T02:50:34.842 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T02:50:34.843 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T02:50:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T02:50:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T02:50:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log: 90.0% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T02:50:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T02:50:34.847 INFO:teuthology.orchestra.run.smithi084.stderr: 82.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T02:50:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T02:50:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log 2024-09-21T02:50:34.850 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T02:50:34.851 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T02:50:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.6.log: 95.0% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T02:50:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T02:50:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T02:50:34.855 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T02:50:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T02:50:34.856 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T02:50:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T02:50:34.858 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.d.log: /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.j.log: 90.9% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T02:50:34.858 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T02:50:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.x.log: /var/log/ceph/cephadm.log: 95.0% 94.8% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.j.log.gz -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T02:50:34.863 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-09-21T02:50:34.866 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T02:50:35.006 INFO:teuthology.orchestra.run.smithi090.stderr: 94.4% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T02:50:35.120 INFO:teuthology.orchestra.run.smithi084.stderr: 90.0% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T02:50:35.199 INFO:teuthology.orchestra.run.smithi172.stderr: 91.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T02:50:35.210 INFO:teuthology.orchestra.run.smithi090.stderr: 91.7% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T02:50:35.364 INFO:teuthology.orchestra.run.smithi172.stderr: 94.9% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T02:50:35.519 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T02:50:36.374 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T02:50:38.635 INFO:teuthology.orchestra.run.smithi090.stderr: 95.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T02:50:38.740 INFO:teuthology.orchestra.run.smithi172.stderr: 91.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T02:50:38.883 INFO:teuthology.orchestra.run.smithi090.stderr: 92.0% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T02:50:38.992 INFO:teuthology.orchestra.run.smithi090.stderr: 92.3% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T02:50:39.516 INFO:teuthology.orchestra.run.smithi084.stderr: 91.7% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T02:50:39.823 INFO:teuthology.orchestra.run.smithi090.stderr: 93.2% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T02:50:39.899 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T02:50:40.149 INFO:teuthology.orchestra.run.smithi084.stderr: 91.9% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T02:50:40.613 INFO:teuthology.orchestra.run.smithi172.stderr: 91.9% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T02:50:40.792 INFO:teuthology.orchestra.run.smithi084.stderr: 91.3% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T02:50:40.794 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-09-21T02:50:40.795 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m5.977s 2024-09-21T02:50:40.795 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m20.265s 2024-09-21T02:50:40.795 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m1.753s 2024-09-21T02:50:41.388 INFO:teuthology.orchestra.run.smithi172.stderr: 92.0% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T02:50:41.577 INFO:teuthology.orchestra.run.smithi090.stderr: 92.1% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T02:50:42.282 INFO:teuthology.orchestra.run.smithi090.stderr: 91.9% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T02:50:42.284 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-09-21T02:50:42.284 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m7.481s 2024-09-21T02:50:42.284 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m30.896s 2024-09-21T02:50:42.285 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m0.954s 2024-09-21T02:50:42.790 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T02:51:11.906 INFO:teuthology.orchestra.run.smithi172.stderr: 93.4% -- replaced with /var/log/ceph/5b18da14-77c1-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T02:51:11.908 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-21T02:51:11.908 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m37.102s 2024-09-21T02:51:11.908 INFO:teuthology.orchestra.run.smithi172.stderr:user 1m1.750s 2024-09-21T02:51:11.908 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m1.989s 2024-09-21T02:51:11.909 INFO:tasks.cephadm:Archiving logs... 2024-09-21T02:51:11.909 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi084/log 2024-09-21T02:51:11.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T02:51:15.146 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi090/log 2024-09-21T02:51:15.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T02:51:19.145 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi172/log 2024-09-21T02:51:19.147 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T02:51:27.752 INFO:tasks.cephadm:Removing cluster... 2024-09-21T02:51:27.752 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 --force 2024-09-21T02:51:28.027 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:51:28.529 DEBUG:teuthology.orchestra.run.smithi090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 --force 2024-09-21T02:51:28.730 INFO:teuthology.orchestra.run.smithi090.stdout:Deleting cluster with fsid: 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:51:29.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b18da14-77c1-11ef-baf5-efdc52797490 --force 2024-09-21T02:51:29.220 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 5b18da14-77c1-11ef-baf5-efdc52797490 2024-09-21T02:51:29.596 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T02:51:29.596 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T02:51:29.636 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T02:51:29.653 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T02:51:29.669 INFO:tasks.cephadm:Teardown complete 2024-09-21T02:51:29.670 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T02:51:29.695 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T02:51:29.696 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T02:51:29.700 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T02:51:29.702 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T02:51:29.832 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T02:51:29.842 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T02:51:29.842 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:51:29.846 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:51:29.848 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T02:51:29.861 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:51:29.862 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:51:29.865 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:51:29.866 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-09-21T02:51:29.866 INFO:teuthology.orchestra.run.smithi090.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -22us[ -17us] +/- 58ms 2024-09-21T02:51:29.866 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -249us[ -244us] +/- 67ms 2024-09-21T02:51:29.866 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +323us[ +327us] +/- 88ms 2024-09-21T02:51:29.866 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:51:29.867 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:51:29.867 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-21T02:51:29.867 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 -24us[ -32us] +/- 58ms 2024-09-21T02:51:29.868 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -234us[ -234us] +/- 67ms 2024-09-21T02:51:29.868 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +340us[ +340us] +/- 88ms 2024-09-21T02:51:29.868 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:51:29.877 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-21T02:51:29.884 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T02:51:29.884 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-21T02:51:29.884 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +18us[ +16us] +/- 58ms 2024-09-21T02:51:29.884 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -217us[ -218us] +/- 67ms 2024-09-21T02:51:29.884 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +371us[ +371us] +/- 88ms 2024-09-21T02:51:29.884 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T02:51:29.885 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T02:51:29.913 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T02:51:29.913 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T02:51:29.944 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T02:51:30.073 DEBUG:teuthology.orchestra.run.smithi090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T02:51:30.139 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T02:51:30.204 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:51:30.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:51:30.264 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:51:30.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:51:30.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T02:51:30.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:51:30.321 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T02:51:30.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T02:51:30.372 INFO:teuthology.task.internal:Duration was 1717.571481 seconds 2024-09-21T02:51:30.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T02:51:30.402 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T02:51:30.402 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T02:51:30.406 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T02:51:30.409 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T02:51:30.446 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:51:30.448 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:51:30.490 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T02:51:30.810 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T02:51:30.810 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T02:51:30.810 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T02:51:30.860 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-09-21T02:51:30.860 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T02:51:30.889 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-21T02:51:30.890 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T02:51:30.916 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T02:51:30.916 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T02:51:30.920 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T02:51:30.932 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T02:51:30.982 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T02:51:30.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T02:51:30.987 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T02:51:30.999 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T02:51:31.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T02:51:31.674 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T02:51:31.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T02:51:31.729 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T02:51:31.756 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T02:51:31.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T02:51:31.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T02:51:31.797 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T02:51:31.799 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T02:51:31.821 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-09-21T02:51:31.845 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-21T02:51:31.863 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-09-21T02:51:31.893 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T02:51:31.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:51:31.926 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T02:51:31.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:51:31.941 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T02:51:31.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T02:51:31.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T02:51:31.967 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T02:51:31.968 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi084 2024-09-21T02:51:31.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T02:51:32.044 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi090 2024-09-21T02:51:32.044 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T02:51:32.079 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913425/remote/smithi172 2024-09-21T02:51:32.079 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T02:51:32.113 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T02:51:32.114 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T02:51:32.118 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T02:51:32.120 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T02:51:32.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T02:51:32.182 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T02:51:32.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T02:51:32.237 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T02:51:32.237 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T02:51:32.241 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T02:51:32.243 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T02:51:32.256 INFO:teuthology.orchestra.run.smithi090.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 02:51 /home/ubuntu/cephtest 2024-09-21T02:51:32.258 INFO:teuthology.orchestra.run.smithi172.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 02:51 /home/ubuntu/cephtest 2024-09-21T02:51:32.271 INFO:teuthology.orchestra.run.smithi084.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 02:51 /home/ubuntu/cephtest 2024-09-21T02:51:32.273 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T02:51:32.285 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T02:51:32.349 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1717.5714809894562 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T02:51:32.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T02:51:32.436 INFO:teuthology.run:pass